Apr 10 13:06:13 devstack cinder-volume[73617]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Apr 10 13:06:13 devstack cinder-volume[73617]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 10 13:06:13 devstack cinder-volume[73617]: we strongly recommend against using it for new projects.
Apr 10 13:06:13 devstack cinder-volume[73617]: If you are already using Eventlet, we recommend migrating to a different
Apr 10 13:06:13 devstack cinder-volume[73617]: framework.  For more detail see
Apr 10 13:06:13 devstack cinder-volume[73617]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 10 13:06:13 devstack cinder-volume[73617]:   import eventlet  # noqa
Apr 10 13:06:15 devstack cinder-volume[73617]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=73617) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 10 13:06:15 devstack cinder-volume[73617]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=73617) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 10 13:06:15 devstack cinder-volume[73617]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=73617) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 10 13:06:15 devstack cinder-volume[73617]: INFO dbcounter [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] Registered counter for database cinder
Apr 10 13:06:15 devstack cinder-volume[73617]: DEBUG oslo_db.sqlalchemy.engines [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73617) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 10 13:06:15 devstack cinder-volume[73617]: DEBUG dbcounter [-] [73617] Writer thread running {{(pid=73617) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 10 13:06:15 devstack cinder-volume[73617]: INFO cinder.rpc [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Apr 10 13:06:15 devstack cinder-volume[73617]: INFO cinder.rpc [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Apr 10 13:06:15 devstack cinder-volume[73617]: DEBUG oslo_db.sqlalchemy.engines [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73617) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 10 13:06:15 devstack cinder-volume[73617]: INFO cinder.volume.manager [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] Determined volume DB was empty at startup.
Apr 10 13:06:15 devstack cinder-volume[73617]: DEBUG cinder.volume.manager [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=73617) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Apr 10 13:06:15 devstack cinder-volume[73617]: INFO cinder.volume.manager [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] Service not found for updating active_backend_id, assuming default for driver init.
Apr 10 13:06:15 devstack cinder-volume[73617]: WARNING stevedore.named [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 10 13:06:15 devstack cinder-volume[73617]: WARNING castellan.key_manager [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 10 13:06:15 devstack cinder-volume[73617]: WARNING cinder.keymgr.conf_key_mgr [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 10 13:06:15 devstack cinder-volume[73617]: DEBUG cinder.volume.drivers.lvm [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=73617) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}}
Apr 10 13:06:15 devstack cinder-volume[73617]: DEBUG oslo_concurrency.processutils [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=73617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_concurrency.processutils [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] CMD "cinder-rtstool verify" returned: 0 in 0.264s {{(pid=73617) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_db.sqlalchemy.engines [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73617) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 10 13:06:16 devstack cinder-volume[73617]: INFO cinder.rpc [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Apr 10 13:06:16 devstack cinder-volume[73617]: INFO cinder.rpc [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Apr 10 13:06:16 devstack cinder-volume[73617]: WARNING stevedore.named [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 10 13:06:16 devstack cinder-volume[73617]: WARNING castellan.key_manager [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 10 13:06:16 devstack cinder-volume[73617]: INFO cinder.volume.manager [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_db.sqlalchemy.engines [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73617) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 10 13:06:16 devstack cinder-volume[73617]: INFO oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] Starting 1 workers
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] Started child 73722 {{(pid=73617) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] Full set of CONF: {{(pid=73617) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] ******************************************************************************** {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] Configuration options gathered from: {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] ================================================================================ {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] allow_availability_zone_fallback = False {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] allow_compression_on_image_upload = False {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] allowed_direct_url_schemes     = [] {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] api_rate_limit                 = True {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] auth_strategy                  = keystone {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] az_cache_duration              = 3600 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] backend_availability_zone      = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73722]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] backend_host                   = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] backend_name                   = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] backend_stats_polling_interval = 60 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] backup_api_class               = cinder.backup.api.API {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] backup_name_template           = backup-%s {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] backup_use_same_host           = False {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] backup_use_temp_snapshot       = False {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] chap_password                  = **** {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] chap_username                  =  {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] cinder_internal_tenant_project_id = 87141a707f79424ba5cb4f3ac4239b63 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] cinder_internal_tenant_user_id = 257156922ff24f0eb77a6b317aba5c23 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] cloned_volume_same_az          = True {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] cluster                        = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] compression_format             = gzip {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] compute_api_class              = cinder.compute.nova.API {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] config_dir                     = [] {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] config_source                  = [] {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] control_exchange               = openstack {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] debug                          = True {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] default_availability_zone      = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] default_group_type             = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] default_volume_type            = lvmdriver-1 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] disk_geometry                  = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] driver_client_cert             = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] driver_client_cert_key         = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] driver_data_namespace          = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] driver_ssl_cert_path           = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] driver_ssl_cert_verify         = False {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] driver_use_ssl                 = False {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] enable_force_upload            = False {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] enable_new_services            = True {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] enable_unsupported_driver      = False {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] enabled_backends               = ['lvmdriver-1'] {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] enforce_multipath_for_image_xfer = False {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] filter_function                = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] glance_api_insecure            = False {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] glance_api_servers             = ['http://192.168.122.117/image'] {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] glance_api_ssl_compression     = False {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] glance_ca_certificates_file    = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] glance_catalog_info            = image:glance:publicURL {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] glance_certfile                = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] glance_keyfile                 = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] glance_num_retries             = 3 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] glance_request_timeout         = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] goodness_function              = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] graceful_shutdown_timeout      = 5 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] group_api_class                = cinder.group.api.API {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] host                           = devstack {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] image_compress_on_upload       = True {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] image_conversion_address_space_limit = 1 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] image_conversion_cpu_limit     = 60 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] image_conversion_disable       = False {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] image_upload_use_cinder_backend = False {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] image_upload_use_internal_tenant = False {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] image_volume_cache_enabled     = False {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] image_volume_cache_max_count   = 0 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] image_volume_cache_max_size_gb = 0 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] init_host_max_objects_retrieval = 0 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] instance_format                = [instance: %(uuid)s]  {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] iscsi_target_flags             =  {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] iscsi_write_cache              = on {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] iser_helper                    = tgtadm {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] iser_ip_address                = 192.168.122.117 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] iser_port                      = 3260 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] log_color                      = False {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] log_config_append              = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] log_dir                        = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] log_file                       = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] log_options                    = True {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] log_rotate_interval            = 1 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] log_rotate_interval_type       = days {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] log_rotation_type              = none {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] max_age                        = 0 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] max_logfile_count              = 30 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] max_logfile_size_mb            = 200 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] max_over_subscription_ratio    = 20.0 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] message_reap_interval          = 86400 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] message_ttl                    = 2592000 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] migration_create_volume_timeout_secs = 300 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] monkey_patch                   = False {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] monkey_patch_modules           = [] {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] my_ip                          = 192.168.122.117 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] no_snapshot_gb_quota           = False {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] num_iser_scan_tries            = 3 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] num_shell_tries                = 3 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] num_volume_device_scan_tries   = 3 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] nvmeof_conn_info_version       = 1 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] nvmet_ns_id                    = 10 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] nvmet_port_id                  = 1 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] osapi_max_limit                = 1000 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] osapi_volume_ext_list          = [] {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] osapi_volume_listen_port       = 8776 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] osapi_volume_use_ssl           = False {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] osapi_volume_workers           = 2 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] per_volume_size_limit          = -1 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] periodic_fuzzy_delay           = 60 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] periodic_interval              = 60 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] public_endpoint                = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] publish_errors                 = False {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] quota_backup_gigabytes         = 1000 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] quota_backups                  = 10 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] quota_gigabytes                = 1000 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] quota_groups                   = 10 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] quota_snapshots                = 10 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] quota_volumes                  = 10 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] rate_limit_burst               = 0 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] rate_limit_except_level        = CRITICAL {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] rate_limit_interval            = 0 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] reinit_driver_count            = 3 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] replication_device             = **** {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] report_discard_supported       = False {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] report_interval                = 120 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] reservation_clean_interval     = 86400 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] reservation_expire             = 86400 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] reserved_image_namespaces      = [] {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] reserved_percentage            = 0 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] rpc_response_timeout           = 120 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] run_external_periodic_tasks    = True {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] scst_target_driver             = iscsi {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] scst_target_iqn_name           = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] service_down_time              = 720 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] shell_completion               = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] snapshot_name_template         = snapshot-%s {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] snapshot_same_host             = True {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] split_loggers                  = False {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] state_path                     = /opt/stack/data/cinder {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] storage_availability_zone      = nova {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] storage_protocol               = iSCSI {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] syslog_log_facility            = LOG_USER {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] target_helper                  = lioadm {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] target_ip_address              = 192.168.122.117 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] target_port                    = 3260 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] target_protocol                = iscsi {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] target_secondary_ip_addresses  = [] {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] trace_flags                    = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] transport_url                  = **** {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] until_refresh                  = 0 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] use_chap_auth                  = False {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] use_default_quota_class        = True {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] use_journal                    = False {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] use_json                       = False {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] use_multipath_for_image_xfer   = False {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] use_stderr                     = False {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] use_syslog                     = False {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] verify_glance_signatures       = enabled {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] volume_api_class               = cinder.volume.api.API {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] volume_backend_name            = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] volume_clear                   = zero {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] volume_clear_ionice            = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] volume_clear_size              = 0 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] volume_copy_bps_limit          = 0 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] volume_dd_blocksize            = 1M {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] volume_name_template           = volume-%s {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73722]: INFO cinder.volume.manager [None req-5406b48b-df62-4b48-b3e5-c64a3d2a076b None None] Starting volume driver LVMVolumeDriver (3.0.0)
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] volume_service_inithost_offload = False {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] volume_usage_audit_period      = month {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] zoning_mode                    = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73722]: DEBUG oslo_concurrency.processutils [None req-5406b48b-df62-4b48-b3e5-c64a3d2a076b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73722) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] oslo_concurrency.disable_process_locking = False {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] keystone_authtoken.admin_password = **** {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] keystone_authtoken.admin_token = **** {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] keystone_authtoken.admin_user  = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] keystone_authtoken.auth_admin_prefix =  {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] keystone_authtoken.auth_port   = 35357 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] keystone_authtoken.auth_protocol = https {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] keystone_authtoken.auth_section = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] keystone_authtoken.auth_type   = password {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] keystone_authtoken.auth_uri    = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] keystone_authtoken.auth_version = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] keystone_authtoken.cache       = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] keystone_authtoken.certfile    = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] keystone_authtoken.delay_auth_decision = False {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] keystone_authtoken.http_connect_timeout = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] keystone_authtoken.identity_uri = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] keystone_authtoken.include_service_catalog = True {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] keystone_authtoken.insecure    = False {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] keystone_authtoken.interface   = public {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] keystone_authtoken.keyfile     = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] keystone_authtoken.memcache_password =  {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] keystone_authtoken.memcache_username =  {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] keystone_authtoken.region_name = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] keystone_authtoken.service_token_roles_required = False {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] keystone_authtoken.service_type = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] keystone_authtoken.token_cache_time = 300 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.117/identity {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] cache.backend                  = dogpile.cache.null {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] cache.backend_argument         = **** {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] cache.backend_expiration_time  = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] cache.config_prefix            = cache.oslo {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] cache.debug_cache_backend      = False {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] cache.enable_retry_client      = False {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] cache.enable_socket_keepalive  = False {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] cache.enabled                  = False {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] cache.enforce_fips_mode        = False {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] cache.expiration_time          = 600 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] cache.hashclient_retry_attempts = 2 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] cache.memcache_dead_retry      = 300 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] cache.memcache_pool_maxsize    = 10 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] cache.memcache_sasl_enabled    = False {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] cache.password                 = **** {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] cache.proxies                  = [] {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] cache.redis_db                 = 0 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] cache.redis_sentinel_service_name = mymaster {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] cache.redis_server             = localhost:6379 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] cache.retry_attempts           = 2 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] cache.retry_delay              = 0.0 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] cache.socket_keepalive_count   = 1 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] cache.socket_keepalive_idle    = 1 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] cache.socket_keepalive_interval = 1 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] cache.socket_timeout           = 1.0 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] cache.tls_allowed_ciphers      = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] cache.tls_cafile               = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] cache.tls_certfile             = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] cache.tls_enabled              = False {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] cache.tls_keyfile              = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] cache.username                 = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] coordination.backend_url       = **** {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] database.asyncio_connection    = **** {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] database.asyncio_slave_connection = **** {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] database.backend               = sqlalchemy {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] database.connection            = **** {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] database.connection_debug      = 0 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] database.connection_parameters =  {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] database.connection_recycle_time = 3600 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] database.connection_trace      = False {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] database.db_inc_retry_interval = True {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] database.db_max_retries        = 20 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] database.db_max_retry_interval = 10 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] database.db_retry_interval     = 1 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] database.max_overflow          = 50 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] database.max_pool_size         = 5 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] database.max_retries           = 10 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] database.mysql_wsrep_sync_wait = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] database.pool_timeout          = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] database.retry_interval        = 10 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] database.slave_connection      = **** {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] database.sqlite_synchronous    = True {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] database.synchronous_reader    = True {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] database.use_db_reconnect      = False {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73722]: DEBUG oslo_concurrency.processutils [None req-5406b48b-df62-4b48-b3e5-c64a3d2a076b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.031s {{(pid=73722) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] profiler.connection_string     = messaging:// {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] profiler.enabled               = False {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] profiler.es_doc_type           = notification {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] profiler.es_scroll_size        = 10000 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73722]: DEBUG oslo_concurrency.processutils [None req-5406b48b-df62-4b48-b3e5-c64a3d2a076b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73722) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] profiler.es_scroll_time        = 2m {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] profiler.filter_error_trace    = False {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] profiler.hmac_keys             = **** {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] profiler.sentinel_service_name = mymaster {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] profiler.socket_timeout        = 0.1 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] profiler.trace_requests        = False {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] profiler.trace_sqlalchemy      = False {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] profiler_jaeger.process_tags   = {} {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] profiler_jaeger.service_name_prefix = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] profiler_otlp.service_name_prefix = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] oslo_policy.enforce_new_defaults = False {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: WARNING oslo_config.cfg [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] oslo_policy.enforce_scope      = False {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] oslo_policy.policy_default_rule = default {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] oslo_policy.policy_file        = policy.yaml {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] privsep_osbrick.group          = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] privsep_osbrick.helper_command = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] privsep_osbrick.user           = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] cinder_sys_admin.group         = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] cinder_sys_admin.helper_command = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] cinder_sys_admin.user          = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] service_user.auth_section      = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] service_user.auth_type         = password {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] service_user.cafile            = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] service_user.certfile          = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] service_user.collect_timing    = False {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] service_user.insecure          = False {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] service_user.keyfile           = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] service_user.send_service_user_token = True {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] service_user.split_loggers     = False {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] service_user.timeout           = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] glance.auth_section            = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] glance.auth_type               = password {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] glance.certfile                = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] glance.collect_timing          = False {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] glance.insecure                = False {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] glance.keyfile                 = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] glance.region_name             = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] glance.split_loggers           = False {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] glance.timeout                 = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] backend_defaults.backend_availability_zone = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] backend_defaults.chap_password = **** {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] backend_defaults.chap_username =  {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] backend_defaults.disk_geometry = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] backend_defaults.driver_client_cert = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] backend_defaults.driver_client_cert_key = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] backend_defaults.driver_data_namespace = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73722]: DEBUG oslo_concurrency.processutils [None req-5406b48b-df62-4b48-b3e5-c64a3d2a076b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=73722) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] backend_defaults.driver_use_ssl = False {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] backend_defaults.enable_unsupported_driver = False {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73722]: DEBUG oslo_concurrency.processutils [None req-5406b48b-df62-4b48-b3e5-c64a3d2a076b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73722) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] backend_defaults.extra_capabilities = {} {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] backend_defaults.filter_function = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] backend_defaults.goodness_function = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] backend_defaults.iscsi_target_flags =  {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] backend_defaults.iscsi_write_cache = on {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] backend_defaults.iser_helper   = tgtadm {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] backend_defaults.iser_ip_address = 192.168.122.117 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] backend_defaults.iser_port     = 3260 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] backend_defaults.lvm_mirrors   = 0 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] backend_defaults.lvm_share_target = False {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] backend_defaults.lvm_type      = auto {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] backend_defaults.num_shell_tries = 3 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] backend_defaults.nvmet_port_id = 1 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] backend_defaults.replication_device = **** {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] backend_defaults.report_discard_supported = False {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] backend_defaults.reserved_percentage = 0 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] backend_defaults.scst_target_driver = iscsi {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] backend_defaults.scst_target_iqn_name = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] backend_defaults.storage_protocol = iSCSI {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] backend_defaults.target_helper = tgtadm {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] backend_defaults.target_ip_address = 192.168.122.117 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] backend_defaults.target_port   = 3260 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] backend_defaults.target_protocol = iscsi {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] backend_defaults.trace_flags   = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] backend_defaults.unique_fqdn_network = True {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] backend_defaults.use_chap_auth = False {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] backend_defaults.volume_backend_name = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] backend_defaults.volume_clear  = zero {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] backend_defaults.volume_clear_ionice = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] backend_defaults.volume_clear_size = 0 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] backend_defaults.volume_group  = cinder-volumes {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] oslo_reports.file_event_handler = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] oslo_reports.log_dir           = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] lvmdriver-1.backend_availability_zone = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] lvmdriver-1.backend_host       = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] lvmdriver-1.chap_password      = **** {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] lvmdriver-1.chap_username      = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] lvmdriver-1.chiscsi_conf       = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] lvmdriver-1.disk_geometry      = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] lvmdriver-1.driver_client_cert = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] lvmdriver-1.driver_data_namespace = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] lvmdriver-1.driver_use_ssl     = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73722]: DEBUG oslo_concurrency.processutils [None req-5406b48b-df62-4b48-b3e5-c64a3d2a076b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=73722) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] lvmdriver-1.extra_capabilities = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73722]: DEBUG oslo_concurrency.processutils [None req-5406b48b-df62-4b48-b3e5-c64a3d2a076b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=73722) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] lvmdriver-1.filter_function    = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] lvmdriver-1.goodness_function  = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] lvmdriver-1.iser_helper        = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] lvmdriver-1.iser_ip_address    = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] lvmdriver-1.iser_port          = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] lvmdriver-1.iser_target_prefix = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] lvmdriver-1.lvm_conf_file      = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] lvmdriver-1.lvm_mirrors        = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] lvmdriver-1.lvm_share_target   = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] lvmdriver-1.lvm_type           = auto {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] lvmdriver-1.num_shell_tries    = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] lvmdriver-1.nvmet_port_id      = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] lvmdriver-1.replication_device = **** {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] lvmdriver-1.report_discard_supported = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] lvmdriver-1.reserved_percentage = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] lvmdriver-1.scst_target_driver = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] lvmdriver-1.storage_protocol   = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] lvmdriver-1.target_helper      = lioadm {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] lvmdriver-1.target_ip_address  = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] lvmdriver-1.target_port        = 3260 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] lvmdriver-1.target_protocol    = iscsi {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] lvmdriver-1.trace_flags        = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] lvmdriver-1.use_chap_auth      = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] lvmdriver-1.volume_clear       = zero {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] lvmdriver-1.volume_clear_size  = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] lvmdriver-1.volumes_dir        = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] oslo_messaging_rabbit.ssl      = False {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] oslo_messaging_notifications.driver = [] {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] oslo_messaging_notifications.retry = -1 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] oslo_messaging_notifications.transport_url = **** {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] key_manager.fixed_key          = **** {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] barbican.barbican_api_version  = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] barbican.barbican_endpoint     = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] barbican.barbican_endpoint_type = public {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] barbican.barbican_region_name  = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] barbican.cafile                = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] barbican.certfile              = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] barbican.collect_timing        = False {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] barbican.insecure              = False {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] barbican.keyfile               = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] barbican.number_of_retries     = 60 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] barbican.retry_delay           = 1 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] barbican.send_service_user_token = False {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] barbican.split_loggers         = False {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] barbican.timeout               = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] barbican.verify_ssl            = True {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] barbican.verify_ssl_path       = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] barbican_service_user.auth_section = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] barbican_service_user.auth_type = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] barbican_service_user.cafile   = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] barbican_service_user.certfile = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] barbican_service_user.collect_timing = False {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] barbican_service_user.insecure = False {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] barbican_service_user.keyfile  = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] barbican_service_user.split_loggers = False {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] barbican_service_user.timeout  = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] vault.approle_role_id          = **** {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] vault.approle_secret_id        = **** {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] vault.kv_mountpoint            = secret {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] vault.kv_path                  = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] vault.kv_version               = 2 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] vault.namespace                = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] vault.root_token_id            = **** {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] vault.ssl_ca_crt_file          = None {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] vault.timeout                  = 60.0 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] vault.use_ssl                  = False {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:06:16 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] ******************************************************************************** {{(pid=73617) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}}
Apr 10 13:06:16 devstack sudo[73726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Apr 10 13:06:16 devstack sudo[73726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:06:17 devstack sudo[73726]: pam_unix(sudo:session): session closed for user root
Apr 10 13:06:17 devstack cinder-volume[73722]: DEBUG oslo_concurrency.processutils [None req-5406b48b-df62-4b48-b3e5-c64a3d2a076b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.575s {{(pid=73722) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:06:17 devstack cinder-volume[73722]: DEBUG oslo_concurrency.processutils [None req-5406b48b-df62-4b48-b3e5-c64a3d2a076b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73722) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:06:17 devstack sudo[73779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 10 13:06:17 devstack sudo[73779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:06:17 devstack sudo[73779]: pam_unix(sudo:session): session closed for user root
Apr 10 13:06:17 devstack cinder-volume[73722]: DEBUG oslo_concurrency.processutils [None req-5406b48b-df62-4b48-b3e5-c64a3d2a076b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.526s {{(pid=73722) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:06:17 devstack cinder-volume[73722]: DEBUG oslo_concurrency.processutils [None req-5406b48b-df62-4b48-b3e5-c64a3d2a076b None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=73722) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 10 13:06:17 devstack cinder-volume[73722]: INFO cinder.brick.local_dev.lvm [None req-5406b48b-df62-4b48-b3e5-c64a3d2a076b None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Apr 10 13:06:17 devstack cinder-volume[73722]: DEBUG oslo_concurrency.processutils [None req-5406b48b-df62-4b48-b3e5-c64a3d2a076b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73722) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:06:17 devstack cinder-volume[73722]: DEBUG oslo_concurrency.processutils [None req-5406b48b-df62-4b48-b3e5-c64a3d2a076b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.014s {{(pid=73722) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:06:17 devstack cinder-volume[73722]: DEBUG oslo_concurrency.processutils [None req-5406b48b-df62-4b48-b3e5-c64a3d2a076b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73722) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:06:17 devstack sudo[73996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 10 13:06:17 devstack sudo[73996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:06:18 devstack sudo[73996]: pam_unix(sudo:session): session closed for user root
Apr 10 13:06:18 devstack cinder-volume[73722]: DEBUG oslo_concurrency.processutils [None req-5406b48b-df62-4b48-b3e5-c64a3d2a076b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.517s {{(pid=73722) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:06:18 devstack cinder-volume[73722]: DEBUG cinder.brick.local_dev.lvm [None req-5406b48b-df62-4b48-b3e5-c64a3d2a076b None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=73722) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}}
Apr 10 13:06:18 devstack cinder-volume[73722]: DEBUG oslo_concurrency.processutils [None req-5406b48b-df62-4b48-b3e5-c64a3d2a076b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73722) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:06:18 devstack sudo[74212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 10 13:06:18 devstack sudo[74212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:06:19 devstack sudo[74212]: pam_unix(sudo:session): session closed for user root
Apr 10 13:06:19 devstack cinder-volume[73722]: DEBUG oslo_concurrency.processutils [None req-5406b48b-df62-4b48-b3e5-c64a3d2a076b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.160s {{(pid=73722) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:06:19 devstack cinder-volume[73722]: DEBUG oslo_concurrency.processutils [None req-5406b48b-df62-4b48-b3e5-c64a3d2a076b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73722) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:06:19 devstack cinder-volume[73722]: DEBUG oslo_concurrency.processutils [None req-5406b48b-df62-4b48-b3e5-c64a3d2a076b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=73722) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:06:19 devstack cinder-volume[73722]: DEBUG oslo_concurrency.processutils [None req-5406b48b-df62-4b48-b3e5-c64a3d2a076b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73722) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:06:19 devstack sudo[74420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 10 13:06:19 devstack sudo[74420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:06:19 devstack sudo[74420]: pam_unix(sudo:session): session closed for user root
Apr 10 13:06:19 devstack cinder-volume[73722]: DEBUG oslo_concurrency.processutils [None req-5406b48b-df62-4b48-b3e5-c64a3d2a076b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.480s {{(pid=73722) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:06:19 devstack cinder-volume[73722]: DEBUG oslo_concurrency.processutils [None req-5406b48b-df62-4b48-b3e5-c64a3d2a076b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73722) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:06:19 devstack cinder-volume[73722]: DEBUG oslo_concurrency.processutils [None req-5406b48b-df62-4b48-b3e5-c64a3d2a076b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=73722) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:06:19 devstack cinder-volume[73722]: DEBUG oslo_concurrency.processutils [None req-5406b48b-df62-4b48-b3e5-c64a3d2a076b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=73722) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:06:19 devstack sudo[74424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Apr 10 13:06:19 devstack sudo[74424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:06:20 devstack sudo[74424]: pam_unix(sudo:session): session closed for user root
Apr 10 13:06:20 devstack cinder-volume[73722]: DEBUG oslo_concurrency.processutils [None req-5406b48b-df62-4b48-b3e5-c64a3d2a076b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.480s {{(pid=73722) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:06:20 devstack cinder-volume[73722]: DEBUG oslo_concurrency.processutils [None req-5406b48b-df62-4b48-b3e5-c64a3d2a076b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73722) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:06:20 devstack sudo[74427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 10 13:06:20 devstack sudo[74427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:06:20 devstack sudo[74427]: pam_unix(sudo:session): session closed for user root
Apr 10 13:06:20 devstack cinder-volume[73722]: DEBUG oslo_concurrency.processutils [None req-5406b48b-df62-4b48-b3e5-c64a3d2a076b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.528s {{(pid=73722) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:06:20 devstack cinder-volume[73722]: DEBUG oslo_concurrency.processutils [None req-5406b48b-df62-4b48-b3e5-c64a3d2a076b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73722) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:06:20 devstack sudo[74436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 10 13:06:20 devstack sudo[74436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:06:21 devstack sudo[74436]: pam_unix(sudo:session): session closed for user root
Apr 10 13:06:21 devstack cinder-volume[73722]: DEBUG oslo_concurrency.processutils [None req-5406b48b-df62-4b48-b3e5-c64a3d2a076b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.467s {{(pid=73722) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:06:21 devstack cinder-volume[73722]: DEBUG oslo_concurrency.processutils [None req-5406b48b-df62-4b48-b3e5-c64a3d2a076b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73722) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:06:21 devstack sudo[74441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 10 13:06:21 devstack sudo[74441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:06:21 devstack sudo[74441]: pam_unix(sudo:session): session closed for user root
Apr 10 13:06:21 devstack cinder-volume[73722]: DEBUG oslo_concurrency.processutils [None req-5406b48b-df62-4b48-b3e5-c64a3d2a076b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.470s {{(pid=73722) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:06:21 devstack cinder-volume[73722]: DEBUG oslo_concurrency.processutils [None req-5406b48b-df62-4b48-b3e5-c64a3d2a076b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73722) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:06:21 devstack sudo[74445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 10 13:06:21 devstack sudo[74445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:06:22 devstack sudo[74445]: pam_unix(sudo:session): session closed for user root
Apr 10 13:06:22 devstack cinder-volume[73722]: DEBUG oslo_concurrency.processutils [None req-5406b48b-df62-4b48-b3e5-c64a3d2a076b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.505s {{(pid=73722) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:06:22 devstack cinder-volume[73722]: DEBUG oslo_concurrency.processutils [None req-5406b48b-df62-4b48-b3e5-c64a3d2a076b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73722) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:06:22 devstack cinder-volume[73722]: DEBUG oslo_concurrency.processutils [None req-5406b48b-df62-4b48-b3e5-c64a3d2a076b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.030s {{(pid=73722) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:06:22 devstack cinder-volume[73722]: DEBUG oslo_concurrency.processutils [None req-5406b48b-df62-4b48-b3e5-c64a3d2a076b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73722) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:06:22 devstack sudo[74454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 10 13:06:22 devstack sudo[74454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:06:22 devstack sudo[74454]: pam_unix(sudo:session): session closed for user root
Apr 10 13:06:22 devstack cinder-volume[73722]: DEBUG oslo_concurrency.processutils [None req-5406b48b-df62-4b48-b3e5-c64a3d2a076b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.551s {{(pid=73722) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:06:22 devstack cinder-volume[73722]: INFO cinder.volume.drivers.lvm [None req-5406b48b-df62-4b48-b3e5-c64a3d2a076b None None] Enabling LVM thin provisioning by default because a thin pool exists.
Apr 10 13:06:22 devstack cinder-volume[73722]: DEBUG oslo_concurrency.processutils [None req-5406b48b-df62-4b48-b3e5-c64a3d2a076b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73722) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:06:22 devstack cinder-volume[73722]: DEBUG oslo_concurrency.processutils [None req-5406b48b-df62-4b48-b3e5-c64a3d2a076b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.014s {{(pid=73722) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:06:22 devstack cinder-volume[73722]: DEBUG oslo_concurrency.processutils [None req-5406b48b-df62-4b48-b3e5-c64a3d2a076b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73722) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:06:22 devstack sudo[74571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 10 13:06:22 devstack sudo[74571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:06:23 devstack sudo[74571]: pam_unix(sudo:session): session closed for user root
Apr 10 13:06:23 devstack cinder-volume[73722]: DEBUG oslo_concurrency.processutils [None req-5406b48b-df62-4b48-b3e5-c64a3d2a076b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.461s {{(pid=73722) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:06:23 devstack cinder-volume[73722]: DEBUG cinder.volume.drivers.lvm [None req-5406b48b-df62-4b48-b3e5-c64a3d2a076b None None] Updating volume stats {{(pid=73722) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 10 13:06:23 devstack cinder-volume[73722]: DEBUG oslo_concurrency.processutils [None req-5406b48b-df62-4b48-b3e5-c64a3d2a076b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73722) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:06:23 devstack sudo[74599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 10 13:06:23 devstack sudo[74599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:06:23 devstack sudo[74599]: pam_unix(sudo:session): session closed for user root
Apr 10 13:06:23 devstack cinder-volume[73722]: DEBUG oslo_concurrency.processutils [None req-5406b48b-df62-4b48-b3e5-c64a3d2a076b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.434s {{(pid=73722) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:06:23 devstack cinder-volume[73722]: DEBUG oslo_concurrency.processutils [None req-5406b48b-df62-4b48-b3e5-c64a3d2a076b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73722) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:06:23 devstack sudo[74713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 10 13:06:23 devstack sudo[74713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:06:24 devstack sudo[74713]: pam_unix(sudo:session): session closed for user root
Apr 10 13:06:24 devstack cinder-volume[73722]: DEBUG oslo_concurrency.processutils [None req-5406b48b-df62-4b48-b3e5-c64a3d2a076b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.447s {{(pid=73722) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:06:24 devstack cinder-volume[73722]: DEBUG oslo_concurrency.processutils [None req-5406b48b-df62-4b48-b3e5-c64a3d2a076b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73722) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:06:24 devstack sudo[74716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 10 13:06:24 devstack sudo[74716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:06:24 devstack sudo[74716]: pam_unix(sudo:session): session closed for user root
Apr 10 13:06:24 devstack cinder-volume[73722]: DEBUG oslo_concurrency.processutils [None req-5406b48b-df62-4b48-b3e5-c64a3d2a076b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.466s {{(pid=73722) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:06:24 devstack cinder-volume[73722]: DEBUG oslo_concurrency.processutils [None req-5406b48b-df62-4b48-b3e5-c64a3d2a076b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73722) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:06:24 devstack sudo[74755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 10 13:06:24 devstack sudo[74755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:06:25 devstack sudo[74755]: pam_unix(sudo:session): session closed for user root
Apr 10 13:06:25 devstack cinder-volume[73722]: DEBUG oslo_concurrency.processutils [None req-5406b48b-df62-4b48-b3e5-c64a3d2a076b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.460s {{(pid=73722) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:06:25 devstack cinder-volume[73722]: INFO cinder.volume.driver [None req-5406b48b-df62-4b48-b3e5-c64a3d2a076b None None] Driver hasn't implemented _init_vendor_properties()
Apr 10 13:06:25 devstack cinder-volume[73722]: DEBUG cinder.volume.driver [None req-5406b48b-df62-4b48-b3e5-c64a3d2a076b None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=73722) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Apr 10 13:06:25 devstack cinder-volume[73722]: DEBUG oslo_db.sqlalchemy.engines [None req-5406b48b-df62-4b48-b3e5-c64a3d2a076b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73722) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 10 13:06:25 devstack cinder-volume[73722]: DEBUG dbcounter [-] [73722] Writer thread running {{(pid=73722) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 10 13:06:25 devstack cinder-volume[73722]: DEBUG cinder.db.sqlalchemy.api [None req-5406b48b-df62-4b48-b3e5-c64a3d2a076b None None] Building query based on filter {{(pid=73722) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Apr 10 13:06:25 devstack cinder-volume[73722]: DEBUG cinder.image.image_utils [None req-5406b48b-df62-4b48-b3e5-c64a3d2a076b None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=73722) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Apr 10 13:06:25 devstack cinder-volume[73722]: INFO cinder.keymgr.migration [None req-ac5f3099-2dc4-4d31-b67e-3b1770be0bb1 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Apr 10 13:06:25 devstack cinder-volume[73722]: DEBUG cinder.volume.drivers.lvm [None req-5406b48b-df62-4b48-b3e5-c64a3d2a076b None None] Updating volume stats {{(pid=73722) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 10 13:06:25 devstack cinder-volume[73722]: DEBUG oslo_concurrency.processutils [None req-5406b48b-df62-4b48-b3e5-c64a3d2a076b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73722) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:06:25 devstack sudo[74762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 10 13:06:25 devstack sudo[74762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:06:25 devstack sudo[74762]: pam_unix(sudo:session): session closed for user root
Apr 10 13:06:25 devstack cinder-volume[73722]: DEBUG oslo_concurrency.processutils [None req-5406b48b-df62-4b48-b3e5-c64a3d2a076b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.504s {{(pid=73722) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:06:25 devstack cinder-volume[73722]: DEBUG oslo_concurrency.processutils [None req-5406b48b-df62-4b48-b3e5-c64a3d2a076b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73722) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:06:25 devstack sudo[74765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 10 13:06:25 devstack sudo[74765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:06:26 devstack sudo[74765]: pam_unix(sudo:session): session closed for user root
Apr 10 13:06:26 devstack cinder-volume[73722]: DEBUG oslo_concurrency.processutils [None req-5406b48b-df62-4b48-b3e5-c64a3d2a076b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.528s {{(pid=73722) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:06:26 devstack cinder-volume[73722]: DEBUG oslo_concurrency.processutils [None req-5406b48b-df62-4b48-b3e5-c64a3d2a076b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73722) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:06:26 devstack sudo[74770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 10 13:06:26 devstack sudo[74770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:06:26 devstack cinder-volume[73617]: DEBUG dbcounter [-] [73617] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=73617) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 10 13:06:26 devstack sudo[74770]: pam_unix(sudo:session): session closed for user root
Apr 10 13:06:26 devstack cinder-volume[73722]: DEBUG oslo_concurrency.processutils [None req-5406b48b-df62-4b48-b3e5-c64a3d2a076b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.503s {{(pid=73722) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:06:26 devstack cinder-volume[73722]: DEBUG oslo_concurrency.processutils [None req-5406b48b-df62-4b48-b3e5-c64a3d2a076b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73722) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:06:26 devstack sudo[74779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 10 13:06:26 devstack sudo[74779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:06:27 devstack sudo[74779]: pam_unix(sudo:session): session closed for user root
Apr 10 13:06:27 devstack cinder-volume[73722]: DEBUG oslo_concurrency.processutils [None req-5406b48b-df62-4b48-b3e5-c64a3d2a076b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.511s {{(pid=73722) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:06:27 devstack cinder-volume[73722]: DEBUG cinder.manager [None req-5406b48b-df62-4b48-b3e5-c64a3d2a076b None None] Notifying Schedulers of capabilities ... {{(pid=73722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:06:27 devstack cinder-volume[73722]: INFO cinder.volume.manager [None req-5406b48b-df62-4b48-b3e5-c64a3d2a076b None None] Driver initialization completed successfully.
Apr 10 13:06:27 devstack cinder-volume[73722]: INFO cinder.manager [None req-5406b48b-df62-4b48-b3e5-c64a3d2a076b None None] Initiating service 2 cleanup
Apr 10 13:06:27 devstack cinder-volume[73722]: INFO cinder.manager [None req-5406b48b-df62-4b48-b3e5-c64a3d2a076b None None] Service 2 cleanup completed.
Apr 10 13:06:27 devstack cinder-volume[73722]: DEBUG cinder.service [None req-5406b48b-df62-4b48-b3e5-c64a3d2a076b None None] Creating RPC server for service cinder-volume {{(pid=73722) start /opt/stack/cinder/cinder/service.py:231}}
Apr 10 13:06:27 devstack cinder-volume[73722]: DEBUG cinder.service [None req-5406b48b-df62-4b48-b3e5-c64a3d2a076b None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=73722) start /opt/stack/cinder/cinder/service.py:237}}
Apr 10 13:06:27 devstack cinder-volume[73722]: INFO cinder.volume.manager [None req-5406b48b-df62-4b48-b3e5-c64a3d2a076b None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Apr 10 13:06:27 devstack cinder-volume[73722]: DEBUG cinder.volume.drivers.lvm [None req-5406b48b-df62-4b48-b3e5-c64a3d2a076b None None] Updating volume stats {{(pid=73722) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 10 13:06:27 devstack cinder-volume[73722]: DEBUG oslo_concurrency.processutils [None req-5406b48b-df62-4b48-b3e5-c64a3d2a076b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73722) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:06:27 devstack sudo[74783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 10 13:06:27 devstack sudo[74783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:06:27 devstack sudo[74783]: pam_unix(sudo:session): session closed for user root
Apr 10 13:06:27 devstack cinder-volume[73722]: DEBUG oslo_concurrency.processutils [None req-5406b48b-df62-4b48-b3e5-c64a3d2a076b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.465s {{(pid=73722) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:06:27 devstack cinder-volume[73722]: DEBUG oslo_concurrency.processutils [None req-5406b48b-df62-4b48-b3e5-c64a3d2a076b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73722) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:06:27 devstack sudo[74840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 10 13:06:27 devstack sudo[74840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:06:28 devstack sudo[74840]: pam_unix(sudo:session): session closed for user root
Apr 10 13:06:28 devstack cinder-volume[73722]: DEBUG oslo_concurrency.processutils [None req-5406b48b-df62-4b48-b3e5-c64a3d2a076b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.461s {{(pid=73722) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:06:28 devstack cinder-volume[73722]: DEBUG oslo_concurrency.processutils [None req-5406b48b-df62-4b48-b3e5-c64a3d2a076b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73722) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:06:28 devstack sudo[74843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 10 13:06:28 devstack sudo[74843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:06:28 devstack sudo[74843]: pam_unix(sudo:session): session closed for user root
Apr 10 13:06:28 devstack cinder-volume[73722]: DEBUG oslo_concurrency.processutils [None req-5406b48b-df62-4b48-b3e5-c64a3d2a076b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.448s {{(pid=73722) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:06:28 devstack cinder-volume[73722]: DEBUG oslo_concurrency.processutils [None req-5406b48b-df62-4b48-b3e5-c64a3d2a076b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73722) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:06:28 devstack sudo[75108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 10 13:06:28 devstack sudo[75108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:06:29 devstack sudo[75108]: pam_unix(sudo:session): session closed for user root
Apr 10 13:06:29 devstack cinder-volume[73722]: DEBUG oslo_concurrency.processutils [None req-5406b48b-df62-4b48-b3e5-c64a3d2a076b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.422s {{(pid=73722) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:06:29 devstack cinder-volume[73722]: INFO cinder.volume.manager [None req-5406b48b-df62-4b48-b3e5-c64a3d2a076b None None] Driver post RPC initialization completed successfully.
Apr 10 13:06:39 devstack cinder-volume[73722]: DEBUG dbcounter [-] [73722] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=73722) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 10 13:06:39 devstack cinder-volume[73722]: DEBUG dbcounter [-] [73722] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=73722) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 10 13:08:10 devstack cinder-volume[73722]: DEBUG oslo_service.periodic_task [None req-223742f6-7ae3-4360-bc86-9cb89dbb9992 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73722) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 10 13:08:10 devstack cinder-volume[73722]: DEBUG cinder.volume.drivers.lvm [None req-223742f6-7ae3-4360-bc86-9cb89dbb9992 None None] Updating volume stats {{(pid=73722) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 10 13:08:10 devstack cinder-volume[73722]: DEBUG oslo_concurrency.processutils [None req-223742f6-7ae3-4360-bc86-9cb89dbb9992 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73722) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:08:10 devstack sudo[79845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 10 13:08:10 devstack sudo[79845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:08:10 devstack sudo[79845]: pam_unix(sudo:session): session closed for user root
Apr 10 13:08:10 devstack cinder-volume[73722]: DEBUG oslo_concurrency.processutils [None req-223742f6-7ae3-4360-bc86-9cb89dbb9992 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.445s {{(pid=73722) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:08:10 devstack cinder-volume[73722]: DEBUG oslo_concurrency.processutils [None req-223742f6-7ae3-4360-bc86-9cb89dbb9992 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73722) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:08:10 devstack sudo[79848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 10 13:08:10 devstack sudo[79848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:08:11 devstack sudo[79848]: pam_unix(sudo:session): session closed for user root
Apr 10 13:08:11 devstack cinder-volume[73722]: DEBUG oslo_concurrency.processutils [None req-223742f6-7ae3-4360-bc86-9cb89dbb9992 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.426s {{(pid=73722) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:08:11 devstack cinder-volume[73722]: DEBUG oslo_concurrency.processutils [None req-223742f6-7ae3-4360-bc86-9cb89dbb9992 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73722) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:08:11 devstack sudo[79851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 10 13:08:11 devstack sudo[79851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:08:11 devstack sudo[79851]: pam_unix(sudo:session): session closed for user root
Apr 10 13:08:11 devstack cinder-volume[73722]: DEBUG oslo_concurrency.processutils [None req-223742f6-7ae3-4360-bc86-9cb89dbb9992 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.447s {{(pid=73722) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:08:11 devstack cinder-volume[73722]: DEBUG oslo_concurrency.processutils [None req-223742f6-7ae3-4360-bc86-9cb89dbb9992 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73722) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:08:11 devstack sudo[79857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 10 13:08:11 devstack sudo[79857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:08:11 devstack sudo[79857]: pam_unix(sudo:session): session closed for user root
Apr 10 13:08:11 devstack cinder-volume[73722]: DEBUG oslo_concurrency.processutils [None req-223742f6-7ae3-4360-bc86-9cb89dbb9992 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.438s {{(pid=73722) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:08:11 devstack cinder-volume[73722]: DEBUG cinder.manager [None req-223742f6-7ae3-4360-bc86-9cb89dbb9992 None None] Notifying Schedulers of capabilities ... {{(pid=73722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:08:39 devstack cinder-volume[73722]: DEBUG dbcounter [-] [73722] Writing DB stats cinder:SELECT=1 {{(pid=73722) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 10 13:08:39 devstack cinder-volume[73722]: DEBUG dbcounter [-] [73722] Writing DB stats cinder:UPDATE=1 {{(pid=73722) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 10 13:09:10 devstack cinder-volume[73722]: DEBUG oslo_service.periodic_task [None req-223742f6-7ae3-4360-bc86-9cb89dbb9992 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73722) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 10 13:09:10 devstack cinder-volume[73722]: DEBUG cinder.volume.drivers.lvm [None req-223742f6-7ae3-4360-bc86-9cb89dbb9992 None None] Updating volume stats {{(pid=73722) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 10 13:09:10 devstack cinder-volume[73722]: DEBUG oslo_concurrency.processutils [None req-223742f6-7ae3-4360-bc86-9cb89dbb9992 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73722) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:09:10 devstack sudo[81940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 10 13:09:10 devstack sudo[81940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:09:10 devstack sudo[81940]: pam_unix(sudo:session): session closed for user root
Apr 10 13:09:10 devstack cinder-volume[73722]: DEBUG oslo_concurrency.processutils [None req-223742f6-7ae3-4360-bc86-9cb89dbb9992 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.428s {{(pid=73722) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:09:10 devstack cinder-volume[73722]: DEBUG oslo_concurrency.processutils [None req-223742f6-7ae3-4360-bc86-9cb89dbb9992 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73722) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:09:10 devstack sudo[81944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 10 13:09:10 devstack sudo[81944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:09:11 devstack sudo[81944]: pam_unix(sudo:session): session closed for user root
Apr 10 13:09:11 devstack cinder-volume[73722]: DEBUG oslo_concurrency.processutils [None req-223742f6-7ae3-4360-bc86-9cb89dbb9992 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.467s {{(pid=73722) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:09:11 devstack cinder-volume[73722]: DEBUG oslo_concurrency.processutils [None req-223742f6-7ae3-4360-bc86-9cb89dbb9992 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73722) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:09:11 devstack sudo[81959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 10 13:09:11 devstack sudo[81959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:09:11 devstack sudo[81959]: pam_unix(sudo:session): session closed for user root
Apr 10 13:09:11 devstack cinder-volume[73722]: DEBUG oslo_concurrency.processutils [None req-223742f6-7ae3-4360-bc86-9cb89dbb9992 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.449s {{(pid=73722) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:09:11 devstack cinder-volume[73722]: DEBUG oslo_concurrency.processutils [None req-223742f6-7ae3-4360-bc86-9cb89dbb9992 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73722) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:09:11 devstack sudo[81964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 10 13:09:11 devstack sudo[81964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:09:11 devstack sudo[81964]: pam_unix(sudo:session): session closed for user root
Apr 10 13:09:11 devstack cinder-volume[73722]: DEBUG oslo_concurrency.processutils [None req-223742f6-7ae3-4360-bc86-9cb89dbb9992 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.441s {{(pid=73722) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:09:11 devstack cinder-volume[73722]: DEBUG cinder.manager [None req-223742f6-7ae3-4360-bc86-9cb89dbb9992 None None] Notifying Schedulers of capabilities ... {{(pid=73722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:09:43 devstack cinder-volume[73617]: INFO oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] Caught SIGTERM, stopping children
Apr 10 13:09:43 devstack cinder-volume[73617]: DEBUG oslo_concurrency.lockutils [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] Acquiring lock "singleton_lock" {{(pid=73617) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 10 13:09:43 devstack cinder-volume[73617]: DEBUG oslo_concurrency.lockutils [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] Acquired lock "singleton_lock" {{(pid=73617) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 10 13:09:43 devstack cinder-volume[73617]: DEBUG oslo_concurrency.lockutils [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] Releasing lock "singleton_lock" {{(pid=73617) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 10 13:09:43 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] Stop services. {{(pid=73617) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Apr 10 13:09:43 devstack cinder-volume[73617]: DEBUG oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] Killing children. {{(pid=73617) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Apr 10 13:09:43 devstack cinder-volume[73617]: INFO oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] Waiting on 1 children to exit
Apr 10 13:09:47 devstack cinder-volume[73722]: DEBUG oslo_concurrency.lockutils [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] Acquiring lock "singleton_lock" {{(pid=73722) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 10 13:09:47 devstack cinder-volume[73722]: DEBUG oslo_concurrency.lockutils [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] Acquired lock "singleton_lock" {{(pid=73722) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 10 13:09:47 devstack cinder-volume[73722]: DEBUG oslo_concurrency.lockutils [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] Releasing lock "singleton_lock" {{(pid=73722) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 10 13:09:47 devstack cinder-volume[73722]: WARNING amqp [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 10 13:09:47 devstack cinder-volume[73722]: WARNING amqp [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 10 13:09:47 devstack cinder-volume[73617]: INFO oslo_service.backend._eventlet.service [None req-1cc7ce6d-0099-457a-8d1b-eea970b86c62 None None] Child 73722 exited with status 0
Apr 10 13:09:47 devstack cinder-volume[82804]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Apr 10 13:09:47 devstack cinder-volume[82804]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 10 13:09:47 devstack cinder-volume[82804]: we strongly recommend against using it for new projects.
Apr 10 13:09:47 devstack cinder-volume[82804]: If you are already using Eventlet, we recommend migrating to a different
Apr 10 13:09:47 devstack cinder-volume[82804]: framework.  For more detail see
Apr 10 13:09:47 devstack cinder-volume[82804]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 10 13:09:47 devstack cinder-volume[82804]:   import eventlet  # noqa
Apr 10 13:09:49 devstack cinder-volume[82804]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82804) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 10 13:09:49 devstack cinder-volume[82804]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82804) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 10 13:09:49 devstack cinder-volume[82804]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82804) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 10 13:09:50 devstack cinder-volume[82804]: INFO dbcounter [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] Registered counter for database cinder
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_db.sqlalchemy.engines [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82804) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG dbcounter [-] [82804] Writer thread running {{(pid=82804) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 10 13:09:50 devstack cinder-volume[82804]: INFO cinder.rpc [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Apr 10 13:09:50 devstack cinder-volume[82804]: INFO cinder.rpc [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_db.sqlalchemy.engines [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82804) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 10 13:09:50 devstack cinder-volume[82804]: INFO cinder.volume.manager [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] Determined volume DB was empty at startup.
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG cinder.volume.manager [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82804) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Apr 10 13:09:50 devstack cinder-volume[82804]: INFO cinder.volume.manager [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] Service not found for updating active_backend_id, assuming default for driver init.
Apr 10 13:09:50 devstack cinder-volume[82804]: WARNING stevedore.named [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 10 13:09:50 devstack cinder-volume[82804]: WARNING castellan.key_manager [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 10 13:09:50 devstack cinder-volume[82804]: WARNING cinder.keymgr.conf_key_mgr [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 10 13:09:50 devstack cinder-volume[82804]: INFO cinder.volume.manager [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_db.sqlalchemy.engines [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82804) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 10 13:09:50 devstack cinder-volume[82804]: INFO oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] Starting 1 workers
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] Started child 82922 {{(pid=82804) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] Full set of CONF: {{(pid=82804) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] ******************************************************************************** {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] Configuration options gathered from: {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] ================================================================================ {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] allow_availability_zone_fallback = False {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] allow_compression_on_image_upload = False {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] allowed_direct_url_schemes     = [] {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] api_rate_limit                 = True {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] auth_strategy                  = keystone {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] backend_availability_zone      = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] backend_host                   = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] backend_name                   = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] backend_stats_polling_interval = 60 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] backup_api_class               = cinder.backup.api.API {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] backup_name_template           = backup-%s {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] backup_use_same_host           = False {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] backup_use_temp_snapshot       = False {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] chap_password                  = **** {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] chap_username                  =  {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82922]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] cinder_internal_tenant_project_id = 87141a707f79424ba5cb4f3ac4239b63 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] cinder_internal_tenant_user_id = 257156922ff24f0eb77a6b317aba5c23 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] cluster                        = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] compression_format             = gzip {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] compute_api_class              = cinder.compute.nova.API {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] config_dir                     = [] {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] config_source                  = [] {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] control_exchange               = openstack {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] debug                          = True {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] default_availability_zone      = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] default_group_type             = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] default_volume_type            = QuobyteHD {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] disk_geometry                  = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] driver_client_cert             = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] driver_client_cert_key         = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] driver_data_namespace          = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] driver_ssl_cert_path           = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] driver_ssl_cert_verify         = False {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] driver_use_ssl                 = False {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] enable_new_services            = True {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] enable_unsupported_driver      = False {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] enabled_backends               = ['QuobyteHD'] {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] enforce_multipath_for_image_xfer = False {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] filter_function                = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] glance_api_insecure            = False {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] glance_api_servers             = ['http://192.168.122.117/image'] {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] glance_api_ssl_compression     = False {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] glance_ca_certificates_file    = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] glance_catalog_info            = image:glance:publicURL {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] glance_certfile                = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] glance_keyfile                 = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] glance_num_retries             = 3 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] glance_request_timeout         = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] goodness_function              = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] graceful_shutdown_timeout      = 5 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] group_api_class                = cinder.group.api.API {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] host                           = devstack {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] image_compress_on_upload       = True {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] image_conversion_address_space_limit = 1 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] image_conversion_cpu_limit     = 60 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] image_conversion_disable       = False {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] image_upload_use_cinder_backend = False {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] image_upload_use_internal_tenant = False {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] image_volume_cache_enabled     = False {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] image_volume_cache_max_count   = 0 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] image_volume_cache_max_size_gb = 0 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] init_host_max_objects_retrieval = 0 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] instance_format                = [instance: %(uuid)s]  {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] iscsi_target_flags             =  {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] iscsi_write_cache              = on {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] iser_helper                    = tgtadm {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] iser_ip_address                = 192.168.122.117 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] iser_port                      = 3260 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] log_color                      = False {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] log_config_append              = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] log_dir                        = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] log_file                       = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] log_options                    = True {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] log_rotate_interval            = 1 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] log_rotate_interval_type       = days {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] log_rotation_type              = none {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] max_age                        = 0 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] max_logfile_count              = 30 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] max_logfile_size_mb            = 200 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] max_over_subscription_ratio    = 20.0 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] message_reap_interval          = 86400 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] message_ttl                    = 2592000 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] migration_create_volume_timeout_secs = 300 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] monkey_patch                   = False {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] monkey_patch_modules           = [] {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] my_ip                          = 192.168.122.117 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] no_snapshot_gb_quota           = False {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] num_iser_scan_tries            = 3 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] num_shell_tries                = 3 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] num_volume_device_scan_tries   = 3 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82922]: INFO cinder.volume.manager [None req-437ba22e-26de-44d2-b986-b3e7352bd6e6 None None] Starting volume driver QuobyteDriver (1.1.14)
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] nvmeof_conn_info_version       = 1 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] nvmet_ns_id                    = 10 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] nvmet_port_id                  = 1 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] osapi_max_limit                = 1000 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82922]: DEBUG cinder.volume.drivers.remotefs [None req-437ba22e-26de-44d2-b986-b3e7352bd6e6 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=82922) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] osapi_volume_ext_list          = [] {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] osapi_volume_listen_port       = 8776 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] osapi_volume_use_ssl           = False {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] osapi_volume_workers           = 2 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] per_volume_size_limit          = -1 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] periodic_fuzzy_delay           = 60 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] periodic_interval              = 60 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] public_endpoint                = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] publish_errors                 = False {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] quota_backup_gigabytes         = 1000 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] quota_backups                  = 10 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] quota_gigabytes                = 1000 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] quota_groups                   = 10 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] quota_snapshots                = 10 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] quota_volumes                  = 10 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] rate_limit_burst               = 0 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] rate_limit_except_level        = CRITICAL {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] rate_limit_interval            = 0 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] reinit_driver_count            = 3 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] replication_device             = **** {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] report_discard_supported       = False {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] report_interval                = 120 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] reservation_clean_interval     = 86400 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] reservation_expire             = 86400 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] reserved_image_namespaces      = [] {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] reserved_percentage            = 0 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] rpc_response_timeout           = 120 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] run_external_periodic_tasks    = True {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] scst_target_driver             = iscsi {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] scst_target_iqn_name           = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] service_down_time              = 720 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] shell_completion               = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] snapshot_name_template         = snapshot-%s {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] split_loggers                  = False {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] state_path                     = /opt/stack/data/cinder {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] storage_availability_zone      = nova {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] storage_protocol               = iSCSI {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] syslog_log_facility            = LOG_USER {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] target_helper                  = lioadm {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] target_ip_address              = 192.168.122.117 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] target_port                    = 3260 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] target_protocol                = iscsi {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] target_secondary_ip_addresses  = [] {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] trace_flags                    = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] transport_url                  = **** {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] until_refresh                  = 0 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] use_chap_auth                  = False {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] use_default_quota_class        = True {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] use_journal                    = False {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] use_json                       = False {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] use_multipath_for_image_xfer   = False {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] use_stderr                     = False {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] use_syslog                     = False {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] verify_glance_signatures       = enabled {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] volume_api_class               = cinder.volume.api.API {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] volume_backend_name            = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] volume_clear                   = zero {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] volume_clear_ionice            = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] volume_clear_size              = 0 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] volume_copy_bps_limit          = 0 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] volume_dd_blocksize            = 1M {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] volume_name_template           = volume-%s {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] volume_service_inithost_offload = False {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] volume_usage_audit_period      = month {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] zoning_mode                    = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] oslo_concurrency.disable_process_locking = False {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] keystone_authtoken.admin_password = **** {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] keystone_authtoken.admin_token = **** {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] keystone_authtoken.admin_user  = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] keystone_authtoken.auth_admin_prefix =  {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] keystone_authtoken.auth_port   = 35357 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] keystone_authtoken.auth_protocol = https {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] keystone_authtoken.auth_section = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] keystone_authtoken.auth_type   = password {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] keystone_authtoken.auth_uri    = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] keystone_authtoken.auth_version = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] keystone_authtoken.cache       = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] keystone_authtoken.certfile    = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] keystone_authtoken.delay_auth_decision = False {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] keystone_authtoken.http_connect_timeout = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] keystone_authtoken.identity_uri = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] keystone_authtoken.include_service_catalog = True {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] keystone_authtoken.insecure    = False {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] keystone_authtoken.interface   = public {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] keystone_authtoken.keyfile     = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] keystone_authtoken.memcache_password =  {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] keystone_authtoken.memcache_username =  {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] keystone_authtoken.region_name = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] keystone_authtoken.service_token_roles_required = False {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] keystone_authtoken.service_type = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] keystone_authtoken.token_cache_time = 300 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.117/identity {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] cache.backend                  = dogpile.cache.null {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] cache.backend_argument         = **** {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] cache.backend_expiration_time  = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] cache.config_prefix            = cache.oslo {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] cache.debug_cache_backend      = False {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] cache.enable_retry_client      = False {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] cache.enable_socket_keepalive  = False {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] cache.enabled                  = False {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] cache.enforce_fips_mode        = False {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] cache.expiration_time          = 600 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] cache.hashclient_retry_attempts = 2 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] cache.memcache_dead_retry      = 300 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] cache.memcache_pool_maxsize    = 10 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] cache.memcache_sasl_enabled    = False {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] cache.password                 = **** {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] cache.proxies                  = [] {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] cache.redis_db                 = 0 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] cache.redis_sentinel_service_name = mymaster {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] cache.redis_server             = localhost:6379 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] cache.retry_attempts           = 2 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] cache.retry_delay              = 0.0 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] cache.socket_keepalive_count   = 1 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] cache.socket_keepalive_idle    = 1 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] cache.socket_keepalive_interval = 1 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] cache.socket_timeout           = 1.0 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] cache.tls_allowed_ciphers      = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] cache.tls_cafile               = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] cache.tls_certfile             = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] cache.tls_enabled              = False {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] cache.tls_keyfile              = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] cache.username                 = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] coordination.backend_url       = **** {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] database.asyncio_connection    = **** {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] database.asyncio_slave_connection = **** {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] database.backend               = sqlalchemy {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] database.connection            = **** {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] database.connection_debug      = 0 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] database.connection_parameters =  {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] database.connection_recycle_time = 3600 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] database.connection_trace      = False {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] database.db_inc_retry_interval = True {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] database.db_max_retries        = 20 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] database.db_max_retry_interval = 10 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] database.db_retry_interval     = 1 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82922]: DEBUG cinder.volume.drivers.quobyte [None req-437ba22e-26de-44d2-b986-b3e7352bd6e6 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=82922) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] database.max_overflow          = 50 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82922]: WARNING cinder.volume.drivers.quobyte [None req-437ba22e-26de-44d2-b986-b3e7352bd6e6 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] database.max_pool_size         = 5 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82922]: WARNING cinder.volume.drivers.quobyte [None req-437ba22e-26de-44d2-b986-b3e7352bd6e6 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] database.max_retries           = 10 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] database.mysql_wsrep_sync_wait = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] database.pool_timeout          = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] database.retry_interval        = 10 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82922]: DEBUG oslo_concurrency.processutils [None req-437ba22e-26de-44d2-b986-b3e7352bd6e6 None None] Running cmd (subprocess): mount.quobyte {{(pid=82922) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] database.slave_connection      = **** {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] database.sqlite_synchronous    = True {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] database.synchronous_reader    = True {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] database.use_db_reconnect      = False {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] profiler.connection_string     = messaging:// {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] profiler.enabled               = False {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] profiler.es_doc_type           = notification {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] profiler.es_scroll_size        = 10000 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] profiler.es_scroll_time        = 2m {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] profiler.filter_error_trace    = False {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] profiler.hmac_keys             = **** {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] profiler.sentinel_service_name = mymaster {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] profiler.socket_timeout        = 0.1 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] profiler.trace_requests        = False {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] profiler.trace_sqlalchemy      = False {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] profiler_jaeger.process_tags   = {} {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] profiler_jaeger.service_name_prefix = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] profiler_otlp.service_name_prefix = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] oslo_policy.enforce_new_defaults = False {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: WARNING oslo_config.cfg [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] oslo_policy.enforce_scope      = False {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] oslo_policy.policy_default_rule = default {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] oslo_policy.policy_file        = policy.yaml {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] privsep_osbrick.group          = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] privsep_osbrick.helper_command = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] privsep_osbrick.user           = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] cinder_sys_admin.group         = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] cinder_sys_admin.helper_command = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] cinder_sys_admin.user          = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] service_user.auth_section      = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] service_user.auth_type         = password {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] service_user.cafile            = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] service_user.certfile          = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] service_user.collect_timing    = False {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] service_user.insecure          = False {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] service_user.keyfile           = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] service_user.send_service_user_token = True {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] service_user.split_loggers     = False {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] service_user.timeout           = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] glance.auth_section            = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] glance.auth_type               = password {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] glance.certfile                = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] glance.collect_timing          = False {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] glance.insecure                = False {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] glance.keyfile                 = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] glance.region_name             = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] glance.split_loggers           = False {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] glance.timeout                 = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] backend_defaults.backend_availability_zone = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] backend_defaults.chap_password = **** {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] backend_defaults.chap_username =  {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] backend_defaults.disk_geometry = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] backend_defaults.driver_client_cert = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] backend_defaults.driver_client_cert_key = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] backend_defaults.driver_data_namespace = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] backend_defaults.driver_use_ssl = False {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] backend_defaults.enable_unsupported_driver = False {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] backend_defaults.extra_capabilities = {} {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] backend_defaults.filter_function = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] backend_defaults.goodness_function = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] backend_defaults.iscsi_target_flags =  {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] backend_defaults.iscsi_write_cache = on {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] backend_defaults.iser_helper   = tgtadm {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] backend_defaults.iser_ip_address = 192.168.122.117 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] backend_defaults.iser_port     = 3260 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] backend_defaults.nas_host      =  {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] backend_defaults.nas_login     = admin {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] backend_defaults.nas_mount_options = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] backend_defaults.nas_password  = **** {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] backend_defaults.nas_private_key =  {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] backend_defaults.nas_share_path =  {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] backend_defaults.num_shell_tries = 3 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] backend_defaults.nvmet_port_id = 1 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] backend_defaults.quobyte_client_cfg = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] backend_defaults.quobyte_volume_url = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] backend_defaults.replication_device = **** {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] backend_defaults.report_discard_supported = False {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] backend_defaults.reserved_percentage = 0 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] backend_defaults.scst_target_driver = iscsi {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] backend_defaults.scst_target_iqn_name = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] backend_defaults.storage_protocol = iSCSI {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] backend_defaults.target_helper = tgtadm {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] backend_defaults.target_ip_address = 192.168.122.117 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] backend_defaults.target_port   = 3260 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] backend_defaults.target_protocol = iscsi {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] backend_defaults.trace_flags   = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] backend_defaults.unique_fqdn_network = True {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] backend_defaults.use_chap_auth = False {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] backend_defaults.volume_backend_name = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] backend_defaults.volume_clear  = zero {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] backend_defaults.volume_clear_ionice = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] backend_defaults.volume_clear_size = 0 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] oslo_reports.file_event_handler = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] oslo_reports.log_dir           = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] QuobyteHD.backend_availability_zone = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] QuobyteHD.backend_host         = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] QuobyteHD.chap_password        = **** {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] QuobyteHD.chap_username        = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] QuobyteHD.chiscsi_conf         = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] QuobyteHD.disk_geometry        = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] QuobyteHD.driver_client_cert   = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] QuobyteHD.driver_client_cert_key = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] QuobyteHD.driver_data_namespace = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] QuobyteHD.driver_use_ssl       = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] QuobyteHD.extra_capabilities   = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] QuobyteHD.filter_function      = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] QuobyteHD.goodness_function    = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] QuobyteHD.iser_helper          = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] QuobyteHD.iser_ip_address      = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] QuobyteHD.iser_port            = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] QuobyteHD.iser_target_prefix   = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] QuobyteHD.nas_host             = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] QuobyteHD.nas_login            = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] QuobyteHD.nas_mount_options    = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] QuobyteHD.nas_password         = **** {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] QuobyteHD.nas_private_key      = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] QuobyteHD.nas_share_path       = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] QuobyteHD.nas_ssh_port         = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] QuobyteHD.num_shell_tries      = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] QuobyteHD.nvmet_port_id        = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] QuobyteHD.replication_device   = **** {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] QuobyteHD.report_discard_supported = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] QuobyteHD.reserved_percentage  = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] QuobyteHD.scst_target_driver   = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] QuobyteHD.storage_protocol     = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] QuobyteHD.target_helper        = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] QuobyteHD.target_ip_address    = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] QuobyteHD.target_port          = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] QuobyteHD.target_prefix        = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] QuobyteHD.target_protocol      = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] QuobyteHD.trace_flags          = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] QuobyteHD.use_chap_auth        = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] QuobyteHD.volume_clear         = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] QuobyteHD.volume_clear_size    = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] QuobyteHD.volumes_dir          = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] oslo_messaging_rabbit.ssl      = False {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] oslo_messaging_notifications.driver = [] {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] oslo_messaging_notifications.retry = -1 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] oslo_messaging_notifications.transport_url = **** {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] key_manager.fixed_key          = **** {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] barbican.barbican_api_version  = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] barbican.barbican_endpoint     = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] barbican.barbican_endpoint_type = public {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] barbican.barbican_region_name  = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] barbican.cafile                = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] barbican.certfile              = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] barbican.collect_timing        = False {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] barbican.insecure              = False {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] barbican.keyfile               = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] barbican.number_of_retries     = 60 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] barbican.retry_delay           = 1 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] barbican.send_service_user_token = False {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] barbican.split_loggers         = False {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] barbican.timeout               = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] barbican.verify_ssl            = True {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] barbican.verify_ssl_path       = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] barbican_service_user.auth_section = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] barbican_service_user.auth_type = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] barbican_service_user.cafile   = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] barbican_service_user.certfile = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] barbican_service_user.collect_timing = False {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] barbican_service_user.insecure = False {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] barbican_service_user.keyfile  = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] barbican_service_user.split_loggers = False {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] barbican_service_user.timeout  = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] vault.approle_role_id          = **** {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] vault.approle_secret_id        = **** {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] vault.kv_mountpoint            = secret {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] vault.kv_path                  = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] vault.kv_version               = 2 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] vault.namespace                = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] vault.root_token_id            = **** {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] vault.ssl_ca_crt_file          = None {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] vault.timeout                  = 60.0 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] vault.use_ssl                  = False {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:09:50 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] ******************************************************************************** {{(pid=82804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}}
Apr 10 13:09:50 devstack quobyte-client[82923]: Reading configuration file: /etc/quobyte/client.cfg
Apr 10 13:09:50 devstack quobyte-client[82923]: Invalid parameters found, error: missing mount point.
Apr 10 13:09:50 devstack quobyte-client[82923]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Apr 10 13:09:50 devstack quobyte-client[82923]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Apr 10 13:09:50 devstack cinder-volume[82922]: DEBUG oslo_concurrency.processutils [None req-437ba22e-26de-44d2-b986-b3e7352bd6e6 None None] CMD "mount.quobyte" returned: 1 in 0.115s {{(pid=82922) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:09:50 devstack cinder-volume[82922]: DEBUG oslo_concurrency.lockutils [None req-437ba22e-26de-44d2-b986-b3e7352bd6e6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82922) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:09:50 devstack cinder-volume[82922]: DEBUG oslo_concurrency.lockutils [None req-437ba22e-26de-44d2-b986-b3e7352bd6e6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82922) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:09:50 devstack cinder-volume[82922]: DEBUG cinder.volume.drivers.quobyte [None req-437ba22e-26de-44d2-b986-b3e7352bd6e6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=82922) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:09:50 devstack cinder-volume[82922]: INFO cinder.volume.drivers.quobyte [None req-437ba22e-26de-44d2-b986-b3e7352bd6e6 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 ...
Apr 10 13:09:50 devstack cinder-volume[82922]: DEBUG oslo_concurrency.processutils [None req-437ba22e-26de-44d2-b986-b3e7352bd6e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b -c /etc/quobyte/client-cinder.cfg {{(pid=82922) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:09:50 devstack sudo[82924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b -c /etc/quobyte/client-cinder.cfg
Apr 10 13:09:50 devstack sudo[82924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:09:51 devstack sudo[82924]: pam_unix(sudo:session): session closed for user root
Apr 10 13:09:51 devstack cinder-volume[82922]: DEBUG oslo_concurrency.processutils [None req-437ba22e-26de-44d2-b986-b3e7352bd6e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.497s {{(pid=82922) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:09:51 devstack cinder-volume[82922]: INFO cinder.volume.drivers.quobyte [None req-437ba22e-26de-44d2-b986-b3e7352bd6e6 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 succeeded
Apr 10 13:09:51 devstack cinder-volume[82922]: DEBUG cinder.volume.drivers.quobyte [None req-437ba22e-26de-44d2-b986-b3e7352bd6e6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=82922) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:09:51 devstack cinder-volume[82922]: DEBUG oslo_concurrency.lockutils [None req-437ba22e-26de-44d2-b986-b3e7352bd6e6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.520s {{(pid=82922) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:09:51 devstack cinder-volume[82922]: DEBUG oslo_concurrency.processutils [None req-437ba22e-26de-44d2-b986-b3e7352bd6e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=82922) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:09:51 devstack sudo[82993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:09:51 devstack sudo[82993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:09:51 devstack sudo[82993]: pam_unix(sudo:session): session closed for user root
Apr 10 13:09:51 devstack cinder-volume[82922]: DEBUG oslo_concurrency.processutils [None req-437ba22e-26de-44d2-b986-b3e7352bd6e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.377s {{(pid=82922) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:09:51 devstack cinder-volume[82922]: INFO cinder.volume.driver [None req-437ba22e-26de-44d2-b986-b3e7352bd6e6 None None] Driver hasn't implemented _init_vendor_properties()
Apr 10 13:09:51 devstack cinder-volume[82922]: DEBUG cinder.volume.driver [None req-437ba22e-26de-44d2-b986-b3e7352bd6e6 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757999420166, 'free_capacity_gb': 1775.757999420166, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82922) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Apr 10 13:09:51 devstack cinder-volume[82922]: DEBUG oslo_db.sqlalchemy.engines [None req-437ba22e-26de-44d2-b986-b3e7352bd6e6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82922) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 10 13:09:51 devstack cinder-volume[82922]: DEBUG dbcounter [-] [82922] Writer thread running {{(pid=82922) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 10 13:09:51 devstack cinder-volume[82922]: DEBUG cinder.db.sqlalchemy.api [None req-437ba22e-26de-44d2-b986-b3e7352bd6e6 None None] Building query based on filter {{(pid=82922) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Apr 10 13:09:51 devstack cinder-volume[82922]: DEBUG cinder.image.image_utils [None req-437ba22e-26de-44d2-b986-b3e7352bd6e6 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82922) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Apr 10 13:09:51 devstack cinder-volume[82922]: INFO cinder.keymgr.migration [None req-824dcddb-dbaa-477f-9d0f-7971a14e09bc None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Apr 10 13:09:51 devstack cinder-volume[82922]: DEBUG oslo_concurrency.lockutils [None req-437ba22e-26de-44d2-b986-b3e7352bd6e6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82922) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:09:51 devstack cinder-volume[82922]: DEBUG oslo_concurrency.lockutils [None req-437ba22e-26de-44d2-b986-b3e7352bd6e6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82922) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:09:51 devstack cinder-volume[82922]: DEBUG cinder.volume.drivers.quobyte [None req-437ba22e-26de-44d2-b986-b3e7352bd6e6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=82922) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:09:51 devstack cinder-volume[82922]: DEBUG cinder.volume.drivers.quobyte [None req-437ba22e-26de-44d2-b986-b3e7352bd6e6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=82922) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:09:51 devstack cinder-volume[82922]: DEBUG oslo_concurrency.lockutils [None req-437ba22e-26de-44d2-b986-b3e7352bd6e6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82922) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:09:51 devstack cinder-volume[82922]: DEBUG oslo_concurrency.processutils [None req-437ba22e-26de-44d2-b986-b3e7352bd6e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=82922) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:09:51 devstack sudo[82997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:09:51 devstack sudo[82997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:09:51 devstack sudo[82997]: pam_unix(sudo:session): session closed for user root
Apr 10 13:09:51 devstack cinder-volume[82922]: DEBUG oslo_concurrency.processutils [None req-437ba22e-26de-44d2-b986-b3e7352bd6e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.387s {{(pid=82922) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:09:51 devstack cinder-volume[82922]: DEBUG cinder.manager [None req-437ba22e-26de-44d2-b986-b3e7352bd6e6 None None] Notifying Schedulers of capabilities ... {{(pid=82922) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:09:51 devstack cinder-volume[82922]: INFO cinder.volume.manager [None req-437ba22e-26de-44d2-b986-b3e7352bd6e6 None None] Driver initialization completed successfully.
Apr 10 13:09:51 devstack cinder-volume[82922]: INFO cinder.manager [None req-437ba22e-26de-44d2-b986-b3e7352bd6e6 None None] Initiating service 3 cleanup
Apr 10 13:09:51 devstack cinder-volume[82922]: INFO cinder.manager [None req-437ba22e-26de-44d2-b986-b3e7352bd6e6 None None] Service 3 cleanup completed.
Apr 10 13:09:51 devstack cinder-volume[82922]: DEBUG cinder.service [None req-437ba22e-26de-44d2-b986-b3e7352bd6e6 None None] Creating RPC server for service cinder-volume {{(pid=82922) start /opt/stack/cinder/cinder/service.py:231}}
Apr 10 13:09:51 devstack cinder-volume[82922]: DEBUG cinder.service [None req-437ba22e-26de-44d2-b986-b3e7352bd6e6 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82922) start /opt/stack/cinder/cinder/service.py:237}}
Apr 10 13:09:52 devstack cinder-volume[82922]: INFO cinder.volume.manager [None req-437ba22e-26de-44d2-b986-b3e7352bd6e6 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Apr 10 13:09:52 devstack cinder-volume[82922]: DEBUG oslo_concurrency.lockutils [None req-437ba22e-26de-44d2-b986-b3e7352bd6e6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82922) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:09:52 devstack cinder-volume[82922]: DEBUG oslo_concurrency.lockutils [None req-437ba22e-26de-44d2-b986-b3e7352bd6e6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82922) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:09:52 devstack cinder-volume[82922]: DEBUG cinder.volume.drivers.quobyte [None req-437ba22e-26de-44d2-b986-b3e7352bd6e6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=82922) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:09:52 devstack cinder-volume[82922]: DEBUG cinder.volume.drivers.quobyte [None req-437ba22e-26de-44d2-b986-b3e7352bd6e6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=82922) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:09:52 devstack cinder-volume[82922]: DEBUG oslo_concurrency.lockutils [None req-437ba22e-26de-44d2-b986-b3e7352bd6e6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82922) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:09:52 devstack cinder-volume[82922]: DEBUG oslo_concurrency.processutils [None req-437ba22e-26de-44d2-b986-b3e7352bd6e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=82922) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:09:52 devstack sudo[83001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:09:52 devstack sudo[83001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:09:52 devstack sudo[83001]: pam_unix(sudo:session): session closed for user root
Apr 10 13:09:52 devstack cinder-volume[82922]: DEBUG oslo_concurrency.processutils [None req-437ba22e-26de-44d2-b986-b3e7352bd6e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.399s {{(pid=82922) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:09:52 devstack cinder-volume[82922]: INFO cinder.volume.manager [None req-437ba22e-26de-44d2-b986-b3e7352bd6e6 None None] Driver post RPC initialization completed successfully.
Apr 10 13:09:55 devstack cinder-volume[82922]: DEBUG oslo_concurrency.lockutils [None req-a0ea5d58-4abd-4bb1-8c8a-34e56c7f57a7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82922) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:09:55 devstack cinder-volume[82922]: DEBUG oslo_concurrency.lockutils [None req-a0ea5d58-4abd-4bb1-8c8a-34e56c7f57a7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82922) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:09:55 devstack cinder-volume[82922]: DEBUG cinder.volume.drivers.quobyte [None req-a0ea5d58-4abd-4bb1-8c8a-34e56c7f57a7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=82922) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:09:55 devstack cinder-volume[82922]: DEBUG cinder.volume.drivers.quobyte [None req-a0ea5d58-4abd-4bb1-8c8a-34e56c7f57a7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=82922) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:09:55 devstack cinder-volume[82922]: DEBUG oslo_concurrency.lockutils [None req-a0ea5d58-4abd-4bb1-8c8a-34e56c7f57a7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82922) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:09:55 devstack cinder-volume[82922]: DEBUG oslo_concurrency.processutils [None req-a0ea5d58-4abd-4bb1-8c8a-34e56c7f57a7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=82922) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:09:55 devstack sudo[83068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:09:55 devstack sudo[83068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:09:55 devstack sudo[83068]: pam_unix(sudo:session): session closed for user root
Apr 10 13:09:55 devstack cinder-volume[82922]: DEBUG oslo_concurrency.processutils [None req-a0ea5d58-4abd-4bb1-8c8a-34e56c7f57a7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.399s {{(pid=82922) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:09:55 devstack cinder-volume[82922]: DEBUG cinder.manager [None req-a0ea5d58-4abd-4bb1-8c8a-34e56c7f57a7 None None] Notifying Schedulers of capabilities ... {{(pid=82922) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:09:58 devstack cinder-volume[82804]: INFO oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] Caught SIGTERM, stopping children
Apr 10 13:09:58 devstack cinder-volume[82804]: DEBUG oslo_concurrency.lockutils [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] Acquiring lock "singleton_lock" {{(pid=82804) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 10 13:09:58 devstack cinder-volume[82804]: DEBUG oslo_concurrency.lockutils [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] Acquired lock "singleton_lock" {{(pid=82804) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 10 13:09:58 devstack cinder-volume[82804]: DEBUG oslo_concurrency.lockutils [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] Releasing lock "singleton_lock" {{(pid=82804) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 10 13:09:58 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] Stop services. {{(pid=82804) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Apr 10 13:09:58 devstack cinder-volume[82804]: DEBUG oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] Killing children. {{(pid=82804) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Apr 10 13:09:58 devstack cinder-volume[82804]: INFO oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] Waiting on 1 children to exit
Apr 10 13:10:00 devstack cinder-volume[82922]: DEBUG oslo_concurrency.lockutils [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] Acquiring lock "singleton_lock" {{(pid=82922) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 10 13:10:00 devstack cinder-volume[82922]: DEBUG oslo_concurrency.lockutils [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] Acquired lock "singleton_lock" {{(pid=82922) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 10 13:10:00 devstack cinder-volume[82922]: DEBUG oslo_concurrency.lockutils [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] Releasing lock "singleton_lock" {{(pid=82922) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 10 13:10:00 devstack cinder-volume[82922]: WARNING amqp [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 10 13:10:00 devstack cinder-volume[82922]: WARNING amqp [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 10 13:10:00 devstack cinder-volume[82804]: INFO oslo_service.backend._eventlet.service [None req-92dd1232-1b29-4e7b-87c2-7acb9f775d18 None None] Child 82922 exited with status 0
Apr 10 13:10:00 devstack cinder-volume[83144]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Apr 10 13:10:00 devstack cinder-volume[83144]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 10 13:10:00 devstack cinder-volume[83144]: we strongly recommend against using it for new projects.
Apr 10 13:10:00 devstack cinder-volume[83144]: If you are already using Eventlet, we recommend migrating to a different
Apr 10 13:10:00 devstack cinder-volume[83144]: framework.  For more detail see
Apr 10 13:10:00 devstack cinder-volume[83144]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 10 13:10:00 devstack cinder-volume[83144]:   import eventlet  # noqa
Apr 10 13:10:02 devstack cinder-volume[83144]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=83144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 10 13:10:02 devstack cinder-volume[83144]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=83144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 10 13:10:02 devstack cinder-volume[83144]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=83144) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 10 13:10:02 devstack cinder-volume[83144]: INFO dbcounter [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] Registered counter for database cinder
Apr 10 13:10:02 devstack cinder-volume[83144]: DEBUG oslo_db.sqlalchemy.engines [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83144) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG dbcounter [-] [83144] Writer thread running {{(pid=83144) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 10 13:10:03 devstack cinder-volume[83144]: INFO cinder.rpc [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Apr 10 13:10:03 devstack cinder-volume[83144]: INFO cinder.rpc [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_db.sqlalchemy.engines [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83144) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 10 13:10:03 devstack cinder-volume[83144]: INFO cinder.volume.manager [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] Determined volume DB was empty at startup.
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG cinder.volume.manager [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=83144) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Apr 10 13:10:03 devstack cinder-volume[83144]: WARNING stevedore.named [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 10 13:10:03 devstack cinder-volume[83144]: WARNING castellan.key_manager [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 10 13:10:03 devstack cinder-volume[83144]: WARNING cinder.keymgr.conf_key_mgr [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 10 13:10:03 devstack cinder-volume[83144]: INFO cinder.volume.manager [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_db.sqlalchemy.engines [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83144) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 10 13:10:03 devstack cinder-volume[83144]: INFO oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] Starting 1 workers
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] Started child 83345 {{(pid=83144) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] Full set of CONF: {{(pid=83144) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] ******************************************************************************** {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}}
Apr 10 13:10:03 devstack cinder-volume[83345]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] Configuration options gathered from: {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] ================================================================================ {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] allow_availability_zone_fallback = False {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] allow_compression_on_image_upload = False {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] allowed_direct_url_schemes     = [] {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] api_rate_limit                 = True {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] auth_strategy                  = keystone {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] backend_availability_zone      = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] backend_host                   = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] backend_name                   = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] backend_stats_polling_interval = 60 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] backup_api_class               = cinder.backup.api.API {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] backup_name_template           = backup-%s {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] backup_use_same_host           = False {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] backup_use_temp_snapshot       = False {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] chap_password                  = **** {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] chap_username                  =  {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] cinder_internal_tenant_project_id = 87141a707f79424ba5cb4f3ac4239b63 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] cinder_internal_tenant_user_id = 257156922ff24f0eb77a6b317aba5c23 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] cluster                        = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] compression_format             = gzip {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] compute_api_class              = cinder.compute.nova.API {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] config_dir                     = [] {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] config_source                  = [] {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] control_exchange               = openstack {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] debug                          = True {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] default_availability_zone      = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] default_group_type             = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] default_volume_type            = QuobyteHD {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] disk_geometry                  = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] driver_client_cert             = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] driver_client_cert_key         = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] driver_data_namespace          = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] driver_ssl_cert_path           = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] driver_ssl_cert_verify         = False {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] driver_use_ssl                 = False {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] enable_new_services            = True {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] enable_unsupported_driver      = False {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] enabled_backends               = ['QuobyteHD'] {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] enforce_multipath_for_image_xfer = False {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] filter_function                = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] glance_api_insecure            = False {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] glance_api_servers             = ['http://192.168.122.117/image'] {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] glance_api_ssl_compression     = False {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] glance_ca_certificates_file    = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] glance_catalog_info            = image:glance:publicURL {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] glance_certfile                = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] glance_keyfile                 = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] glance_num_retries             = 3 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] glance_request_timeout         = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] goodness_function              = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] graceful_shutdown_timeout      = 5 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] group_api_class                = cinder.group.api.API {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] host                           = devstack {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] image_compress_on_upload       = True {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] image_conversion_address_space_limit = 1 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] image_conversion_cpu_limit     = 60 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] image_conversion_disable       = False {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] image_upload_use_cinder_backend = False {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] image_upload_use_internal_tenant = False {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] image_volume_cache_enabled     = False {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] image_volume_cache_max_count   = 0 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] image_volume_cache_max_size_gb = 0 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] init_host_max_objects_retrieval = 0 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] instance_format                = [instance: %(uuid)s]  {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] iscsi_target_flags             =  {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] iscsi_write_cache              = on {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] iser_helper                    = tgtadm {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-944d9ebe-2cfb-4717-96d8-05c7b1b4bcc2 None None] Starting volume driver QuobyteDriver (1.1.14)
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] iser_ip_address                = 192.168.122.117 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] iser_port                      = 3260 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-944d9ebe-2cfb-4717-96d8-05c7b1b4bcc2 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=83345) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] log_color                      = False {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] log_config_append              = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] log_dir                        = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] log_file                       = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] log_options                    = True {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] log_rotate_interval            = 1 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] log_rotate_interval_type       = days {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] log_rotation_type              = none {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] max_age                        = 0 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] max_logfile_count              = 30 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] max_logfile_size_mb            = 200 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] max_over_subscription_ratio    = 20.0 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] message_reap_interval          = 86400 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] message_ttl                    = 2592000 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] migration_create_volume_timeout_secs = 300 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] monkey_patch                   = False {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] monkey_patch_modules           = [] {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] my_ip                          = 192.168.122.117 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] no_snapshot_gb_quota           = False {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] num_iser_scan_tries            = 3 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] num_shell_tries                = 3 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] num_volume_device_scan_tries   = 3 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] nvmeof_conn_info_version       = 1 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] nvmet_ns_id                    = 10 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] nvmet_port_id                  = 1 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] osapi_max_limit                = 1000 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] osapi_volume_ext_list          = [] {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] osapi_volume_listen_port       = 8776 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] osapi_volume_use_ssl           = False {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] osapi_volume_workers           = 2 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] per_volume_size_limit          = -1 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] periodic_fuzzy_delay           = 60 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] periodic_interval              = 60 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] public_endpoint                = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] publish_errors                 = False {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] quota_backup_gigabytes         = 1000 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] quota_backups                  = 10 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] quota_gigabytes                = 1000 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] quota_groups                   = 10 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] quota_snapshots                = 10 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] quota_volumes                  = 10 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] rate_limit_burst               = 0 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] rate_limit_except_level        = CRITICAL {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] rate_limit_interval            = 0 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] reinit_driver_count            = 3 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] replication_device             = **** {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] report_discard_supported       = False {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] report_interval                = 120 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] reservation_clean_interval     = 86400 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] reservation_expire             = 86400 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] reserved_image_namespaces      = [] {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] reserved_percentage            = 0 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] rpc_response_timeout           = 120 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] run_external_periodic_tasks    = True {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] scst_target_driver             = iscsi {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] scst_target_iqn_name           = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] service_down_time              = 720 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] shell_completion               = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] snapshot_name_template         = snapshot-%s {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] split_loggers                  = False {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] state_path                     = /opt/stack/data/cinder {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] storage_availability_zone      = nova {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] storage_protocol               = iSCSI {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] syslog_log_facility            = LOG_USER {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] target_helper                  = lioadm {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] target_ip_address              = 192.168.122.117 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] target_port                    = 3260 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] target_protocol                = iscsi {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] target_secondary_ip_addresses  = [] {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] trace_flags                    = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] transport_url                  = **** {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] until_refresh                  = 0 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] use_chap_auth                  = False {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:03 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] use_default_quota_class        = True {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] use_journal                    = False {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] use_json                       = False {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] use_multipath_for_image_xfer   = False {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] use_stderr                     = False {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] use_syslog                     = False {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] verify_glance_signatures       = enabled {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] volume_api_class               = cinder.volume.api.API {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] volume_backend_name            = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] volume_clear                   = zero {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] volume_clear_ionice            = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] volume_clear_size              = 0 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] volume_copy_bps_limit          = 0 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] volume_dd_blocksize            = 1M {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] volume_name_template           = volume-%s {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] volume_service_inithost_offload = False {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] volume_usage_audit_period      = month {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] zoning_mode                    = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] oslo_concurrency.disable_process_locking = False {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] keystone_authtoken.admin_password = **** {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] keystone_authtoken.admin_token = **** {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] keystone_authtoken.admin_user  = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] keystone_authtoken.auth_admin_prefix =  {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] keystone_authtoken.auth_port   = 35357 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] keystone_authtoken.auth_protocol = https {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] keystone_authtoken.auth_section = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] keystone_authtoken.auth_type   = password {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] keystone_authtoken.auth_uri    = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] keystone_authtoken.auth_version = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] keystone_authtoken.cache       = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] keystone_authtoken.certfile    = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] keystone_authtoken.delay_auth_decision = False {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] keystone_authtoken.http_connect_timeout = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] keystone_authtoken.identity_uri = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] keystone_authtoken.include_service_catalog = True {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] keystone_authtoken.insecure    = False {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] keystone_authtoken.interface   = public {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] keystone_authtoken.keyfile     = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] keystone_authtoken.memcache_password =  {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] keystone_authtoken.memcache_username =  {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-944d9ebe-2cfb-4717-96d8-05c7b1b4bcc2 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=83345) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Apr 10 13:10:04 devstack cinder-volume[83345]: WARNING cinder.volume.drivers.quobyte [None req-944d9ebe-2cfb-4717-96d8-05c7b1b4bcc2 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Apr 10 13:10:04 devstack cinder-volume[83345]: WARNING cinder.volume.drivers.quobyte [None req-944d9ebe-2cfb-4717-96d8-05c7b1b4bcc2 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Apr 10 13:10:04 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-944d9ebe-2cfb-4717-96d8-05c7b1b4bcc2 None None] Running cmd (subprocess): mount.quobyte {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] keystone_authtoken.region_name = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] keystone_authtoken.service_token_roles_required = False {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] keystone_authtoken.service_type = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] keystone_authtoken.token_cache_time = 300 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.117/identity {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] cache.backend                  = dogpile.cache.null {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] cache.backend_argument         = **** {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] cache.backend_expiration_time  = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] cache.config_prefix            = cache.oslo {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] cache.debug_cache_backend      = False {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] cache.enable_retry_client      = False {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] cache.enable_socket_keepalive  = False {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] cache.enabled                  = False {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] cache.enforce_fips_mode        = False {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] cache.expiration_time          = 600 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] cache.hashclient_retry_attempts = 2 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] cache.memcache_dead_retry      = 300 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] cache.memcache_pool_maxsize    = 10 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] cache.memcache_sasl_enabled    = False {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] cache.password                 = **** {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] cache.proxies                  = [] {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] cache.redis_db                 = 0 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] cache.redis_sentinel_service_name = mymaster {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] cache.redis_server             = localhost:6379 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] cache.retry_attempts           = 2 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] cache.retry_delay              = 0.0 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] cache.socket_keepalive_count   = 1 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] cache.socket_keepalive_idle    = 1 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] cache.socket_keepalive_interval = 1 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] cache.socket_timeout           = 1.0 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] cache.tls_allowed_ciphers      = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] cache.tls_cafile               = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] cache.tls_certfile             = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] cache.tls_enabled              = False {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] cache.tls_keyfile              = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] cache.username                 = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] coordination.backend_url       = **** {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] database.asyncio_connection    = **** {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] database.asyncio_slave_connection = **** {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] database.backend               = sqlalchemy {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] database.connection            = **** {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] database.connection_debug      = 0 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] database.connection_parameters =  {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] database.connection_recycle_time = 3600 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] database.connection_trace      = False {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] database.db_inc_retry_interval = True {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] database.db_max_retries        = 20 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] database.db_max_retry_interval = 10 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] database.db_retry_interval     = 1 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] database.max_overflow          = 50 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] database.max_pool_size         = 5 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] database.max_retries           = 10 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] database.mysql_wsrep_sync_wait = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] database.pool_timeout          = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] database.retry_interval        = 10 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] database.slave_connection      = **** {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] database.sqlite_synchronous    = True {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] database.synchronous_reader    = True {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] database.use_db_reconnect      = False {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] profiler.connection_string     = messaging:// {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] profiler.enabled               = False {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] profiler.es_doc_type           = notification {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] profiler.es_scroll_size        = 10000 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] profiler.es_scroll_time        = 2m {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] profiler.filter_error_trace    = False {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] profiler.hmac_keys             = **** {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] profiler.sentinel_service_name = mymaster {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] profiler.socket_timeout        = 0.1 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] profiler.trace_requests        = False {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] profiler.trace_sqlalchemy      = False {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] profiler_jaeger.process_tags   = {} {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] profiler_jaeger.service_name_prefix = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] profiler_otlp.service_name_prefix = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] oslo_policy.enforce_new_defaults = False {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: WARNING oslo_config.cfg [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] oslo_policy.enforce_scope      = False {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] oslo_policy.policy_default_rule = default {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] oslo_policy.policy_file        = policy.yaml {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] privsep_osbrick.group          = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] privsep_osbrick.helper_command = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] privsep_osbrick.user           = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] cinder_sys_admin.group         = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] cinder_sys_admin.helper_command = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] cinder_sys_admin.user          = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] service_user.auth_section      = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] service_user.auth_type         = password {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] service_user.cafile            = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] service_user.certfile          = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] service_user.collect_timing    = False {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] service_user.insecure          = False {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] service_user.keyfile           = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] service_user.send_service_user_token = True {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] service_user.split_loggers     = False {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] service_user.timeout           = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] glance.auth_section            = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] glance.auth_type               = password {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack quobyte-client[83360]: Reading configuration file: /etc/quobyte/client.cfg
Apr 10 13:10:04 devstack quobyte-client[83360]: Invalid parameters found, error: missing mount point.
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] glance.certfile                = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] glance.collect_timing          = False {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack quobyte-client[83360]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Apr 10 13:10:04 devstack quobyte-client[83360]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] glance.insecure                = False {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] glance.keyfile                 = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] glance.region_name             = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] glance.split_loggers           = False {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] glance.timeout                 = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] backend_defaults.backend_availability_zone = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] backend_defaults.chap_password = **** {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] backend_defaults.chap_username =  {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] backend_defaults.disk_geometry = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] backend_defaults.driver_client_cert = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] backend_defaults.driver_client_cert_key = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] backend_defaults.driver_data_namespace = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-944d9ebe-2cfb-4717-96d8-05c7b1b4bcc2 None None] CMD "mount.quobyte" returned: 1 in 0.079s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] backend_defaults.driver_use_ssl = False {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] backend_defaults.enable_unsupported_driver = False {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-944d9ebe-2cfb-4717-96d8-05c7b1b4bcc2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] backend_defaults.extra_capabilities = {} {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-944d9ebe-2cfb-4717-96d8-05c7b1b4bcc2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] backend_defaults.filter_function = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] backend_defaults.goodness_function = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-944d9ebe-2cfb-4717-96d8-05c7b1b4bcc2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] backend_defaults.iscsi_target_flags =  {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] backend_defaults.iscsi_write_cache = on {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] backend_defaults.iser_helper   = tgtadm {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] backend_defaults.iser_ip_address = 192.168.122.117 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] backend_defaults.iser_port     = 3260 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] backend_defaults.nas_host      =  {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] backend_defaults.nas_login     = admin {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] backend_defaults.nas_mount_options = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-944d9ebe-2cfb-4717-96d8-05c7b1b4bcc2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] backend_defaults.nas_password  = **** {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-944d9ebe-2cfb-4717-96d8-05c7b1b4bcc2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] backend_defaults.nas_private_key =  {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] backend_defaults.nas_share_path =  {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-944d9ebe-2cfb-4717-96d8-05c7b1b4bcc2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] backend_defaults.num_shell_tries = 3 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] backend_defaults.nvmet_port_id = 1 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] backend_defaults.quobyte_client_cfg = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] backend_defaults.quobyte_volume_url = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] backend_defaults.replication_device = **** {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] backend_defaults.report_discard_supported = False {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] backend_defaults.reserved_percentage = 0 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] backend_defaults.scst_target_driver = iscsi {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] backend_defaults.scst_target_iqn_name = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] backend_defaults.storage_protocol = iSCSI {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] backend_defaults.target_helper = tgtadm {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] backend_defaults.target_ip_address = 192.168.122.117 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] backend_defaults.target_port   = 3260 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] backend_defaults.target_protocol = iscsi {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] backend_defaults.trace_flags   = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] backend_defaults.unique_fqdn_network = True {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] backend_defaults.use_chap_auth = False {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] backend_defaults.volume_backend_name = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] backend_defaults.volume_clear  = zero {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] backend_defaults.volume_clear_ionice = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] backend_defaults.volume_clear_size = 0 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] oslo_reports.file_event_handler = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] oslo_reports.log_dir           = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] QuobyteHD.backend_availability_zone = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] QuobyteHD.backend_host         = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] QuobyteHD.chap_password        = **** {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] QuobyteHD.chap_username        = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] QuobyteHD.chiscsi_conf         = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] QuobyteHD.disk_geometry        = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] QuobyteHD.driver_client_cert   = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] QuobyteHD.driver_client_cert_key = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] QuobyteHD.driver_data_namespace = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] QuobyteHD.driver_use_ssl       = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] QuobyteHD.extra_capabilities   = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] QuobyteHD.filter_function      = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] QuobyteHD.goodness_function    = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] QuobyteHD.iser_helper          = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] QuobyteHD.iser_ip_address      = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] QuobyteHD.iser_port            = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] QuobyteHD.iser_target_prefix   = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] QuobyteHD.nas_host             = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] QuobyteHD.nas_login            = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack sudo[83371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] QuobyteHD.nas_mount_options    = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] QuobyteHD.nas_password         = **** {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] QuobyteHD.nas_private_key      = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] QuobyteHD.nas_share_path       = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] QuobyteHD.nas_ssh_port         = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack sudo[83371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] QuobyteHD.num_shell_tries      = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] QuobyteHD.nvmet_port_id        = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] QuobyteHD.replication_device   = **** {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] QuobyteHD.report_discard_supported = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] QuobyteHD.reserved_percentage  = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] QuobyteHD.scst_target_driver   = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] QuobyteHD.storage_protocol     = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] QuobyteHD.target_helper        = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] QuobyteHD.target_ip_address    = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] QuobyteHD.target_port          = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] QuobyteHD.target_prefix        = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] QuobyteHD.target_protocol      = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] QuobyteHD.trace_flags          = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] QuobyteHD.use_chap_auth        = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] QuobyteHD.volume_clear         = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] QuobyteHD.volume_clear_size    = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] QuobyteHD.volumes_dir          = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] oslo_messaging_rabbit.ssl      = False {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] oslo_messaging_notifications.driver = [] {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] oslo_messaging_notifications.retry = -1 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] oslo_messaging_notifications.transport_url = **** {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] key_manager.fixed_key          = **** {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] barbican.barbican_api_version  = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] barbican.barbican_endpoint     = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] barbican.barbican_endpoint_type = public {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] barbican.barbican_region_name  = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] barbican.cafile                = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] barbican.certfile              = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] barbican.collect_timing        = False {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] barbican.insecure              = False {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] barbican.keyfile               = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] barbican.number_of_retries     = 60 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] barbican.retry_delay           = 1 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] barbican.send_service_user_token = False {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] barbican.split_loggers         = False {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] barbican.timeout               = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] barbican.verify_ssl            = True {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] barbican.verify_ssl_path       = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] barbican_service_user.auth_section = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] barbican_service_user.auth_type = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] barbican_service_user.cafile   = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] barbican_service_user.certfile = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] barbican_service_user.collect_timing = False {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] barbican_service_user.insecure = False {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] barbican_service_user.keyfile  = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] barbican_service_user.split_loggers = False {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] barbican_service_user.timeout  = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] vault.approle_role_id          = **** {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] vault.approle_secret_id        = **** {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] vault.kv_mountpoint            = secret {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] vault.kv_path                  = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] vault.kv_version               = 2 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] vault.namespace                = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] vault.root_token_id            = **** {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] vault.ssl_ca_crt_file          = None {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] vault.timeout                  = 60.0 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] vault.use_ssl                  = False {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 10 13:10:04 devstack cinder-volume[83144]: DEBUG oslo_service.backend._eventlet.service [None req-40f8b0ed-76e4-4821-85f6-d81ccfda0180 None None] ******************************************************************************** {{(pid=83144) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}}
Apr 10 13:10:04 devstack sudo[83371]: pam_unix(sudo:session): session closed for user root
Apr 10 13:10:04 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-944d9ebe-2cfb-4717-96d8-05c7b1b4bcc2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.430s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:10:04 devstack cinder-volume[83345]: INFO cinder.volume.driver [None req-944d9ebe-2cfb-4717-96d8-05c7b1b4bcc2 None None] Driver hasn't implemented _init_vendor_properties()
Apr 10 13:10:04 devstack cinder-volume[83345]: DEBUG cinder.volume.driver [None req-944d9ebe-2cfb-4717-96d8-05c7b1b4bcc2 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757999420166, 'free_capacity_gb': 1775.757999420166, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83345) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Apr 10 13:10:04 devstack cinder-volume[83345]: DEBUG oslo_db.sqlalchemy.engines [None req-944d9ebe-2cfb-4717-96d8-05c7b1b4bcc2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83345) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 10 13:10:04 devstack cinder-volume[83345]: DEBUG dbcounter [-] [83345] Writer thread running {{(pid=83345) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 10 13:10:04 devstack cinder-volume[83345]: DEBUG cinder.db.sqlalchemy.api [None req-944d9ebe-2cfb-4717-96d8-05c7b1b4bcc2 None None] Building query based on filter {{(pid=83345) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Apr 10 13:10:04 devstack cinder-volume[83345]: DEBUG cinder.image.image_utils [None req-944d9ebe-2cfb-4717-96d8-05c7b1b4bcc2 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=83345) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Apr 10 13:10:04 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-944d9ebe-2cfb-4717-96d8-05c7b1b4bcc2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:10:04 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-944d9ebe-2cfb-4717-96d8-05c7b1b4bcc2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:10:04 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-944d9ebe-2cfb-4717-96d8-05c7b1b4bcc2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:10:04 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-944d9ebe-2cfb-4717-96d8-05c7b1b4bcc2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:10:04 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-944d9ebe-2cfb-4717-96d8-05c7b1b4bcc2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:10:04 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-944d9ebe-2cfb-4717-96d8-05c7b1b4bcc2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:10:04 devstack cinder-volume[83345]: INFO cinder.keymgr.migration [None req-6796eee8-e362-473b-897d-721d0d2c0284 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Apr 10 13:10:04 devstack sudo[83389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:10:04 devstack sudo[83389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:10:05 devstack sudo[83389]: pam_unix(sudo:session): session closed for user root
Apr 10 13:10:05 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-944d9ebe-2cfb-4717-96d8-05c7b1b4bcc2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.439s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:10:05 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-944d9ebe-2cfb-4717-96d8-05c7b1b4bcc2 None None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:10:05 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-944d9ebe-2cfb-4717-96d8-05c7b1b4bcc2 None None] Driver initialization completed successfully.
Apr 10 13:10:05 devstack cinder-volume[83345]: INFO cinder.manager [None req-944d9ebe-2cfb-4717-96d8-05c7b1b4bcc2 None None] Initiating service 3 cleanup
Apr 10 13:10:05 devstack cinder-volume[83345]: INFO cinder.manager [None req-944d9ebe-2cfb-4717-96d8-05c7b1b4bcc2 None None] Service 3 cleanup completed.
Apr 10 13:10:05 devstack cinder-volume[83345]: DEBUG cinder.service [None req-944d9ebe-2cfb-4717-96d8-05c7b1b4bcc2 None None] Creating RPC server for service cinder-volume {{(pid=83345) start /opt/stack/cinder/cinder/service.py:231}}
Apr 10 13:10:05 devstack cinder-volume[83345]: DEBUG cinder.service [None req-944d9ebe-2cfb-4717-96d8-05c7b1b4bcc2 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=83345) start /opt/stack/cinder/cinder/service.py:237}}
Apr 10 13:10:05 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-944d9ebe-2cfb-4717-96d8-05c7b1b4bcc2 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Apr 10 13:10:05 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-944d9ebe-2cfb-4717-96d8-05c7b1b4bcc2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:10:05 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-944d9ebe-2cfb-4717-96d8-05c7b1b4bcc2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:10:05 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-944d9ebe-2cfb-4717-96d8-05c7b1b4bcc2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:10:05 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-944d9ebe-2cfb-4717-96d8-05c7b1b4bcc2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:10:05 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-944d9ebe-2cfb-4717-96d8-05c7b1b4bcc2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:10:05 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-944d9ebe-2cfb-4717-96d8-05c7b1b4bcc2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:10:05 devstack sudo[83394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:10:05 devstack sudo[83394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:10:05 devstack sudo[83394]: pam_unix(sudo:session): session closed for user root
Apr 10 13:10:05 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-944d9ebe-2cfb-4717-96d8-05c7b1b4bcc2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.384s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:10:05 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-944d9ebe-2cfb-4717-96d8-05c7b1b4bcc2 None None] Driver post RPC initialization completed successfully.
Apr 10 13:10:13 devstack cinder-volume[83144]: DEBUG dbcounter [-] [83144] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=83144) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 10 13:10:15 devstack cinder-volume[83345]: DEBUG dbcounter [-] [83345] Writing DB stats cinder:SELECT=2 {{(pid=83345) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 10 13:10:15 devstack cinder-volume[83345]: DEBUG dbcounter [-] [83345] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=83345) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 10 13:11:04 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [req-4d649772-db55-4b33-bd73-88d68cdc69a8 req-b9470299-20f2-44f9-ba42-1c132b784014 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:11:04 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [req-4d649772-db55-4b33-bd73-88d68cdc69a8 req-b9470299-20f2-44f9-ba42-1c132b784014 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Flow 'volume_create_manager' (ad450418-8da4-4645-aac7-a19dd01d5606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:11:04 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [req-4d649772-db55-4b33-bd73-88d68cdc69a8 req-b9470299-20f2-44f9-ba42-1c132b784014 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbcf8131-e9cf-478b-95bb-369912ec36a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:11:04 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [req-4d649772-db55-4b33-bd73-88d68cdc69a8 req-b9470299-20f2-44f9-ba42-1c132b784014 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbcf8131-e9cf-478b-95bb-369912ec36a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:11:01Z,deleted=False,deleted_at=None,display_description='',display_name='716c6a11-e2f7-4009-bed5-7ef34e60c619-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=648cb04b-29b8-434b-bf1e-971d8761dc4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d54ed146d39f4e3dbc91a7441decfecc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:11:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:11:05Z,use_quota=True,user_id='45a7706494bf40ceb2abb68c0b9c8c78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:11:04 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [req-4d649772-db55-4b33-bd73-88d68cdc69a8 req-b9470299-20f2-44f9-ba42-1c132b784014 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa55f3ad-6ee0-4fad-884f-68b8cd4fd2ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:11:04 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [req-4d649772-db55-4b33-bd73-88d68cdc69a8 req-b9470299-20f2-44f9-ba42-1c132b784014 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa55f3ad-6ee0-4fad-884f-68b8cd4fd2ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:11:04 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [req-4d649772-db55-4b33-bd73-88d68cdc69a8 req-b9470299-20f2-44f9-ba42-1c132b784014 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (305f00ad-a42f-474f-b7c3-799fa01667af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:11:04 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [req-4d649772-db55-4b33-bd73-88d68cdc69a8 req-b9470299-20f2-44f9-ba42-1c132b784014 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (305f00ad-a42f-474f-b7c3-799fa01667af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '648cb04b-29b8-434b-bf1e-971d8761dc4f', 'volume_name': 'volume-648cb04b-29b8-434b-bf1e-971d8761dc4f', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:11:04 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [req-4d649772-db55-4b33-bd73-88d68cdc69a8 req-b9470299-20f2-44f9-ba42-1c132b784014 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (543bddb8-c058-492b-aa12-1703c21c4382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:11:04 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [req-4d649772-db55-4b33-bd73-88d68cdc69a8 req-b9470299-20f2-44f9-ba42-1c132b784014 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (543bddb8-c058-492b-aa12-1703c21c4382) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:11:04 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [req-4d649772-db55-4b33-bd73-88d68cdc69a8 req-b9470299-20f2-44f9-ba42-1c132b784014 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f370762-b617-4da8-9ebd-236ceb074025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:11:04 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [req-4d649772-db55-4b33-bd73-88d68cdc69a8 req-b9470299-20f2-44f9-ba42-1c132b784014 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Volume 648cb04b-29b8-434b-bf1e-971d8761dc4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-648cb04b-29b8-434b-bf1e-971d8761dc4f', 'volume_size': 1}
Apr 10 13:11:04 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [req-4d649772-db55-4b33-bd73-88d68cdc69a8 req-b9470299-20f2-44f9-ba42-1c132b784014 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:11:04 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [req-4d649772-db55-4b33-bd73-88d68cdc69a8 req-b9470299-20f2-44f9-ba42-1c132b784014 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:11:04 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [req-4d649772-db55-4b33-bd73-88d68cdc69a8 req-b9470299-20f2-44f9-ba42-1c132b784014 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f252bf08b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:11:01Z,deleted=False,deleted_at=None,display_description='',display_name='716c6a11-e2f7-4009-bed5-7ef34e60c619-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=648cb04b-29b8-434b-bf1e-971d8761dc4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d54ed146d39f4e3dbc91a7441decfecc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:11:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:11:05Z,use_quota=True,user_id='45a7706494bf40ceb2abb68c0b9c8c78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)}" {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 13:11:04 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [req-4d649772-db55-4b33-bd73-88d68cdc69a8 req-b9470299-20f2-44f9-ba42-1c132b784014 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Creating volume 648cb04b-29b8-434b-bf1e-971d8761dc4f {{(pid=83345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 13:11:04 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [req-4d649772-db55-4b33-bd73-88d68cdc69a8 req-b9470299-20f2-44f9-ba42-1c132b784014 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:11:04 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [req-4d649772-db55-4b33-bd73-88d68cdc69a8 req-b9470299-20f2-44f9-ba42-1c132b784014 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:11:04 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [req-4d649772-db55-4b33-bd73-88d68cdc69a8 req-b9470299-20f2-44f9-ba42-1c132b784014 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:11:04 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [req-4d649772-db55-4b33-bd73-88d68cdc69a8 req-b9470299-20f2-44f9-ba42-1c132b784014 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:11:04 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [req-4d649772-db55-4b33-bd73-88d68cdc69a8 req-b9470299-20f2-44f9-ba42-1c132b784014 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:11:04 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [req-4d649772-db55-4b33-bd73-88d68cdc69a8 req-b9470299-20f2-44f9-ba42-1c132b784014 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:11:04 devstack cinder-volume[83345]: INFO cinder.volume.drivers.remotefs [req-4d649772-db55-4b33-bd73-88d68cdc69a8 req-b9470299-20f2-44f9-ba42-1c132b784014 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] casted to osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331
Apr 10 13:11:04 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [req-4d649772-db55-4b33-bd73-88d68cdc69a8 req-b9470299-20f2-44f9-ba42-1c132b784014 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-648cb04b-29b8-434b-bf1e-971d8761dc4f 1073741824 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:11:04 devstack sudo[83849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-648cb04b-29b8-434b-bf1e-971d8761dc4f 1073741824
Apr 10 13:11:04 devstack sudo[83849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:11:05 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-f2727a4f-39ec-40aa-921b-fadaf21b4fb8 tempest-GroupsTest-67639021 None] Group tempest-Group1-1791786831: creating
Apr 10 13:11:05 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-f2727a4f-39ec-40aa-921b-fadaf21b4fb8 tempest-GroupsTest-67639021 None] Group tempest-Group1-1791786831: created successfully
Apr 10 13:11:05 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-f2727a4f-39ec-40aa-921b-fadaf21b4fb8 tempest-GroupsTest-67639021 None] Create group completed successfully.
Apr 10 13:11:05 devstack sudo[83849]: pam_unix(sudo:session): session closed for user root
Apr 10 13:11:05 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [req-4d649772-db55-4b33-bd73-88d68cdc69a8 req-b9470299-20f2-44f9-ba42-1c132b784014 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-648cb04b-29b8-434b-bf1e-971d8761dc4f 1073741824" returned: 0 in 0.839s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:11:05 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [req-4d649772-db55-4b33-bd73-88d68cdc69a8 req-b9470299-20f2-44f9-ba42-1c132b784014 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-648cb04b-29b8-434b-bf1e-971d8761dc4f {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:11:05 devstack sudo[84194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-648cb04b-29b8-434b-bf1e-971d8761dc4f
Apr 10 13:11:05 devstack sudo[84194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:11:06 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-231af65b-9902-4030-9858-d65610d2ca98 tempest-GroupsTest-67639021 None] Group tempest-Group2-541521735: creating
Apr 10 13:11:06 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-231af65b-9902-4030-9858-d65610d2ca98 tempest-GroupsTest-67639021 None] Group tempest-Group2-541521735: created successfully
Apr 10 13:11:06 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-231af65b-9902-4030-9858-d65610d2ca98 tempest-GroupsTest-67639021 None] Create group completed successfully.
Apr 10 13:11:06 devstack sudo[84194]: pam_unix(sudo:session): session closed for user root
Apr 10 13:11:06 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [req-4d649772-db55-4b33-bd73-88d68cdc69a8 req-b9470299-20f2-44f9-ba42-1c132b784014 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-648cb04b-29b8-434b-bf1e-971d8761dc4f" returned: 0 in 0.651s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:11:06 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [req-4d649772-db55-4b33-bd73-88d68cdc69a8 req-b9470299-20f2-44f9-ba42-1c132b784014 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] <== create_volume: return (1524ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'} {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 13:11:06 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [req-4d649772-db55-4b33-bd73-88d68cdc69a8 req-b9470299-20f2-44f9-ba42-1c132b784014 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.526s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:11:06 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [req-4d649772-db55-4b33-bd73-88d68cdc69a8 req-b9470299-20f2-44f9-ba42-1c132b784014 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f370762-b617-4da8-9ebd-236ceb074025) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-648cb04b-29b8-434b-bf1e-971d8761dc4f', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:11:06 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [req-4d649772-db55-4b33-bd73-88d68cdc69a8 req-b9470299-20f2-44f9-ba42-1c132b784014 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (371321ca-c00a-412d-bc26-db70857a6f3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:11:06 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [req-4d649772-db55-4b33-bd73-88d68cdc69a8 req-b9470299-20f2-44f9-ba42-1c132b784014 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Volume volume-648cb04b-29b8-434b-bf1e-971d8761dc4f (648cb04b-29b8-434b-bf1e-971d8761dc4f): created successfully
Apr 10 13:11:06 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [req-4d649772-db55-4b33-bd73-88d68cdc69a8 req-b9470299-20f2-44f9-ba42-1c132b784014 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (371321ca-c00a-412d-bc26-db70857a6f3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:11:06 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [req-4d649772-db55-4b33-bd73-88d68cdc69a8 req-b9470299-20f2-44f9-ba42-1c132b784014 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Flow 'volume_create_manager' (ad450418-8da4-4645-aac7-a19dd01d5606) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:11:06 devstack cinder-volume[83345]: INFO cinder.volume.manager [req-4d649772-db55-4b33-bd73-88d68cdc69a8 req-b9470299-20f2-44f9-ba42-1c132b784014 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Created volume successfully.
Apr 10 13:11:07 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-00266ef6-565f-4d8c-a527-58d896708f91 tempest-GroupsTest-67639021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:11:07 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-00266ef6-565f-4d8c-a527-58d896708f91 tempest-GroupsTest-67639021 None] Flow 'volume_create_manager' (10959dbe-5e0d-464e-a9d1-d167f51aa67f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:11:07 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-00266ef6-565f-4d8c-a527-58d896708f91 tempest-GroupsTest-67639021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f42d4453-6d58-407a-8264-b588d941387b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:11:07 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-00266ef6-565f-4d8c-a527-58d896708f91 tempest-GroupsTest-67639021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f42d4453-6d58-407a-8264-b588d941387b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:11:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-148466091',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=93ceea80-e3fa-4c16-84f8-2b7eccf5e982,host='devstack@QuobyteHD#QuobyteHD',id=8fd1a30d-a55d-4a5b-ae3e-7222449d53f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3b998d7f8a445d983daf8b23cb0160a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:11:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:11:08Z,use_quota=True,user_id='a59b0946da1e4dbcbb3d94348b5b9aac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7c47dc8-95f5-4b51-b9ca-d6e1f10e2c51),volume_type_id=a7c47dc8-95f5-4b51-b9ca-d6e1f10e2c51)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:11:07 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-00266ef6-565f-4d8c-a527-58d896708f91 tempest-GroupsTest-67639021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e93e313-e8c6-41dd-b86e-b159e83de205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:11:07 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-00266ef6-565f-4d8c-a527-58d896708f91 tempest-GroupsTest-67639021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e93e313-e8c6-41dd-b86e-b159e83de205) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:11:07 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-00266ef6-565f-4d8c-a527-58d896708f91 tempest-GroupsTest-67639021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad5a7832-b339-4240-84e2-cc6886cfeeba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:11:07 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-00266ef6-565f-4d8c-a527-58d896708f91 tempest-GroupsTest-67639021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad5a7832-b339-4240-84e2-cc6886cfeeba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8fd1a30d-a55d-4a5b-ae3e-7222449d53f3', 'volume_name': 'volume-8fd1a30d-a55d-4a5b-ae3e-7222449d53f3', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:11:07 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-00266ef6-565f-4d8c-a527-58d896708f91 tempest-GroupsTest-67639021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dedb4fea-6671-4097-8b57-b9e2b008f88a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:11:07 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-00266ef6-565f-4d8c-a527-58d896708f91 tempest-GroupsTest-67639021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dedb4fea-6671-4097-8b57-b9e2b008f88a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:11:07 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-00266ef6-565f-4d8c-a527-58d896708f91 tempest-GroupsTest-67639021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27584edd-87e6-49cb-a7a8-672e0242355f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:11:07 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-00266ef6-565f-4d8c-a527-58d896708f91 tempest-GroupsTest-67639021 None] Volume 8fd1a30d-a55d-4a5b-ae3e-7222449d53f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8fd1a30d-a55d-4a5b-ae3e-7222449d53f3', 'volume_size': 1}
Apr 10 13:11:07 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-00266ef6-565f-4d8c-a527-58d896708f91 tempest-GroupsTest-67639021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:11:07 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-00266ef6-565f-4d8c-a527-58d896708f91 tempest-GroupsTest-67639021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:11:07 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-00266ef6-565f-4d8c-a527-58d896708f91 tempest-GroupsTest-67639021 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f252bf08b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=93ceea80-e3fa-4c16-84f8-2b7eccf5e982,created_at=2026-04-10T11:11:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-148466091',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=93ceea80-e3fa-4c16-84f8-2b7eccf5e982,host='devstack@QuobyteHD#QuobyteHD',id=8fd1a30d-a55d-4a5b-ae3e-7222449d53f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3b998d7f8a445d983daf8b23cb0160a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:11:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:11:08Z,use_quota=True,user_id='a59b0946da1e4dbcbb3d94348b5b9aac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7c47dc8-95f5-4b51-b9ca-d6e1f10e2c51),volume_type_id=a7c47dc8-95f5-4b51-b9ca-d6e1f10e2c51)}" {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 13:11:07 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-00266ef6-565f-4d8c-a527-58d896708f91 tempest-GroupsTest-67639021 None] Creating volume 8fd1a30d-a55d-4a5b-ae3e-7222449d53f3 {{(pid=83345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 13:11:07 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-00266ef6-565f-4d8c-a527-58d896708f91 tempest-GroupsTest-67639021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:11:07 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-00266ef6-565f-4d8c-a527-58d896708f91 tempest-GroupsTest-67639021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:11:07 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-00266ef6-565f-4d8c-a527-58d896708f91 tempest-GroupsTest-67639021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:11:07 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-00266ef6-565f-4d8c-a527-58d896708f91 tempest-GroupsTest-67639021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:11:07 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-00266ef6-565f-4d8c-a527-58d896708f91 tempest-GroupsTest-67639021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:11:07 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-00266ef6-565f-4d8c-a527-58d896708f91 tempest-GroupsTest-67639021 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:11:08 devstack cinder-volume[83345]: INFO cinder.volume.drivers.remotefs [None req-00266ef6-565f-4d8c-a527-58d896708f91 tempest-GroupsTest-67639021 None] casted to osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331
Apr 10 13:11:08 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-00266ef6-565f-4d8c-a527-58d896708f91 tempest-GroupsTest-67639021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-8fd1a30d-a55d-4a5b-ae3e-7222449d53f3 1073741824 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:11:08 devstack sudo[84201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-8fd1a30d-a55d-4a5b-ae3e-7222449d53f3 1073741824
Apr 10 13:11:08 devstack sudo[84201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:11:09 devstack sudo[84201]: pam_unix(sudo:session): session closed for user root
Apr 10 13:11:09 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-00266ef6-565f-4d8c-a527-58d896708f91 tempest-GroupsTest-67639021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-8fd1a30d-a55d-4a5b-ae3e-7222449d53f3 1073741824" returned: 0 in 1.366s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:11:09 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-00266ef6-565f-4d8c-a527-58d896708f91 tempest-GroupsTest-67639021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-8fd1a30d-a55d-4a5b-ae3e-7222449d53f3 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:11:09 devstack sudo[84210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-8fd1a30d-a55d-4a5b-ae3e-7222449d53f3
Apr 10 13:11:09 devstack sudo[84210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:11:10 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffdf7080-8d0e-4928-838b-202fcf5f54b1 tempest-VolumesAdminNegativeTest-282150995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:11:10 devstack sudo[84210]: pam_unix(sudo:session): session closed for user root
Apr 10 13:11:10 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ffdf7080-8d0e-4928-838b-202fcf5f54b1 tempest-VolumesAdminNegativeTest-282150995 None] Flow 'volume_create_manager' (c2cdfc8b-2621-47bd-957a-33f4d136feec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:11:10 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ffdf7080-8d0e-4928-838b-202fcf5f54b1 tempest-VolumesAdminNegativeTest-282150995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd12f8ad-202e-4c7b-91f9-709edf6816ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:11:10 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-00266ef6-565f-4d8c-a527-58d896708f91 tempest-GroupsTest-67639021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-8fd1a30d-a55d-4a5b-ae3e-7222449d53f3" returned: 0 in 1.317s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:11:10 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-00266ef6-565f-4d8c-a527-58d896708f91 tempest-GroupsTest-67639021 None] <== create_volume: return (2746ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'} {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 13:11:10 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-00266ef6-565f-4d8c-a527-58d896708f91 tempest-GroupsTest-67639021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.750s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:11:10 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ffdf7080-8d0e-4928-838b-202fcf5f54b1 tempest-VolumesAdminNegativeTest-282150995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd12f8ad-202e-4c7b-91f9-709edf6816ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:11:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1346670753',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb66036a-899e-4e21-b537-9f57aec59916,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aaea903814c6435c86ab6d3177743fd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:11:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:11:11Z,use_quota=True,user_id='01067892b9004441b84921879a8ab2eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:11:10 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ffdf7080-8d0e-4928-838b-202fcf5f54b1 tempest-VolumesAdminNegativeTest-282150995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f803b09-f586-4ef4-8ec1-abd0beaaf85e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:11:10 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ffdf7080-8d0e-4928-838b-202fcf5f54b1 tempest-VolumesAdminNegativeTest-282150995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f803b09-f586-4ef4-8ec1-abd0beaaf85e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:11:10 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ffdf7080-8d0e-4928-838b-202fcf5f54b1 tempest-VolumesAdminNegativeTest-282150995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a535b43-ae62-46c8-9644-c0520ee13031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:11:10 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ffdf7080-8d0e-4928-838b-202fcf5f54b1 tempest-VolumesAdminNegativeTest-282150995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a535b43-ae62-46c8-9644-c0520ee13031) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb66036a-899e-4e21-b537-9f57aec59916', 'volume_name': 'volume-cb66036a-899e-4e21-b537-9f57aec59916', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:11:10 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ffdf7080-8d0e-4928-838b-202fcf5f54b1 tempest-VolumesAdminNegativeTest-282150995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf5e711e-c5e7-468a-b2f8-170b04c8b681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:11:10 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ffdf7080-8d0e-4928-838b-202fcf5f54b1 tempest-VolumesAdminNegativeTest-282150995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf5e711e-c5e7-468a-b2f8-170b04c8b681) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:11:10 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ffdf7080-8d0e-4928-838b-202fcf5f54b1 tempest-VolumesAdminNegativeTest-282150995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (076bc4c3-a7d6-473a-81f9-94240edda9cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:11:10 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-ffdf7080-8d0e-4928-838b-202fcf5f54b1 tempest-VolumesAdminNegativeTest-282150995 None] Volume cb66036a-899e-4e21-b537-9f57aec59916: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb66036a-899e-4e21-b537-9f57aec59916', 'volume_size': 1}
Apr 10 13:11:10 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-ffdf7080-8d0e-4928-838b-202fcf5f54b1 tempest-VolumesAdminNegativeTest-282150995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:11:10 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-ffdf7080-8d0e-4928-838b-202fcf5f54b1 tempest-VolumesAdminNegativeTest-282150995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:11:10 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-ffdf7080-8d0e-4928-838b-202fcf5f54b1 tempest-VolumesAdminNegativeTest-282150995 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f252bf08b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:11:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1346670753',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb66036a-899e-4e21-b537-9f57aec59916,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aaea903814c6435c86ab6d3177743fd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:11:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:11:11Z,use_quota=True,user_id='01067892b9004441b84921879a8ab2eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)}" {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 13:11:10 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-ffdf7080-8d0e-4928-838b-202fcf5f54b1 tempest-VolumesAdminNegativeTest-282150995 None] Creating volume cb66036a-899e-4e21-b537-9f57aec59916 {{(pid=83345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 13:11:10 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-ffdf7080-8d0e-4928-838b-202fcf5f54b1 tempest-VolumesAdminNegativeTest-282150995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:11:10 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-ffdf7080-8d0e-4928-838b-202fcf5f54b1 tempest-VolumesAdminNegativeTest-282150995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:11:10 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-ffdf7080-8d0e-4928-838b-202fcf5f54b1 tempest-VolumesAdminNegativeTest-282150995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:11:10 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-ffdf7080-8d0e-4928-838b-202fcf5f54b1 tempest-VolumesAdminNegativeTest-282150995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:11:10 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-ffdf7080-8d0e-4928-838b-202fcf5f54b1 tempest-VolumesAdminNegativeTest-282150995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:11:10 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-ffdf7080-8d0e-4928-838b-202fcf5f54b1 tempest-VolumesAdminNegativeTest-282150995 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:11:10 devstack cinder-volume[83345]: INFO cinder.volume.drivers.remotefs [None req-ffdf7080-8d0e-4928-838b-202fcf5f54b1 tempest-VolumesAdminNegativeTest-282150995 None] casted to osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331
Apr 10 13:11:10 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ffdf7080-8d0e-4928-838b-202fcf5f54b1 tempest-VolumesAdminNegativeTest-282150995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-cb66036a-899e-4e21-b537-9f57aec59916 1073741824 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:11:10 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-00266ef6-565f-4d8c-a527-58d896708f91 tempest-GroupsTest-67639021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27584edd-87e6-49cb-a7a8-672e0242355f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fd1a30d-a55d-4a5b-ae3e-7222449d53f3', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:11:10 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-00266ef6-565f-4d8c-a527-58d896708f91 tempest-GroupsTest-67639021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c09c2c2f-89a0-43ed-bce4-6ca5206df925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:11:10 devstack sudo[84219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-cb66036a-899e-4e21-b537-9f57aec59916 1073741824
Apr 10 13:11:10 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-00266ef6-565f-4d8c-a527-58d896708f91 tempest-GroupsTest-67639021 None] Volume volume-8fd1a30d-a55d-4a5b-ae3e-7222449d53f3 (8fd1a30d-a55d-4a5b-ae3e-7222449d53f3): created successfully
Apr 10 13:11:10 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-00266ef6-565f-4d8c-a527-58d896708f91 tempest-GroupsTest-67639021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c09c2c2f-89a0-43ed-bce4-6ca5206df925) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:11:10 devstack sudo[84219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:11:10 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-00266ef6-565f-4d8c-a527-58d896708f91 tempest-GroupsTest-67639021 None] Flow 'volume_create_manager' (10959dbe-5e0d-464e-a9d1-d167f51aa67f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:11:10 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-00266ef6-565f-4d8c-a527-58d896708f91 tempest-GroupsTest-67639021 None] Created volume successfully.
Apr 10 13:11:11 devstack cinder-volume[83345]: WARNING py.warnings [req-4d649772-db55-4b33-bd73-88d68cdc69a8 req-4e9e946e-440a-4ad9-a742-0f8df49de93f tempest-ServerBootFromVolumeStableRescueTest-864025333 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1".  Apply join condition(s) between each element to resolve.
Apr 10 13:11:11 devstack cinder-volume[83345]:   .first()
Apr 10 13:11:11 devstack cinder-volume[83345]: 
Apr 10 13:11:11 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [req-4d649772-db55-4b33-bd73-88d68cdc69a8 req-4e9e946e-440a-4ad9-a742-0f8df49de93f tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:11:11 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-719545b5-f9e3-4811-9abc-fd06c31cd8a9 tempest-GroupsTest-67639021 None] Acquiring lock "cinder-quobyte-8fd1a30d-a55d-4a5b-ae3e-7222449d53f3" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:11:11 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-719545b5-f9e3-4811-9abc-fd06c31cd8a9 tempest-GroupsTest-67639021 None] Lock "cinder-quobyte-8fd1a30d-a55d-4a5b-ae3e-7222449d53f3" acquired by "delete_volume" :: waited 0.023s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:11:11 devstack cinder-volume[83345]: INFO oslo.privsep.daemon [None req-719545b5-f9e3-4811-9abc-fd06c31cd8a9 tempest-GroupsTest-67639021 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpi0bbyqh6/privsep.sock']
Apr 10 13:11:11 devstack sudo[84234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpi0bbyqh6/privsep.sock
Apr 10 13:11:11 devstack sudo[84234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:11:11 devstack sudo[84219]: pam_unix(sudo:session): session closed for user root
Apr 10 13:11:11 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ffdf7080-8d0e-4928-838b-202fcf5f54b1 tempest-VolumesAdminNegativeTest-282150995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-cb66036a-899e-4e21-b537-9f57aec59916 1073741824" returned: 0 in 1.099s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:11:11 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ffdf7080-8d0e-4928-838b-202fcf5f54b1 tempest-VolumesAdminNegativeTest-282150995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-cb66036a-899e-4e21-b537-9f57aec59916 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:11:11 devstack sudo[84236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-cb66036a-899e-4e21-b537-9f57aec59916
Apr 10 13:11:12 devstack sudo[84236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:11:12 devstack cinder-volume[83345]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning:
Apr 10 13:11:12 devstack cinder-volume[83345]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 10 13:11:12 devstack cinder-volume[83345]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Apr 10 13:11:12 devstack cinder-volume[83345]: WARNING oslo.privsep.daemon [-] privsep log: 
Apr 10 13:11:12 devstack cinder-volume[83345]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Apr 10 13:11:12 devstack cinder-volume[83345]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Apr 10 13:11:12 devstack cinder-volume[83345]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 10 13:11:12 devstack cinder-volume[83345]: WARNING oslo.privsep.daemon [-] privsep log: 
Apr 10 13:11:12 devstack cinder-volume[83345]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet.patcher
Apr 10 13:11:12 devstack sudo[84236]: pam_unix(sudo:session): session closed for user root
Apr 10 13:11:12 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ffdf7080-8d0e-4928-838b-202fcf5f54b1 tempest-VolumesAdminNegativeTest-282150995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-cb66036a-899e-4e21-b537-9f57aec59916" returned: 0 in 0.568s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:11:12 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-ffdf7080-8d0e-4928-838b-202fcf5f54b1 tempest-VolumesAdminNegativeTest-282150995 None] <== create_volume: return (1716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'} {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 13:11:12 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-ffdf7080-8d0e-4928-838b-202fcf5f54b1 tempest-VolumesAdminNegativeTest-282150995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.719s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:11:12 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [req-4d649772-db55-4b33-bd73-88d68cdc69a8 req-4e9e946e-440a-4ad9-a742-0f8df49de93f tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.207s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:11:12 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ffdf7080-8d0e-4928-838b-202fcf5f54b1 tempest-VolumesAdminNegativeTest-282150995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (076bc4c3-a7d6-473a-81f9-94240edda9cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb66036a-899e-4e21-b537-9f57aec59916', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:11:12 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ffdf7080-8d0e-4928-838b-202fcf5f54b1 tempest-VolumesAdminNegativeTest-282150995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3561c1d-9ac6-4436-9cd1-122cde776dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:11:12 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-ffdf7080-8d0e-4928-838b-202fcf5f54b1 tempest-VolumesAdminNegativeTest-282150995 None] Volume volume-cb66036a-899e-4e21-b537-9f57aec59916 (cb66036a-899e-4e21-b537-9f57aec59916): created successfully
Apr 10 13:11:12 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ffdf7080-8d0e-4928-838b-202fcf5f54b1 tempest-VolumesAdminNegativeTest-282150995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3561c1d-9ac6-4436-9cd1-122cde776dfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:11:12 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ffdf7080-8d0e-4928-838b-202fcf5f54b1 tempest-VolumesAdminNegativeTest-282150995 None] Flow 'volume_create_manager' (c2cdfc8b-2621-47bd-957a-33f4d136feec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:11:12 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-ffdf7080-8d0e-4928-838b-202fcf5f54b1 tempest-VolumesAdminNegativeTest-282150995 None] Created volume successfully.
Apr 10 13:11:13 devstack cinder-volume[83345]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:66: EventletDeprecationWarning:
Apr 10 13:11:13 devstack cinder-volume[83345]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 10 13:11:13 devstack cinder-volume[83345]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Apr 10 13:11:13 devstack cinder-volume[83345]: WARNING oslo.privsep.daemon [-] privsep log: 
Apr 10 13:11:13 devstack cinder-volume[83345]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Apr 10 13:11:13 devstack cinder-volume[83345]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Apr 10 13:11:13 devstack cinder-volume[83345]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 10 13:11:13 devstack cinder-volume[83345]: WARNING oslo.privsep.daemon [-] privsep log: 
Apr 10 13:11:13 devstack cinder-volume[83345]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet
Apr 10 13:11:13 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-1270eca6-a1cc-45a1-9d88-c327d4b0bdbb tempest-VolumesAdminNegativeTest-282150995 None] Acquiring lock "cinder-cb66036a-899e-4e21-b537-9f57aec59916-delete_volume" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:11:13 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-1270eca6-a1cc-45a1-9d88-c327d4b0bdbb tempest-VolumesAdminNegativeTest-282150995 None] Lock "cinder-cb66036a-899e-4e21-b537-9f57aec59916-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:11:13 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-1270eca6-a1cc-45a1-9d88-c327d4b0bdbb tempest-VolumesAdminNegativeTest-282150995 None] Acquiring lock "cinder-quobyte-cb66036a-899e-4e21-b537-9f57aec59916" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:11:13 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-1270eca6-a1cc-45a1-9d88-c327d4b0bdbb tempest-VolumesAdminNegativeTest-282150995 None] Lock "cinder-quobyte-cb66036a-899e-4e21-b537-9f57aec59916" acquired by "delete_volume" :: waited 0.017s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:11:13 devstack sudo[84234]: pam_unix(sudo:session): session closed for user root
Apr 10 13:11:13 devstack cinder-volume[83345]: INFO oslo.privsep.daemon [None req-719545b5-f9e3-4811-9abc-fd06c31cd8a9 tempest-GroupsTest-67639021 None] Spawned new privsep daemon via rootwrap
Apr 10 13:11:13 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [None req-719545b5-f9e3-4811-9abc-fd06c31cd8a9 tempest-GroupsTest-67639021 None] Accepted privsep connection to /tmp/tmpi0bbyqh6/privsep.sock {{(pid=83345) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:418}}
Apr 10 13:11:13 devstack cinder-volume[83345]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 10 13:11:13 devstack cinder-volume[83345]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 10 13:11:13 devstack cinder-volume[83345]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Apr 10 13:11:13 devstack cinder-volume[83345]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84247
Apr 10 13:11:13 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[15307ba3-fdb9-4e7f-a9ca-78a7e9e3ebb1]: (2,) {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:11:13 devstack cinder-volume[83345]: WARNING oslo_privsep.priv_context [req-4d649772-db55-4b33-bd73-88d68cdc69a8 req-4e9e946e-440a-4ad9-a742-0f8df49de93f tempest-ServerBootFromVolumeStableRescueTest-864025333 None] privsep daemon already running
Apr 10 13:11:13 devstack cinder-volume[83345]: WARNING oslo_privsep.priv_context [None req-1270eca6-a1cc-45a1-9d88-c327d4b0bdbb tempest-VolumesAdminNegativeTest-282150995 None] privsep daemon already running
Apr 10 13:11:13 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e211a1c-2b53-4a62-a606-77b92a021664]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:11:13 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [req-4d649772-db55-4b33-bd73-88d68cdc69a8 req-4e9e946e-440a-4ad9-a742-0f8df49de93f tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-648cb04b-29b8-434b-bf1e-971d8761dc4f {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:11:13 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[0277d9d9-1a76-4c93-b175-94e0df400d11]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:11:13 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-1270eca6-a1cc-45a1-9d88-c327d4b0bdbb tempest-VolumesAdminNegativeTest-282150995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-cb66036a-899e-4e21-b537-9f57aec59916 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:11:13 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[d11ea229-22e3-4aa6-a853-af8ca0d1a1a4]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:11:13 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-719545b5-f9e3-4811-9abc-fd06c31cd8a9 tempest-GroupsTest-67639021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-8fd1a30d-a55d-4a5b-ae3e-7222449d53f3 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:11:13 devstack sudo[84253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-648cb04b-29b8-434b-bf1e-971d8761dc4f
Apr 10 13:11:13 devstack sudo[84253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:11:13 devstack sudo[84254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-cb66036a-899e-4e21-b537-9f57aec59916
Apr 10 13:11:13 devstack sudo[84254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:11:13 devstack sudo[84255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-8fd1a30d-a55d-4a5b-ae3e-7222449d53f3
Apr 10 13:11:13 devstack sudo[84255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:11:14 devstack sudo[84253]: pam_unix(sudo:session): session closed for user root
Apr 10 13:11:14 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [req-4d649772-db55-4b33-bd73-88d68cdc69a8 req-4e9e946e-440a-4ad9-a742-0f8df49de93f tempest-ServerBootFromVolumeStableRescueTest-864025333 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-648cb04b-29b8-434b-bf1e-971d8761dc4f" returned: 0 in 0.792s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:11:14 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [req-4d649772-db55-4b33-bd73-88d68cdc69a8 req-4e9e946e-440a-4ad9-a742-0f8df49de93f tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.941s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:11:14 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [req-4d649772-db55-4b33-bd73-88d68cdc69a8 req-4e9e946e-440a-4ad9-a742-0f8df49de93f tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331', 'name': 'volume-648cb04b-29b8-434b-bf1e-971d8761dc4f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7735643a-f852-44d8-8d0e-d13dbe48d19c', 'enforce_multipath': True} {{(pid=83345) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 10 13:11:14 devstack sudo[84254]: pam_unix(sudo:session): session closed for user root
Apr 10 13:11:14 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-1270eca6-a1cc-45a1-9d88-c327d4b0bdbb tempest-VolumesAdminNegativeTest-282150995 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-cb66036a-899e-4e21-b537-9f57aec59916" returned: 0 in 1.116s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:11:14 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-1270eca6-a1cc-45a1-9d88-c327d4b0bdbb tempest-VolumesAdminNegativeTest-282150995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-cb66036a-899e-4e21-b537-9f57aec59916 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:11:14 devstack sudo[84255]: pam_unix(sudo:session): session closed for user root
Apr 10 13:11:14 devstack cinder-volume[83345]: INFO cinder.volume.manager [req-4d649772-db55-4b33-bd73-88d68cdc69a8 req-4e9e946e-440a-4ad9-a742-0f8df49de93f tempest-ServerBootFromVolumeStableRescueTest-864025333 None] attachment_update completed successfully.
Apr 10 13:11:14 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-719545b5-f9e3-4811-9abc-fd06c31cd8a9 tempest-GroupsTest-67639021 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-8fd1a30d-a55d-4a5b-ae3e-7222449d53f3" returned: 0 in 1.123s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:11:14 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-719545b5-f9e3-4811-9abc-fd06c31cd8a9 tempest-GroupsTest-67639021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-8fd1a30d-a55d-4a5b-ae3e-7222449d53f3 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:11:14 devstack sudo[84268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-cb66036a-899e-4e21-b537-9f57aec59916
Apr 10 13:11:14 devstack sudo[84268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:11:14 devstack sudo[84269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-8fd1a30d-a55d-4a5b-ae3e-7222449d53f3
Apr 10 13:11:14 devstack sudo[84269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:11:15 devstack sudo[84269]: pam_unix(sudo:session): session closed for user root
Apr 10 13:11:15 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-719545b5-f9e3-4811-9abc-fd06c31cd8a9 tempest-GroupsTest-67639021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-8fd1a30d-a55d-4a5b-ae3e-7222449d53f3" returned: 0 in 0.442s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:11:15 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-719545b5-f9e3-4811-9abc-fd06c31cd8a9 tempest-GroupsTest-67639021 None] Lock "cinder-quobyte-8fd1a30d-a55d-4a5b-ae3e-7222449d53f3" released by "delete_volume" :: held 3.435s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:11:15 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-719545b5-f9e3-4811-9abc-fd06c31cd8a9 tempest-GroupsTest-67639021 None] Created reservations ['685b7693-5b48-4462-b6ae-3eef6d9fea25'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:11:15 devstack cinder-volume[83345]: WARNING cinder.quota [None req-719545b5-f9e3-4811-9abc-fd06c31cd8a9 tempest-GroupsTest-67639021 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1199074581 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1199074581, it is now deprecated. Please use the default quota class for default quota.
Apr 10 13:11:15 devstack cinder-volume[83345]: WARNING cinder.quota [None req-719545b5-f9e3-4811-9abc-fd06c31cd8a9 tempest-GroupsTest-67639021 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1199074581 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1199074581, it is now deprecated. Please use the default quota class for default quota.
Apr 10 13:11:15 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-719545b5-f9e3-4811-9abc-fd06c31cd8a9 tempest-GroupsTest-67639021 None] Created reservations ['df713e59-9e8e-40d0-a7ae-9583b4efa860', '866a4677-b9ca-4ccf-a0c5-6e474a301c96', 'e7c9e665-838d-448c-9add-43e3c6d37cc3', '94b55cb2-98ab-4865-8b51-94089ed12f88'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:11:15 devstack sudo[84268]: pam_unix(sudo:session): session closed for user root
Apr 10 13:11:15 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-1270eca6-a1cc-45a1-9d88-c327d4b0bdbb tempest-VolumesAdminNegativeTest-282150995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-cb66036a-899e-4e21-b537-9f57aec59916" returned: 0 in 0.654s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:11:15 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-1270eca6-a1cc-45a1-9d88-c327d4b0bdbb tempest-VolumesAdminNegativeTest-282150995 None] Lock "cinder-quobyte-cb66036a-899e-4e21-b537-9f57aec59916" released by "delete_volume" :: held 2.282s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:11:15 devstack cinder-volume[83345]: WARNING cinder.quota [None req-1270eca6-a1cc-45a1-9d88-c327d4b0bdbb tempest-VolumesAdminNegativeTest-282150995 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Apr 10 13:11:15 devstack cinder-volume[83345]: WARNING cinder.quota [None req-1270eca6-a1cc-45a1-9d88-c327d4b0bdbb tempest-VolumesAdminNegativeTest-282150995 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Apr 10 13:11:15 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-1270eca6-a1cc-45a1-9d88-c327d4b0bdbb tempest-VolumesAdminNegativeTest-282150995 None] Created reservations ['d1bd2100-6b01-4427-b4d1-4ade0a0e4067', '4179535c-7c18-4968-ba29-232469c0a540', 'ec09b7b2-4487-4646-aff7-d38d6539c617', 'f594cb9d-ced9-405d-9058-a1143019bfd5'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:11:15 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-719545b5-f9e3-4811-9abc-fd06c31cd8a9 tempest-GroupsTest-67639021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:11:15 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-719545b5-f9e3-4811-9abc-fd06c31cd8a9 tempest-GroupsTest-67639021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:11:15 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-719545b5-f9e3-4811-9abc-fd06c31cd8a9 tempest-GroupsTest-67639021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:11:15 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-719545b5-f9e3-4811-9abc-fd06c31cd8a9 tempest-GroupsTest-67639021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:11:15 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-719545b5-f9e3-4811-9abc-fd06c31cd8a9 tempest-GroupsTest-67639021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:11:15 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-719545b5-f9e3-4811-9abc-fd06c31cd8a9 tempest-GroupsTest-67639021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:11:15 devstack sudo[84274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:11:15 devstack sudo[84274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:11:15 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-1270eca6-a1cc-45a1-9d88-c327d4b0bdbb tempest-VolumesAdminNegativeTest-282150995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:11:15 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-1270eca6-a1cc-45a1-9d88-c327d4b0bdbb tempest-VolumesAdminNegativeTest-282150995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:11:15 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-1270eca6-a1cc-45a1-9d88-c327d4b0bdbb tempest-VolumesAdminNegativeTest-282150995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:11:15 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-1270eca6-a1cc-45a1-9d88-c327d4b0bdbb tempest-VolumesAdminNegativeTest-282150995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:11:15 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-1270eca6-a1cc-45a1-9d88-c327d4b0bdbb tempest-VolumesAdminNegativeTest-282150995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:11:15 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-1270eca6-a1cc-45a1-9d88-c327d4b0bdbb tempest-VolumesAdminNegativeTest-282150995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:11:15 devstack sudo[84276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:11:15 devstack sudo[84276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:11:16 devstack sudo[84274]: pam_unix(sudo:session): session closed for user root
Apr 10 13:11:16 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-719545b5-f9e3-4811-9abc-fd06c31cd8a9 tempest-GroupsTest-67639021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.621s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:11:16 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-719545b5-f9e3-4811-9abc-fd06c31cd8a9 tempest-GroupsTest-67639021 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:11:16 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-719545b5-f9e3-4811-9abc-fd06c31cd8a9 tempest-GroupsTest-67639021 None] Delete group completed successfully.
Apr 10 13:11:16 devstack sudo[84276]: pam_unix(sudo:session): session closed for user root
Apr 10 13:11:16 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-1270eca6-a1cc-45a1-9d88-c327d4b0bdbb tempest-VolumesAdminNegativeTest-282150995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.631s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:11:16 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-1270eca6-a1cc-45a1-9d88-c327d4b0bdbb tempest-VolumesAdminNegativeTest-282150995 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:11:16 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-1270eca6-a1cc-45a1-9d88-c327d4b0bdbb tempest-VolumesAdminNegativeTest-282150995 None] Deleted volume successfully.
Apr 10 13:11:16 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-1270eca6-a1cc-45a1-9d88-c327d4b0bdbb tempest-VolumesAdminNegativeTest-282150995 None] Lock "cinder-cb66036a-899e-4e21-b537-9f57aec59916-delete_volume" released by "delete_volume" :: held 3.126s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:11:16 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-6a7cc53a-82d6-4b1f-b076-5f647087310b tempest-GroupsTest-67639021 None] Created reservations ['09fc145f-09c7-4903-a8e0-ce57392ceba2'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:11:16 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-6a7cc53a-82d6-4b1f-b076-5f647087310b tempest-GroupsTest-67639021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:11:16 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-6a7cc53a-82d6-4b1f-b076-5f647087310b tempest-GroupsTest-67639021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:11:16 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-6a7cc53a-82d6-4b1f-b076-5f647087310b tempest-GroupsTest-67639021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:11:16 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-6a7cc53a-82d6-4b1f-b076-5f647087310b tempest-GroupsTest-67639021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:11:16 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-6a7cc53a-82d6-4b1f-b076-5f647087310b tempest-GroupsTest-67639021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:11:16 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-6a7cc53a-82d6-4b1f-b076-5f647087310b tempest-GroupsTest-67639021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:11:16 devstack sudo[84281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:11:16 devstack sudo[84281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:11:17 devstack sudo[84281]: pam_unix(sudo:session): session closed for user root
Apr 10 13:11:17 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-6a7cc53a-82d6-4b1f-b076-5f647087310b tempest-GroupsTest-67639021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.502s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:11:17 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-6a7cc53a-82d6-4b1f-b076-5f647087310b tempest-GroupsTest-67639021 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:11:17 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-6a7cc53a-82d6-4b1f-b076-5f647087310b tempest-GroupsTest-67639021 None] Delete group completed successfully.
Apr 10 13:11:18 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-442ce1c9-620b-49bd-90d9-c15227d54ddd tempest-GroupsTest-67639021 None] Group tempest-GroupsTest-Group-1108623555: creating
Apr 10 13:11:18 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-442ce1c9-620b-49bd-90d9-c15227d54ddd tempest-GroupsTest-67639021 None] Group tempest-GroupsTest-Group-1108623555: created successfully
Apr 10 13:11:18 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-442ce1c9-620b-49bd-90d9-c15227d54ddd tempest-GroupsTest-67639021 None] Create group completed successfully.
Apr 10 13:11:19 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-f11aac0f-8093-44d9-95b0-78a7c269609a tempest-GroupsTest-67639021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:11:19 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-f11aac0f-8093-44d9-95b0-78a7c269609a tempest-GroupsTest-67639021 None] Flow 'volume_create_manager' (89602025-2104-4797-8e0d-a04a069499ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:11:19 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-f11aac0f-8093-44d9-95b0-78a7c269609a tempest-GroupsTest-67639021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ed07288-ca4c-47a9-8d47-6b03aa30d0fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:11:19 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-f11aac0f-8093-44d9-95b0-78a7c269609a tempest-GroupsTest-67639021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ed07288-ca4c-47a9-8d47-6b03aa30d0fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:11:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-366347730',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=76df3648-c266-4149-80a6-9bbe8f569cae,host='devstack@QuobyteHD#QuobyteHD',id=e6a80cac-1b4b-4a3c-8628-909a67d5d010,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3b998d7f8a445d983daf8b23cb0160a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:11:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:11:20Z,use_quota=True,user_id='a59b0946da1e4dbcbb3d94348b5b9aac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f802dbb-7808-445d-9ddf-800db863902c),volume_type_id=2f802dbb-7808-445d-9ddf-800db863902c)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:11:19 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-f11aac0f-8093-44d9-95b0-78a7c269609a tempest-GroupsTest-67639021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (496168f0-b137-4735-b870-2d8aa05006e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:11:19 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-f11aac0f-8093-44d9-95b0-78a7c269609a tempest-GroupsTest-67639021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (496168f0-b137-4735-b870-2d8aa05006e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:11:19 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-f11aac0f-8093-44d9-95b0-78a7c269609a tempest-GroupsTest-67639021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ce12c15-b6fb-4aca-ae2b-798c109cb124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:11:19 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-f11aac0f-8093-44d9-95b0-78a7c269609a tempest-GroupsTest-67639021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ce12c15-b6fb-4aca-ae2b-798c109cb124) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6a80cac-1b4b-4a3c-8628-909a67d5d010', 'volume_name': 'volume-e6a80cac-1b4b-4a3c-8628-909a67d5d010', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:11:19 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-f11aac0f-8093-44d9-95b0-78a7c269609a tempest-GroupsTest-67639021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (081bbad3-eef1-4b93-b341-414892287474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:11:19 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-f11aac0f-8093-44d9-95b0-78a7c269609a tempest-GroupsTest-67639021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (081bbad3-eef1-4b93-b341-414892287474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:11:19 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-f11aac0f-8093-44d9-95b0-78a7c269609a tempest-GroupsTest-67639021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89fec39f-c1db-45ce-a9b6-d4fd9431380f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:11:19 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-f11aac0f-8093-44d9-95b0-78a7c269609a tempest-GroupsTest-67639021 None] Volume e6a80cac-1b4b-4a3c-8628-909a67d5d010: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6a80cac-1b4b-4a3c-8628-909a67d5d010', 'volume_size': 1}
Apr 10 13:11:19 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-f11aac0f-8093-44d9-95b0-78a7c269609a tempest-GroupsTest-67639021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:11:19 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-f11aac0f-8093-44d9-95b0-78a7c269609a tempest-GroupsTest-67639021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:11:19 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-f11aac0f-8093-44d9-95b0-78a7c269609a tempest-GroupsTest-67639021 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f252bf08b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=76df3648-c266-4149-80a6-9bbe8f569cae,created_at=2026-04-10T11:11:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-366347730',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=76df3648-c266-4149-80a6-9bbe8f569cae,host='devstack@QuobyteHD#QuobyteHD',id=e6a80cac-1b4b-4a3c-8628-909a67d5d010,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3b998d7f8a445d983daf8b23cb0160a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:11:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:11:20Z,use_quota=True,user_id='a59b0946da1e4dbcbb3d94348b5b9aac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f802dbb-7808-445d-9ddf-800db863902c),volume_type_id=2f802dbb-7808-445d-9ddf-800db863902c)}" {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 13:11:19 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-f11aac0f-8093-44d9-95b0-78a7c269609a tempest-GroupsTest-67639021 None] Creating volume e6a80cac-1b4b-4a3c-8628-909a67d5d010 {{(pid=83345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 13:11:19 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-f11aac0f-8093-44d9-95b0-78a7c269609a tempest-GroupsTest-67639021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:11:19 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-f11aac0f-8093-44d9-95b0-78a7c269609a tempest-GroupsTest-67639021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:11:19 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-f11aac0f-8093-44d9-95b0-78a7c269609a tempest-GroupsTest-67639021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:11:19 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-f11aac0f-8093-44d9-95b0-78a7c269609a tempest-GroupsTest-67639021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:11:19 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-f11aac0f-8093-44d9-95b0-78a7c269609a tempest-GroupsTest-67639021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:11:19 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-f11aac0f-8093-44d9-95b0-78a7c269609a tempest-GroupsTest-67639021 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:11:19 devstack cinder-volume[83345]: INFO cinder.volume.drivers.remotefs [None req-f11aac0f-8093-44d9-95b0-78a7c269609a tempest-GroupsTest-67639021 None] casted to osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331
Apr 10 13:11:19 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-f11aac0f-8093-44d9-95b0-78a7c269609a tempest-GroupsTest-67639021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e6a80cac-1b4b-4a3c-8628-909a67d5d010 1073741824 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:11:19 devstack sudo[84406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e6a80cac-1b4b-4a3c-8628-909a67d5d010 1073741824
Apr 10 13:11:19 devstack sudo[84406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:11:20 devstack sudo[84406]: pam_unix(sudo:session): session closed for user root
Apr 10 13:11:20 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-f11aac0f-8093-44d9-95b0-78a7c269609a tempest-GroupsTest-67639021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e6a80cac-1b4b-4a3c-8628-909a67d5d010 1073741824" returned: 0 in 0.554s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:11:20 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-f11aac0f-8093-44d9-95b0-78a7c269609a tempest-GroupsTest-67639021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e6a80cac-1b4b-4a3c-8628-909a67d5d010 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:11:20 devstack sudo[84740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e6a80cac-1b4b-4a3c-8628-909a67d5d010
Apr 10 13:11:20 devstack sudo[84740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:11:20 devstack sudo[84740]: pam_unix(sudo:session): session closed for user root
Apr 10 13:11:20 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-f11aac0f-8093-44d9-95b0-78a7c269609a tempest-GroupsTest-67639021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e6a80cac-1b4b-4a3c-8628-909a67d5d010" returned: 0 in 0.580s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:11:20 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-f11aac0f-8093-44d9-95b0-78a7c269609a tempest-GroupsTest-67639021 None] <== create_volume: return (1180ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'} {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 13:11:20 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-f11aac0f-8093-44d9-95b0-78a7c269609a tempest-GroupsTest-67639021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.182s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:11:20 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-f11aac0f-8093-44d9-95b0-78a7c269609a tempest-GroupsTest-67639021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89fec39f-c1db-45ce-a9b6-d4fd9431380f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6a80cac-1b4b-4a3c-8628-909a67d5d010', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:11:20 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-f11aac0f-8093-44d9-95b0-78a7c269609a tempest-GroupsTest-67639021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98230692-62f3-4d1b-a348-eea8ed7fcc58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:11:20 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-f11aac0f-8093-44d9-95b0-78a7c269609a tempest-GroupsTest-67639021 None] Volume volume-e6a80cac-1b4b-4a3c-8628-909a67d5d010 (e6a80cac-1b4b-4a3c-8628-909a67d5d010): created successfully
Apr 10 13:11:20 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-f11aac0f-8093-44d9-95b0-78a7c269609a tempest-GroupsTest-67639021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98230692-62f3-4d1b-a348-eea8ed7fcc58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:11:20 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-f11aac0f-8093-44d9-95b0-78a7c269609a tempest-GroupsTest-67639021 None] Flow 'volume_create_manager' (89602025-2104-4797-8e0d-a04a069499ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:11:20 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-f11aac0f-8093-44d9-95b0-78a7c269609a tempest-GroupsTest-67639021 None] Created volume successfully.
Apr 10 13:11:22 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d9ff054-b267-424d-8960-78e237955e13 tempest-GroupsTest-67639021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:11:22 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-3d9ff054-b267-424d-8960-78e237955e13 tempest-GroupsTest-67639021 None] Flow 'volume_create_manager' (7e47c708-00eb-4ea0-954b-7e150b24d76d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:11:22 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-3d9ff054-b267-424d-8960-78e237955e13 tempest-GroupsTest-67639021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef9a7009-f491-4bf3-b507-708b7b34cb0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:11:22 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-3d9ff054-b267-424d-8960-78e237955e13 tempest-GroupsTest-67639021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef9a7009-f491-4bf3-b507-708b7b34cb0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:11:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1205420707',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=76df3648-c266-4149-80a6-9bbe8f569cae,host='devstack@QuobyteHD#QuobyteHD',id=f979e413-4154-447c-a90b-2e3c7c29906a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3b998d7f8a445d983daf8b23cb0160a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:11:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:11:22Z,use_quota=True,user_id='a59b0946da1e4dbcbb3d94348b5b9aac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f802dbb-7808-445d-9ddf-800db863902c),volume_type_id=2f802dbb-7808-445d-9ddf-800db863902c)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:11:22 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-3d9ff054-b267-424d-8960-78e237955e13 tempest-GroupsTest-67639021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1386b70-8291-4614-b7eb-1ce9f14641cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:11:22 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-3d9ff054-b267-424d-8960-78e237955e13 tempest-GroupsTest-67639021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1386b70-8291-4614-b7eb-1ce9f14641cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:11:22 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-3d9ff054-b267-424d-8960-78e237955e13 tempest-GroupsTest-67639021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85d2384f-185e-490c-a703-0f38fb149a0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:11:22 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-3d9ff054-b267-424d-8960-78e237955e13 tempest-GroupsTest-67639021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85d2384f-185e-490c-a703-0f38fb149a0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f979e413-4154-447c-a90b-2e3c7c29906a', 'volume_name': 'volume-f979e413-4154-447c-a90b-2e3c7c29906a', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:11:22 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-3d9ff054-b267-424d-8960-78e237955e13 tempest-GroupsTest-67639021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8e4ca73-410b-4561-a96d-4d9fc712de57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:11:22 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-3d9ff054-b267-424d-8960-78e237955e13 tempest-GroupsTest-67639021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8e4ca73-410b-4561-a96d-4d9fc712de57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:11:22 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-3d9ff054-b267-424d-8960-78e237955e13 tempest-GroupsTest-67639021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4657cd94-0ebe-42bf-9249-8770d369ff41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:11:22 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-3d9ff054-b267-424d-8960-78e237955e13 tempest-GroupsTest-67639021 None] Volume f979e413-4154-447c-a90b-2e3c7c29906a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f979e413-4154-447c-a90b-2e3c7c29906a', 'volume_size': 1}
Apr 10 13:11:22 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-3d9ff054-b267-424d-8960-78e237955e13 tempest-GroupsTest-67639021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:11:22 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-3d9ff054-b267-424d-8960-78e237955e13 tempest-GroupsTest-67639021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:11:22 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-3d9ff054-b267-424d-8960-78e237955e13 tempest-GroupsTest-67639021 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f252bf08b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=76df3648-c266-4149-80a6-9bbe8f569cae,created_at=2026-04-10T11:11:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1205420707',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=76df3648-c266-4149-80a6-9bbe8f569cae,host='devstack@QuobyteHD#QuobyteHD',id=f979e413-4154-447c-a90b-2e3c7c29906a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3b998d7f8a445d983daf8b23cb0160a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:11:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:11:22Z,use_quota=True,user_id='a59b0946da1e4dbcbb3d94348b5b9aac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f802dbb-7808-445d-9ddf-800db863902c),volume_type_id=2f802dbb-7808-445d-9ddf-800db863902c)}" {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 13:11:22 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-3d9ff054-b267-424d-8960-78e237955e13 tempest-GroupsTest-67639021 None] Creating volume f979e413-4154-447c-a90b-2e3c7c29906a {{(pid=83345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 13:11:22 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-3d9ff054-b267-424d-8960-78e237955e13 tempest-GroupsTest-67639021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:11:22 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-3d9ff054-b267-424d-8960-78e237955e13 tempest-GroupsTest-67639021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:11:22 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-3d9ff054-b267-424d-8960-78e237955e13 tempest-GroupsTest-67639021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:11:22 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-3d9ff054-b267-424d-8960-78e237955e13 tempest-GroupsTest-67639021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:11:22 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-3d9ff054-b267-424d-8960-78e237955e13 tempest-GroupsTest-67639021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:11:22 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-3d9ff054-b267-424d-8960-78e237955e13 tempest-GroupsTest-67639021 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:11:22 devstack cinder-volume[83345]: INFO cinder.volume.drivers.remotefs [None req-3d9ff054-b267-424d-8960-78e237955e13 tempest-GroupsTest-67639021 None] casted to osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331
Apr 10 13:11:22 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-3d9ff054-b267-424d-8960-78e237955e13 tempest-GroupsTest-67639021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-f979e413-4154-447c-a90b-2e3c7c29906a 1073741824 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:11:22 devstack sudo[84758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-f979e413-4154-447c-a90b-2e3c7c29906a 1073741824
Apr 10 13:11:22 devstack sudo[84758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:11:22 devstack sudo[84758]: pam_unix(sudo:session): session closed for user root
Apr 10 13:11:22 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-3d9ff054-b267-424d-8960-78e237955e13 tempest-GroupsTest-67639021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-f979e413-4154-447c-a90b-2e3c7c29906a 1073741824" returned: 0 in 0.523s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:11:22 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-3d9ff054-b267-424d-8960-78e237955e13 tempest-GroupsTest-67639021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-f979e413-4154-447c-a90b-2e3c7c29906a {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:11:22 devstack sudo[84763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-f979e413-4154-447c-a90b-2e3c7c29906a
Apr 10 13:11:22 devstack sudo[84763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:11:23 devstack sudo[84763]: pam_unix(sudo:session): session closed for user root
Apr 10 13:11:23 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-3d9ff054-b267-424d-8960-78e237955e13 tempest-GroupsTest-67639021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-f979e413-4154-447c-a90b-2e3c7c29906a" returned: 0 in 0.437s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:11:23 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-3d9ff054-b267-424d-8960-78e237955e13 tempest-GroupsTest-67639021 None] <== create_volume: return (1009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'} {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 13:11:23 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-3d9ff054-b267-424d-8960-78e237955e13 tempest-GroupsTest-67639021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.020s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:11:23 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-3d9ff054-b267-424d-8960-78e237955e13 tempest-GroupsTest-67639021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4657cd94-0ebe-42bf-9249-8770d369ff41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f979e413-4154-447c-a90b-2e3c7c29906a', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:11:23 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-3d9ff054-b267-424d-8960-78e237955e13 tempest-GroupsTest-67639021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff339b3f-b960-403e-8a82-0127fe51b5a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:11:23 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-3d9ff054-b267-424d-8960-78e237955e13 tempest-GroupsTest-67639021 None] Volume volume-f979e413-4154-447c-a90b-2e3c7c29906a (f979e413-4154-447c-a90b-2e3c7c29906a): created successfully
Apr 10 13:11:23 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-3d9ff054-b267-424d-8960-78e237955e13 tempest-GroupsTest-67639021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff339b3f-b960-403e-8a82-0127fe51b5a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:11:23 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-3d9ff054-b267-424d-8960-78e237955e13 tempest-GroupsTest-67639021 None] Flow 'volume_create_manager' (7e47c708-00eb-4ea0-954b-7e150b24d76d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:11:23 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-3d9ff054-b267-424d-8960-78e237955e13 tempest-GroupsTest-67639021 None] Created volume successfully.
Apr 10 13:11:24 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-1cbadada-ec5a-4536-a6d1-05899a89add6 tempest-GroupsTest-67639021 None] Update group completed successfully.
Apr 10 13:11:25 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-971394ad-c7e6-46ea-b543-a7625b6b1485 tempest-GroupsTest-67639021 None] Update group completed successfully.
Apr 10 13:11:26 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-3bd18449-7cea-40e5-b1b9-fa04bb6ca1d0 tempest-GroupsTest-67639021 None] Acquiring lock "cinder-quobyte-e6a80cac-1b4b-4a3c-8628-909a67d5d010" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:11:27 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-3bd18449-7cea-40e5-b1b9-fa04bb6ca1d0 tempest-GroupsTest-67639021 None] Lock "cinder-quobyte-e6a80cac-1b4b-4a3c-8628-909a67d5d010" acquired by "delete_volume" :: waited 0.013s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:11:27 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[39fc561e-25fa-4600-82c4-62b4611a1693]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:11:27 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-3bd18449-7cea-40e5-b1b9-fa04bb6ca1d0 tempest-GroupsTest-67639021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e6a80cac-1b4b-4a3c-8628-909a67d5d010 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:11:27 devstack sudo[84830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e6a80cac-1b4b-4a3c-8628-909a67d5d010
Apr 10 13:11:27 devstack sudo[84830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:11:27 devstack sudo[84830]: pam_unix(sudo:session): session closed for user root
Apr 10 13:11:27 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-3bd18449-7cea-40e5-b1b9-fa04bb6ca1d0 tempest-GroupsTest-67639021 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e6a80cac-1b4b-4a3c-8628-909a67d5d010" returned: 0 in 0.849s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:11:27 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-3bd18449-7cea-40e5-b1b9-fa04bb6ca1d0 tempest-GroupsTest-67639021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e6a80cac-1b4b-4a3c-8628-909a67d5d010 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:11:27 devstack sudo[84835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e6a80cac-1b4b-4a3c-8628-909a67d5d010
Apr 10 13:11:27 devstack sudo[84835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:11:28 devstack sudo[84835]: pam_unix(sudo:session): session closed for user root
Apr 10 13:11:28 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-3bd18449-7cea-40e5-b1b9-fa04bb6ca1d0 tempest-GroupsTest-67639021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e6a80cac-1b4b-4a3c-8628-909a67d5d010" returned: 0 in 0.858s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:11:28 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-3bd18449-7cea-40e5-b1b9-fa04bb6ca1d0 tempest-GroupsTest-67639021 None] Lock "cinder-quobyte-e6a80cac-1b4b-4a3c-8628-909a67d5d010" released by "delete_volume" :: held 1.796s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:11:28 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-3bd18449-7cea-40e5-b1b9-fa04bb6ca1d0 tempest-GroupsTest-67639021 None] Acquiring lock "cinder-quobyte-f979e413-4154-447c-a90b-2e3c7c29906a" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:11:28 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-3bd18449-7cea-40e5-b1b9-fa04bb6ca1d0 tempest-GroupsTest-67639021 None] Lock "cinder-quobyte-f979e413-4154-447c-a90b-2e3c7c29906a" acquired by "delete_volume" :: waited 0.019s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:11:28 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[5031a565-441e-43b1-a969-1182db8449a3]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:11:28 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-3bd18449-7cea-40e5-b1b9-fa04bb6ca1d0 tempest-GroupsTest-67639021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-f979e413-4154-447c-a90b-2e3c7c29906a {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:11:28 devstack sudo[84869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-f979e413-4154-447c-a90b-2e3c7c29906a
Apr 10 13:11:28 devstack sudo[84869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:11:29 devstack sudo[84869]: pam_unix(sudo:session): session closed for user root
Apr 10 13:11:29 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-3bd18449-7cea-40e5-b1b9-fa04bb6ca1d0 tempest-GroupsTest-67639021 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-f979e413-4154-447c-a90b-2e3c7c29906a" returned: 0 in 0.728s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:11:29 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-3bd18449-7cea-40e5-b1b9-fa04bb6ca1d0 tempest-GroupsTest-67639021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-f979e413-4154-447c-a90b-2e3c7c29906a {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:11:29 devstack sudo[84877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-f979e413-4154-447c-a90b-2e3c7c29906a
Apr 10 13:11:29 devstack sudo[84877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:11:30 devstack sudo[84877]: pam_unix(sudo:session): session closed for user root
Apr 10 13:11:30 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-3bd18449-7cea-40e5-b1b9-fa04bb6ca1d0 tempest-GroupsTest-67639021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-f979e413-4154-447c-a90b-2e3c7c29906a" returned: 0 in 0.632s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:11:30 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-3bd18449-7cea-40e5-b1b9-fa04bb6ca1d0 tempest-GroupsTest-67639021 None] Lock "cinder-quobyte-f979e413-4154-447c-a90b-2e3c7c29906a" released by "delete_volume" :: held 1.399s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:11:30 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-3bd18449-7cea-40e5-b1b9-fa04bb6ca1d0 tempest-GroupsTest-67639021 None] Created reservations ['6bbcdff0-4891-4583-90e7-800db35d0342'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:11:30 devstack cinder-volume[83345]: WARNING cinder.quota [None req-3bd18449-7cea-40e5-b1b9-fa04bb6ca1d0 tempest-GroupsTest-67639021 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1395049382 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1395049382, it is now deprecated. Please use the default quota class for default quota.
Apr 10 13:11:30 devstack cinder-volume[83345]: WARNING cinder.quota [None req-3bd18449-7cea-40e5-b1b9-fa04bb6ca1d0 tempest-GroupsTest-67639021 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1395049382 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1395049382, it is now deprecated. Please use the default quota class for default quota.
Apr 10 13:11:30 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-3bd18449-7cea-40e5-b1b9-fa04bb6ca1d0 tempest-GroupsTest-67639021 None] Created reservations ['bed5aa06-1948-4bca-a71b-dcf24f3b50ef', 'c516102a-f2c6-4b4d-8c8e-6fac424f9c84', '248e907f-02b6-4c59-8a34-8b6208cb6793', 'fa103e64-c467-4b5d-93b8-759ab20e6aab'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:11:30 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-3bd18449-7cea-40e5-b1b9-fa04bb6ca1d0 tempest-GroupsTest-67639021 None] Created reservations ['383af125-3f41-482f-b60b-7daf22e24ec2', 'e8965847-d896-4de7-a3be-643440213f0c', 'b6f61712-7b79-4806-91d2-085448986861', '10e439c2-92d2-47a1-88d3-4888212e627e'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:11:30 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-3bd18449-7cea-40e5-b1b9-fa04bb6ca1d0 tempest-GroupsTest-67639021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:11:30 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-3bd18449-7cea-40e5-b1b9-fa04bb6ca1d0 tempest-GroupsTest-67639021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:11:30 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-3bd18449-7cea-40e5-b1b9-fa04bb6ca1d0 tempest-GroupsTest-67639021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:11:30 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-3bd18449-7cea-40e5-b1b9-fa04bb6ca1d0 tempest-GroupsTest-67639021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:11:30 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-3bd18449-7cea-40e5-b1b9-fa04bb6ca1d0 tempest-GroupsTest-67639021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:11:30 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-3bd18449-7cea-40e5-b1b9-fa04bb6ca1d0 tempest-GroupsTest-67639021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:11:30 devstack sudo[84888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:11:30 devstack sudo[84888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:11:31 devstack sudo[84888]: pam_unix(sudo:session): session closed for user root
Apr 10 13:11:31 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-3bd18449-7cea-40e5-b1b9-fa04bb6ca1d0 tempest-GroupsTest-67639021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.548s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:11:31 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-3bd18449-7cea-40e5-b1b9-fa04bb6ca1d0 tempest-GroupsTest-67639021 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:11:31 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-3bd18449-7cea-40e5-b1b9-fa04bb6ca1d0 tempest-GroupsTest-67639021 None] Delete group completed successfully.
Apr 10 13:11:37 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b05fb31-2fcf-4e46-b5a5-831d5597c046 tempest-VolumeRetypeWithoutMigrationTest-20033726 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:11:37 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-3b05fb31-2fcf-4e46-b5a5-831d5597c046 tempest-VolumeRetypeWithoutMigrationTest-20033726 None] Flow 'volume_create_manager' (6ab6788d-c197-4992-b495-77cabe0c50eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:11:37 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-3b05fb31-2fcf-4e46-b5a5-831d5597c046 tempest-VolumeRetypeWithoutMigrationTest-20033726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab052af8-18bb-47bd-bd56-c5aedd0a0001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:11:37 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-3b05fb31-2fcf-4e46-b5a5-831d5597c046 tempest-VolumeRetypeWithoutMigrationTest-20033726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab052af8-18bb-47bd-bd56-c5aedd0a0001) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:11:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1385630805',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba14826a-f3fe-4bcc-a459-845379ee4cac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ecc2d1dda154bb68346ceb158436c44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:11:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:11:38Z,use_quota=True,user_id='68e4a8cd9aae44a8939c0629febd4a4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3d6497fc-cbbd-430c-9a29-ceea8555dc3a),volume_type_id=3d6497fc-cbbd-430c-9a29-ceea8555dc3a)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:11:37 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-3b05fb31-2fcf-4e46-b5a5-831d5597c046 tempest-VolumeRetypeWithoutMigrationTest-20033726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07c73dac-1ee6-4e88-b47d-d4bc709b8f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:11:37 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-3b05fb31-2fcf-4e46-b5a5-831d5597c046 tempest-VolumeRetypeWithoutMigrationTest-20033726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07c73dac-1ee6-4e88-b47d-d4bc709b8f43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:11:37 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-3b05fb31-2fcf-4e46-b5a5-831d5597c046 tempest-VolumeRetypeWithoutMigrationTest-20033726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cb68468-d6a7-44eb-ac9f-d90fcf711b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:11:37 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-3b05fb31-2fcf-4e46-b5a5-831d5597c046 tempest-VolumeRetypeWithoutMigrationTest-20033726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cb68468-d6a7-44eb-ac9f-d90fcf711b6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba14826a-f3fe-4bcc-a459-845379ee4cac', 'volume_name': 'volume-ba14826a-f3fe-4bcc-a459-845379ee4cac', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:11:38 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-3b05fb31-2fcf-4e46-b5a5-831d5597c046 tempest-VolumeRetypeWithoutMigrationTest-20033726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4be9fc90-af6f-452b-9f9b-3c09daae5211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:11:38 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-3b05fb31-2fcf-4e46-b5a5-831d5597c046 tempest-VolumeRetypeWithoutMigrationTest-20033726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4be9fc90-af6f-452b-9f9b-3c09daae5211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:11:38 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-3b05fb31-2fcf-4e46-b5a5-831d5597c046 tempest-VolumeRetypeWithoutMigrationTest-20033726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e67dd699-1196-490c-977f-97ddc38a7d2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:11:38 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-3b05fb31-2fcf-4e46-b5a5-831d5597c046 tempest-VolumeRetypeWithoutMigrationTest-20033726 None] Volume ba14826a-f3fe-4bcc-a459-845379ee4cac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba14826a-f3fe-4bcc-a459-845379ee4cac', 'volume_size': 1}
Apr 10 13:11:38 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-3b05fb31-2fcf-4e46-b5a5-831d5597c046 tempest-VolumeRetypeWithoutMigrationTest-20033726 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:11:38 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-3b05fb31-2fcf-4e46-b5a5-831d5597c046 tempest-VolumeRetypeWithoutMigrationTest-20033726 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:11:38 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-3b05fb31-2fcf-4e46-b5a5-831d5597c046 tempest-VolumeRetypeWithoutMigrationTest-20033726 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f252bf08b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:11:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1385630805',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba14826a-f3fe-4bcc-a459-845379ee4cac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ecc2d1dda154bb68346ceb158436c44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:11:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:11:38Z,use_quota=True,user_id='68e4a8cd9aae44a8939c0629febd4a4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3d6497fc-cbbd-430c-9a29-ceea8555dc3a),volume_type_id=3d6497fc-cbbd-430c-9a29-ceea8555dc3a)}" {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 13:11:38 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-3b05fb31-2fcf-4e46-b5a5-831d5597c046 tempest-VolumeRetypeWithoutMigrationTest-20033726 None] Creating volume ba14826a-f3fe-4bcc-a459-845379ee4cac {{(pid=83345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 13:11:38 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-3b05fb31-2fcf-4e46-b5a5-831d5597c046 tempest-VolumeRetypeWithoutMigrationTest-20033726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:11:38 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-3b05fb31-2fcf-4e46-b5a5-831d5597c046 tempest-VolumeRetypeWithoutMigrationTest-20033726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:11:38 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-3b05fb31-2fcf-4e46-b5a5-831d5597c046 tempest-VolumeRetypeWithoutMigrationTest-20033726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:11:38 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-3b05fb31-2fcf-4e46-b5a5-831d5597c046 tempest-VolumeRetypeWithoutMigrationTest-20033726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:11:38 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-3b05fb31-2fcf-4e46-b5a5-831d5597c046 tempest-VolumeRetypeWithoutMigrationTest-20033726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:11:38 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-3b05fb31-2fcf-4e46-b5a5-831d5597c046 tempest-VolumeRetypeWithoutMigrationTest-20033726 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:11:38 devstack cinder-volume[83345]: INFO cinder.volume.drivers.remotefs [None req-3b05fb31-2fcf-4e46-b5a5-831d5597c046 tempest-VolumeRetypeWithoutMigrationTest-20033726 None] casted to osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331
Apr 10 13:11:38 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-3b05fb31-2fcf-4e46-b5a5-831d5597c046 tempest-VolumeRetypeWithoutMigrationTest-20033726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-ba14826a-f3fe-4bcc-a459-845379ee4cac 1073741824 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:11:38 devstack sudo[84978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-ba14826a-f3fe-4bcc-a459-845379ee4cac 1073741824
Apr 10 13:11:38 devstack sudo[84978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:11:38 devstack sudo[84978]: pam_unix(sudo:session): session closed for user root
Apr 10 13:11:38 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-3b05fb31-2fcf-4e46-b5a5-831d5597c046 tempest-VolumeRetypeWithoutMigrationTest-20033726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-ba14826a-f3fe-4bcc-a459-845379ee4cac 1073741824" returned: 0 in 0.910s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:11:38 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-3b05fb31-2fcf-4e46-b5a5-831d5597c046 tempest-VolumeRetypeWithoutMigrationTest-20033726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-ba14826a-f3fe-4bcc-a459-845379ee4cac {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:11:39 devstack sudo[84985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-ba14826a-f3fe-4bcc-a459-845379ee4cac
Apr 10 13:11:39 devstack sudo[84985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:11:39 devstack sudo[84985]: pam_unix(sudo:session): session closed for user root
Apr 10 13:11:39 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-3b05fb31-2fcf-4e46-b5a5-831d5597c046 tempest-VolumeRetypeWithoutMigrationTest-20033726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-ba14826a-f3fe-4bcc-a459-845379ee4cac" returned: 0 in 0.991s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:11:39 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-3b05fb31-2fcf-4e46-b5a5-831d5597c046 tempest-VolumeRetypeWithoutMigrationTest-20033726 None] <== create_volume: return (1950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'} {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 13:11:39 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-3b05fb31-2fcf-4e46-b5a5-831d5597c046 tempest-VolumeRetypeWithoutMigrationTest-20033726 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.954s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:11:39 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-3b05fb31-2fcf-4e46-b5a5-831d5597c046 tempest-VolumeRetypeWithoutMigrationTest-20033726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e67dd699-1196-490c-977f-97ddc38a7d2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba14826a-f3fe-4bcc-a459-845379ee4cac', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:11:39 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-3b05fb31-2fcf-4e46-b5a5-831d5597c046 tempest-VolumeRetypeWithoutMigrationTest-20033726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffcf8cd8-2f26-4fa3-99d5-2b2aee30379a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:11:40 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-3b05fb31-2fcf-4e46-b5a5-831d5597c046 tempest-VolumeRetypeWithoutMigrationTest-20033726 None] Volume volume-ba14826a-f3fe-4bcc-a459-845379ee4cac (ba14826a-f3fe-4bcc-a459-845379ee4cac): created successfully
Apr 10 13:11:40 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-3b05fb31-2fcf-4e46-b5a5-831d5597c046 tempest-VolumeRetypeWithoutMigrationTest-20033726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffcf8cd8-2f26-4fa3-99d5-2b2aee30379a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:11:40 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-3b05fb31-2fcf-4e46-b5a5-831d5597c046 tempest-VolumeRetypeWithoutMigrationTest-20033726 None] Flow 'volume_create_manager' (6ab6788d-c197-4992-b495-77cabe0c50eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:11:40 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-3b05fb31-2fcf-4e46-b5a5-831d5597c046 tempest-VolumeRetypeWithoutMigrationTest-20033726 None] Created volume successfully.
Apr 10 13:11:41 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-f66df8f4-e117-415e-a668-b174d1089854 tempest-VolumeRetypeWithoutMigrationTest-20033726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:11:41 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-f66df8f4-e117-415e-a668-b174d1089854 tempest-VolumeRetypeWithoutMigrationTest-20033726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:11:41 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-f66df8f4-e117-415e-a668-b174d1089854 tempest-VolumeRetypeWithoutMigrationTest-20033726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:11:41 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-f66df8f4-e117-415e-a668-b174d1089854 tempest-VolumeRetypeWithoutMigrationTest-20033726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:11:41 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-f66df8f4-e117-415e-a668-b174d1089854 tempest-VolumeRetypeWithoutMigrationTest-20033726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:11:41 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-f66df8f4-e117-415e-a668-b174d1089854 tempest-VolumeRetypeWithoutMigrationTest-20033726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:11:41 devstack sudo[85045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:11:41 devstack sudo[85045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:11:42 devstack sudo[85045]: pam_unix(sudo:session): session closed for user root
Apr 10 13:11:42 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-f66df8f4-e117-415e-a668-b174d1089854 tempest-VolumeRetypeWithoutMigrationTest-20033726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.783s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:11:42 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-f66df8f4-e117-415e-a668-b174d1089854 tempest-VolumeRetypeWithoutMigrationTest-20033726 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:11:42 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-f66df8f4-e117-415e-a668-b174d1089854 tempest-VolumeRetypeWithoutMigrationTest-20033726 None] Retype volume completed successfully.
Apr 10 13:11:43 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-6887fba3-778d-47aa-9927-2191204e4ba7 tempest-VolumeRetypeWithoutMigrationTest-20033726 None] Acquiring lock "cinder-ba14826a-f3fe-4bcc-a459-845379ee4cac-delete_volume" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:11:43 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-6887fba3-778d-47aa-9927-2191204e4ba7 tempest-VolumeRetypeWithoutMigrationTest-20033726 None] Lock "cinder-ba14826a-f3fe-4bcc-a459-845379ee4cac-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:11:43 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-6887fba3-778d-47aa-9927-2191204e4ba7 tempest-VolumeRetypeWithoutMigrationTest-20033726 None] Acquiring lock "cinder-quobyte-ba14826a-f3fe-4bcc-a459-845379ee4cac" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:11:43 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-6887fba3-778d-47aa-9927-2191204e4ba7 tempest-VolumeRetypeWithoutMigrationTest-20033726 None] Lock "cinder-quobyte-ba14826a-f3fe-4bcc-a459-845379ee4cac" acquired by "delete_volume" :: waited 0.054s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:11:43 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c18574c-cf60-4309-ac94-7d90f35954c2]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:11:43 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-6887fba3-778d-47aa-9927-2191204e4ba7 tempest-VolumeRetypeWithoutMigrationTest-20033726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-ba14826a-f3fe-4bcc-a459-845379ee4cac {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:11:43 devstack sudo[85076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-ba14826a-f3fe-4bcc-a459-845379ee4cac
Apr 10 13:11:43 devstack sudo[85076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:11:44 devstack sudo[85076]: pam_unix(sudo:session): session closed for user root
Apr 10 13:11:44 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-6887fba3-778d-47aa-9927-2191204e4ba7 tempest-VolumeRetypeWithoutMigrationTest-20033726 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-ba14826a-f3fe-4bcc-a459-845379ee4cac" returned: 0 in 0.943s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:11:44 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-6887fba3-778d-47aa-9927-2191204e4ba7 tempest-VolumeRetypeWithoutMigrationTest-20033726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-ba14826a-f3fe-4bcc-a459-845379ee4cac {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:11:44 devstack sudo[85086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-ba14826a-f3fe-4bcc-a459-845379ee4cac
Apr 10 13:11:44 devstack sudo[85086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:11:45 devstack sudo[85086]: pam_unix(sudo:session): session closed for user root
Apr 10 13:11:45 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-6887fba3-778d-47aa-9927-2191204e4ba7 tempest-VolumeRetypeWithoutMigrationTest-20033726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-ba14826a-f3fe-4bcc-a459-845379ee4cac" returned: 0 in 0.758s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:11:45 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-6887fba3-778d-47aa-9927-2191204e4ba7 tempest-VolumeRetypeWithoutMigrationTest-20033726 None] Lock "cinder-quobyte-ba14826a-f3fe-4bcc-a459-845379ee4cac" released by "delete_volume" :: held 1.782s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:11:45 devstack cinder-volume[83345]: WARNING cinder.quota [None req-6887fba3-778d-47aa-9927-2191204e4ba7 tempest-VolumeRetypeWithoutMigrationTest-20033726 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Apr 10 13:11:45 devstack cinder-volume[83345]: WARNING cinder.quota [None req-6887fba3-778d-47aa-9927-2191204e4ba7 tempest-VolumeRetypeWithoutMigrationTest-20033726 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Apr 10 13:11:45 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-6887fba3-778d-47aa-9927-2191204e4ba7 tempest-VolumeRetypeWithoutMigrationTest-20033726 None] Created reservations ['e326a80a-ca9f-420c-8615-4e09448a8c51', '89e35d94-e362-4b05-84d3-0d00a901bc25', 'd898797c-4fe3-42ff-a7db-ea0445bff7d4', 'cccce776-d07e-4a4a-9a35-6e2952922255'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:11:45 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-6887fba3-778d-47aa-9927-2191204e4ba7 tempest-VolumeRetypeWithoutMigrationTest-20033726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:11:45 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-6887fba3-778d-47aa-9927-2191204e4ba7 tempest-VolumeRetypeWithoutMigrationTest-20033726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:11:45 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-6887fba3-778d-47aa-9927-2191204e4ba7 tempest-VolumeRetypeWithoutMigrationTest-20033726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:11:45 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-6887fba3-778d-47aa-9927-2191204e4ba7 tempest-VolumeRetypeWithoutMigrationTest-20033726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:11:45 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-6887fba3-778d-47aa-9927-2191204e4ba7 tempest-VolumeRetypeWithoutMigrationTest-20033726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:11:45 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-6887fba3-778d-47aa-9927-2191204e4ba7 tempest-VolumeRetypeWithoutMigrationTest-20033726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:11:45 devstack sudo[85109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:11:45 devstack sudo[85109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:11:46 devstack sudo[85109]: pam_unix(sudo:session): session closed for user root
Apr 10 13:11:46 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-6887fba3-778d-47aa-9927-2191204e4ba7 tempest-VolumeRetypeWithoutMigrationTest-20033726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 1.174s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:11:46 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-6887fba3-778d-47aa-9927-2191204e4ba7 tempest-VolumeRetypeWithoutMigrationTest-20033726 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:11:46 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-6887fba3-778d-47aa-9927-2191204e4ba7 tempest-VolumeRetypeWithoutMigrationTest-20033726 None] Deleted volume successfully.
Apr 10 13:11:46 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-6887fba3-778d-47aa-9927-2191204e4ba7 tempest-VolumeRetypeWithoutMigrationTest-20033726 None] Lock "cinder-ba14826a-f3fe-4bcc-a459-845379ee4cac-delete_volume" released by "delete_volume" :: held 3.212s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:11:53 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-915c01bd-97d0-40d0-a8e4-5076b0959d63 tempest-ServersNegativeTestJSON-1265470882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:11:53 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-915c01bd-97d0-40d0-a8e4-5076b0959d63 tempest-ServersNegativeTestJSON-1265470882 None] Flow 'volume_create_manager' (30479a63-29ab-400f-891c-ff3f5b6d3568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:11:53 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-915c01bd-97d0-40d0-a8e4-5076b0959d63 tempest-ServersNegativeTestJSON-1265470882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (607804ba-6629-45fd-8a49-8dfca6816dfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:11:53 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-915c01bd-97d0-40d0-a8e4-5076b0959d63 tempest-ServersNegativeTestJSON-1265470882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (607804ba-6629-45fd-8a49-8dfca6816dfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:11:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1592599500',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e76d7bd-b54b-4d41-8d15-21df35e34c6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5f0d036ce4449c594b94e898b9a5d71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:11:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:11:53Z,use_quota=True,user_id='f911217e9ec54028928b48a33616dc17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:11:53 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-915c01bd-97d0-40d0-a8e4-5076b0959d63 tempest-ServersNegativeTestJSON-1265470882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91ec9e6a-b350-4cf6-94ba-d6bd57b61cd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:11:53 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-915c01bd-97d0-40d0-a8e4-5076b0959d63 tempest-ServersNegativeTestJSON-1265470882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91ec9e6a-b350-4cf6-94ba-d6bd57b61cd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:11:53 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-915c01bd-97d0-40d0-a8e4-5076b0959d63 tempest-ServersNegativeTestJSON-1265470882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cac1ccd-529b-48c5-8031-66080885ae17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:11:53 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-915c01bd-97d0-40d0-a8e4-5076b0959d63 tempest-ServersNegativeTestJSON-1265470882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cac1ccd-529b-48c5-8031-66080885ae17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e76d7bd-b54b-4d41-8d15-21df35e34c6e', 'volume_name': 'volume-1e76d7bd-b54b-4d41-8d15-21df35e34c6e', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:11:53 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-915c01bd-97d0-40d0-a8e4-5076b0959d63 tempest-ServersNegativeTestJSON-1265470882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c230f15c-0c39-4d53-9567-2b20fa0d90d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:11:53 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-915c01bd-97d0-40d0-a8e4-5076b0959d63 tempest-ServersNegativeTestJSON-1265470882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c230f15c-0c39-4d53-9567-2b20fa0d90d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:11:53 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-915c01bd-97d0-40d0-a8e4-5076b0959d63 tempest-ServersNegativeTestJSON-1265470882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c156de90-99a0-47bd-ad3c-2f466891a2b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:11:53 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-915c01bd-97d0-40d0-a8e4-5076b0959d63 tempest-ServersNegativeTestJSON-1265470882 None] Volume 1e76d7bd-b54b-4d41-8d15-21df35e34c6e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e76d7bd-b54b-4d41-8d15-21df35e34c6e', 'volume_size': 1}
Apr 10 13:11:53 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-915c01bd-97d0-40d0-a8e4-5076b0959d63 tempest-ServersNegativeTestJSON-1265470882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:11:53 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-915c01bd-97d0-40d0-a8e4-5076b0959d63 tempest-ServersNegativeTestJSON-1265470882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:11:53 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-915c01bd-97d0-40d0-a8e4-5076b0959d63 tempest-ServersNegativeTestJSON-1265470882 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f252bf08b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:11:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1592599500',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e76d7bd-b54b-4d41-8d15-21df35e34c6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5f0d036ce4449c594b94e898b9a5d71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:11:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:11:53Z,use_quota=True,user_id='f911217e9ec54028928b48a33616dc17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)}" {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 13:11:53 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-915c01bd-97d0-40d0-a8e4-5076b0959d63 tempest-ServersNegativeTestJSON-1265470882 None] Creating volume 1e76d7bd-b54b-4d41-8d15-21df35e34c6e {{(pid=83345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 13:11:53 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-915c01bd-97d0-40d0-a8e4-5076b0959d63 tempest-ServersNegativeTestJSON-1265470882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:11:53 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-915c01bd-97d0-40d0-a8e4-5076b0959d63 tempest-ServersNegativeTestJSON-1265470882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:11:53 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-915c01bd-97d0-40d0-a8e4-5076b0959d63 tempest-ServersNegativeTestJSON-1265470882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:11:53 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-915c01bd-97d0-40d0-a8e4-5076b0959d63 tempest-ServersNegativeTestJSON-1265470882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:11:53 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-915c01bd-97d0-40d0-a8e4-5076b0959d63 tempest-ServersNegativeTestJSON-1265470882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:11:53 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-915c01bd-97d0-40d0-a8e4-5076b0959d63 tempest-ServersNegativeTestJSON-1265470882 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:11:53 devstack cinder-volume[83345]: INFO cinder.volume.drivers.remotefs [None req-915c01bd-97d0-40d0-a8e4-5076b0959d63 tempest-ServersNegativeTestJSON-1265470882 None] casted to osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331
Apr 10 13:11:53 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-915c01bd-97d0-40d0-a8e4-5076b0959d63 tempest-ServersNegativeTestJSON-1265470882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-1e76d7bd-b54b-4d41-8d15-21df35e34c6e 1073741824 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:11:53 devstack sudo[85160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-1e76d7bd-b54b-4d41-8d15-21df35e34c6e 1073741824
Apr 10 13:11:53 devstack sudo[85160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:11:53 devstack cinder-volume[83345]: DEBUG oslo_service.periodic_task [None req-c3f44832-ad7f-424b-a850-32c7352a19c5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83345) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 10 13:11:53 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-c3f44832-ad7f-424b-a850-32c7352a19c5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:11:53 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-c3f44832-ad7f-424b-a850-32c7352a19c5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:11:53 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-c3f44832-ad7f-424b-a850-32c7352a19c5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:11:53 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-c3f44832-ad7f-424b-a850-32c7352a19c5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:11:53 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-c3f44832-ad7f-424b-a850-32c7352a19c5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:11:53 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-c3f44832-ad7f-424b-a850-32c7352a19c5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:11:53 devstack sudo[85162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:11:53 devstack sudo[85162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:11:54 devstack sudo[85162]: pam_unix(sudo:session): session closed for user root
Apr 10 13:11:54 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-c3f44832-ad7f-424b-a850-32c7352a19c5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.607s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:11:54 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-c3f44832-ad7f-424b-a850-32c7352a19c5 None None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:11:54 devstack sudo[85160]: pam_unix(sudo:session): session closed for user root
Apr 10 13:11:54 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-915c01bd-97d0-40d0-a8e4-5076b0959d63 tempest-ServersNegativeTestJSON-1265470882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-1e76d7bd-b54b-4d41-8d15-21df35e34c6e 1073741824" returned: 0 in 0.833s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:11:54 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-915c01bd-97d0-40d0-a8e4-5076b0959d63 tempest-ServersNegativeTestJSON-1265470882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-1e76d7bd-b54b-4d41-8d15-21df35e34c6e {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:11:54 devstack sudo[85168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-1e76d7bd-b54b-4d41-8d15-21df35e34c6e
Apr 10 13:11:54 devstack sudo[85168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:11:54 devstack sudo[85168]: pam_unix(sudo:session): session closed for user root
Apr 10 13:11:54 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-915c01bd-97d0-40d0-a8e4-5076b0959d63 tempest-ServersNegativeTestJSON-1265470882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-1e76d7bd-b54b-4d41-8d15-21df35e34c6e" returned: 0 in 0.473s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:11:54 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-915c01bd-97d0-40d0-a8e4-5076b0959d63 tempest-ServersNegativeTestJSON-1265470882 None] <== create_volume: return (1356ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'} {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 13:11:54 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-915c01bd-97d0-40d0-a8e4-5076b0959d63 tempest-ServersNegativeTestJSON-1265470882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.359s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:11:54 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-915c01bd-97d0-40d0-a8e4-5076b0959d63 tempest-ServersNegativeTestJSON-1265470882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c156de90-99a0-47bd-ad3c-2f466891a2b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e76d7bd-b54b-4d41-8d15-21df35e34c6e', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:11:54 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-915c01bd-97d0-40d0-a8e4-5076b0959d63 tempest-ServersNegativeTestJSON-1265470882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13e0d394-e4cb-4c14-ab07-bed48b606398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:11:54 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-915c01bd-97d0-40d0-a8e4-5076b0959d63 tempest-ServersNegativeTestJSON-1265470882 None] Volume volume-1e76d7bd-b54b-4d41-8d15-21df35e34c6e (1e76d7bd-b54b-4d41-8d15-21df35e34c6e): created successfully
Apr 10 13:11:54 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-915c01bd-97d0-40d0-a8e4-5076b0959d63 tempest-ServersNegativeTestJSON-1265470882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13e0d394-e4cb-4c14-ab07-bed48b606398) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:11:54 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-915c01bd-97d0-40d0-a8e4-5076b0959d63 tempest-ServersNegativeTestJSON-1265470882 None] Flow 'volume_create_manager' (30479a63-29ab-400f-891c-ff3f5b6d3568) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:11:54 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-915c01bd-97d0-40d0-a8e4-5076b0959d63 tempest-ServersNegativeTestJSON-1265470882 None] Created volume successfully.
Apr 10 13:11:56 devstack cinder-volume[83345]: DEBUG dbcounter [-] [83345] Writing DB stats cinder:UPDATE=72,cinder:SELECT=68,cinder:DELETE=6,cinder:INSERT=16 {{(pid=83345) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 10 13:11:57 devstack cinder-volume[83345]: DEBUG dbcounter [-] [83345] Writing DB stats cinder:SELECT=80,cinder:UPDATE=88,cinder:INSERT=14,cinder:DELETE=3 {{(pid=83345) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 10 13:11:57 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-a586d959-ee90-43e2-b119-fac7d69ce04e tempest-ServersNegativeTestJSON-1265470882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:11:57 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-a586d959-ee90-43e2-b119-fac7d69ce04e tempest-ServersNegativeTestJSON-1265470882 None] Flow 'volume_create_manager' (c760e3a4-3ae0-4914-aaf5-fd5166d1240b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:11:57 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-a586d959-ee90-43e2-b119-fac7d69ce04e tempest-ServersNegativeTestJSON-1265470882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7e591cc-bd9a-4f10-b1a0-74b81d5a9354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:11:57 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-a586d959-ee90-43e2-b119-fac7d69ce04e tempest-ServersNegativeTestJSON-1265470882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7e591cc-bd9a-4f10-b1a0-74b81d5a9354) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:11:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-422594167',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba8c6c3d-6cd1-48e8-9177-7a6574ab8c7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5f0d036ce4449c594b94e898b9a5d71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:11:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:11:57Z,use_quota=True,user_id='f911217e9ec54028928b48a33616dc17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:11:57 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-a586d959-ee90-43e2-b119-fac7d69ce04e tempest-ServersNegativeTestJSON-1265470882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad6ea70d-edda-4a92-8f10-e9b38a06871b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:11:57 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-a586d959-ee90-43e2-b119-fac7d69ce04e tempest-ServersNegativeTestJSON-1265470882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad6ea70d-edda-4a92-8f10-e9b38a06871b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:11:57 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-a586d959-ee90-43e2-b119-fac7d69ce04e tempest-ServersNegativeTestJSON-1265470882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76aa1737-f57f-4cc4-bc55-46ef1456920e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:11:57 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-a586d959-ee90-43e2-b119-fac7d69ce04e tempest-ServersNegativeTestJSON-1265470882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76aa1737-f57f-4cc4-bc55-46ef1456920e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba8c6c3d-6cd1-48e8-9177-7a6574ab8c7c', 'volume_name': 'volume-ba8c6c3d-6cd1-48e8-9177-7a6574ab8c7c', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:11:57 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-a586d959-ee90-43e2-b119-fac7d69ce04e tempest-ServersNegativeTestJSON-1265470882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95923376-7075-47e8-a222-2820d1443ca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:11:57 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-a586d959-ee90-43e2-b119-fac7d69ce04e tempest-ServersNegativeTestJSON-1265470882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95923376-7075-47e8-a222-2820d1443ca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:11:57 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-a586d959-ee90-43e2-b119-fac7d69ce04e tempest-ServersNegativeTestJSON-1265470882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e934187b-6aeb-4eba-9c02-1e39c1f3057e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:11:57 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-a586d959-ee90-43e2-b119-fac7d69ce04e tempest-ServersNegativeTestJSON-1265470882 None] Volume ba8c6c3d-6cd1-48e8-9177-7a6574ab8c7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba8c6c3d-6cd1-48e8-9177-7a6574ab8c7c', 'volume_size': 1}
Apr 10 13:11:57 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-a586d959-ee90-43e2-b119-fac7d69ce04e tempest-ServersNegativeTestJSON-1265470882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:11:57 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-a586d959-ee90-43e2-b119-fac7d69ce04e tempest-ServersNegativeTestJSON-1265470882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:11:57 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-a586d959-ee90-43e2-b119-fac7d69ce04e tempest-ServersNegativeTestJSON-1265470882 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f252bf08b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:11:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-422594167',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba8c6c3d-6cd1-48e8-9177-7a6574ab8c7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5f0d036ce4449c594b94e898b9a5d71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:11:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:11:57Z,use_quota=True,user_id='f911217e9ec54028928b48a33616dc17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)}" {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 13:11:57 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-a586d959-ee90-43e2-b119-fac7d69ce04e tempest-ServersNegativeTestJSON-1265470882 None] Creating volume ba8c6c3d-6cd1-48e8-9177-7a6574ab8c7c {{(pid=83345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 13:11:57 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-a586d959-ee90-43e2-b119-fac7d69ce04e tempest-ServersNegativeTestJSON-1265470882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:11:57 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-a586d959-ee90-43e2-b119-fac7d69ce04e tempest-ServersNegativeTestJSON-1265470882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:11:57 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-a586d959-ee90-43e2-b119-fac7d69ce04e tempest-ServersNegativeTestJSON-1265470882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:11:57 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-a586d959-ee90-43e2-b119-fac7d69ce04e tempest-ServersNegativeTestJSON-1265470882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:11:57 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-a586d959-ee90-43e2-b119-fac7d69ce04e tempest-ServersNegativeTestJSON-1265470882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:11:57 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-a586d959-ee90-43e2-b119-fac7d69ce04e tempest-ServersNegativeTestJSON-1265470882 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:11:57 devstack cinder-volume[83345]: INFO cinder.volume.drivers.remotefs [None req-a586d959-ee90-43e2-b119-fac7d69ce04e tempest-ServersNegativeTestJSON-1265470882 None] casted to osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331
Apr 10 13:11:57 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-a586d959-ee90-43e2-b119-fac7d69ce04e tempest-ServersNegativeTestJSON-1265470882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-ba8c6c3d-6cd1-48e8-9177-7a6574ab8c7c 1073741824 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:11:57 devstack sudo[85178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-ba8c6c3d-6cd1-48e8-9177-7a6574ab8c7c 1073741824
Apr 10 13:11:57 devstack sudo[85178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:11:58 devstack sudo[85178]: pam_unix(sudo:session): session closed for user root
Apr 10 13:11:58 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-a586d959-ee90-43e2-b119-fac7d69ce04e tempest-ServersNegativeTestJSON-1265470882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-ba8c6c3d-6cd1-48e8-9177-7a6574ab8c7c 1073741824" returned: 0 in 1.100s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:11:58 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-a586d959-ee90-43e2-b119-fac7d69ce04e tempest-ServersNegativeTestJSON-1265470882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-ba8c6c3d-6cd1-48e8-9177-7a6574ab8c7c {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:11:58 devstack sudo[85210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-ba8c6c3d-6cd1-48e8-9177-7a6574ab8c7c
Apr 10 13:11:58 devstack sudo[85210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:11:58 devstack sudo[85210]: pam_unix(sudo:session): session closed for user root
Apr 10 13:11:58 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-a586d959-ee90-43e2-b119-fac7d69ce04e tempest-ServersNegativeTestJSON-1265470882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-ba8c6c3d-6cd1-48e8-9177-7a6574ab8c7c" returned: 0 in 0.524s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:11:58 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-a586d959-ee90-43e2-b119-fac7d69ce04e tempest-ServersNegativeTestJSON-1265470882 None] <== create_volume: return (1654ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'} {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 13:11:58 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-a586d959-ee90-43e2-b119-fac7d69ce04e tempest-ServersNegativeTestJSON-1265470882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.657s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:11:58 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-a586d959-ee90-43e2-b119-fac7d69ce04e tempest-ServersNegativeTestJSON-1265470882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e934187b-6aeb-4eba-9c02-1e39c1f3057e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba8c6c3d-6cd1-48e8-9177-7a6574ab8c7c', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:11:58 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-a586d959-ee90-43e2-b119-fac7d69ce04e tempest-ServersNegativeTestJSON-1265470882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21a87450-8579-439a-8981-2b81e7a426b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:11:58 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-a586d959-ee90-43e2-b119-fac7d69ce04e tempest-ServersNegativeTestJSON-1265470882 None] Volume volume-ba8c6c3d-6cd1-48e8-9177-7a6574ab8c7c (ba8c6c3d-6cd1-48e8-9177-7a6574ab8c7c): created successfully
Apr 10 13:11:58 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-a586d959-ee90-43e2-b119-fac7d69ce04e tempest-ServersNegativeTestJSON-1265470882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21a87450-8579-439a-8981-2b81e7a426b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:11:58 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-a586d959-ee90-43e2-b119-fac7d69ce04e tempest-ServersNegativeTestJSON-1265470882 None] Flow 'volume_create_manager' (c760e3a4-3ae0-4914-aaf5-fd5166d1240b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:11:58 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-a586d959-ee90-43e2-b119-fac7d69ce04e tempest-ServersNegativeTestJSON-1265470882 None] Created volume successfully.
Apr 10 13:11:59 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-f7afdaaf-684b-4069-922f-76fb61e79697 tempest-ServersNegativeTestJSON-1265470882 None] Acquiring lock "cinder-ba8c6c3d-6cd1-48e8-9177-7a6574ab8c7c-delete_volume" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:11:59 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-f7afdaaf-684b-4069-922f-76fb61e79697 tempest-ServersNegativeTestJSON-1265470882 None] Lock "cinder-ba8c6c3d-6cd1-48e8-9177-7a6574ab8c7c-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:12:00 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-f7afdaaf-684b-4069-922f-76fb61e79697 tempest-ServersNegativeTestJSON-1265470882 None] Acquiring lock "cinder-quobyte-ba8c6c3d-6cd1-48e8-9177-7a6574ab8c7c" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:12:00 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-f7afdaaf-684b-4069-922f-76fb61e79697 tempest-ServersNegativeTestJSON-1265470882 None] Lock "cinder-quobyte-ba8c6c3d-6cd1-48e8-9177-7a6574ab8c7c" acquired by "delete_volume" :: waited 0.040s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:12:00 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[14bd0a1b-21ec-4189-882a-db4df20e60b4]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:12:00 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-f7afdaaf-684b-4069-922f-76fb61e79697 tempest-ServersNegativeTestJSON-1265470882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-ba8c6c3d-6cd1-48e8-9177-7a6574ab8c7c {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:12:00 devstack sudo[85232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-ba8c6c3d-6cd1-48e8-9177-7a6574ab8c7c
Apr 10 13:12:00 devstack sudo[85232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:12:00 devstack sudo[85232]: pam_unix(sudo:session): session closed for user root
Apr 10 13:12:00 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-f7afdaaf-684b-4069-922f-76fb61e79697 tempest-ServersNegativeTestJSON-1265470882 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-ba8c6c3d-6cd1-48e8-9177-7a6574ab8c7c" returned: 0 in 0.700s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:12:00 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-f7afdaaf-684b-4069-922f-76fb61e79697 tempest-ServersNegativeTestJSON-1265470882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-ba8c6c3d-6cd1-48e8-9177-7a6574ab8c7c {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:12:00 devstack sudo[85237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-ba8c6c3d-6cd1-48e8-9177-7a6574ab8c7c
Apr 10 13:12:00 devstack sudo[85237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:12:01 devstack sudo[85237]: pam_unix(sudo:session): session closed for user root
Apr 10 13:12:01 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-f7afdaaf-684b-4069-922f-76fb61e79697 tempest-ServersNegativeTestJSON-1265470882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-ba8c6c3d-6cd1-48e8-9177-7a6574ab8c7c" returned: 0 in 0.697s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:12:01 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-f7afdaaf-684b-4069-922f-76fb61e79697 tempest-ServersNegativeTestJSON-1265470882 None] Lock "cinder-quobyte-ba8c6c3d-6cd1-48e8-9177-7a6574ab8c7c" released by "delete_volume" :: held 1.436s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:12:01 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-f7afdaaf-684b-4069-922f-76fb61e79697 tempest-ServersNegativeTestJSON-1265470882 None] Created reservations ['75cf5a77-cf1e-4746-b802-cc49311cbea5', 'a2cfebd5-35c7-4848-81ee-a05ad76d8f26', '9f90bddb-baf2-4bb8-a6fd-47bc38599e0b', '4935ec08-dea3-4f36-a110-5de8f95bbaac'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:12:01 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-f7afdaaf-684b-4069-922f-76fb61e79697 tempest-ServersNegativeTestJSON-1265470882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:12:01 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-f7afdaaf-684b-4069-922f-76fb61e79697 tempest-ServersNegativeTestJSON-1265470882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:12:01 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-f7afdaaf-684b-4069-922f-76fb61e79697 tempest-ServersNegativeTestJSON-1265470882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:12:01 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-f7afdaaf-684b-4069-922f-76fb61e79697 tempest-ServersNegativeTestJSON-1265470882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:12:01 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-f7afdaaf-684b-4069-922f-76fb61e79697 tempest-ServersNegativeTestJSON-1265470882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:12:01 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-f7afdaaf-684b-4069-922f-76fb61e79697 tempest-ServersNegativeTestJSON-1265470882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:12:01 devstack sudo[85243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:12:01 devstack sudo[85243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:12:02 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-bff1073d-b0c8-401a-b00a-ac0bc0396084 tempest-ServersNegativeTestJSON-1265470882 None] Acquiring lock "cinder-1e76d7bd-b54b-4d41-8d15-21df35e34c6e-delete_volume" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:12:02 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-bff1073d-b0c8-401a-b00a-ac0bc0396084 tempest-ServersNegativeTestJSON-1265470882 None] Lock "cinder-1e76d7bd-b54b-4d41-8d15-21df35e34c6e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:12:02 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-bff1073d-b0c8-401a-b00a-ac0bc0396084 tempest-ServersNegativeTestJSON-1265470882 None] Acquiring lock "cinder-quobyte-1e76d7bd-b54b-4d41-8d15-21df35e34c6e" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:12:02 devstack sudo[85243]: pam_unix(sudo:session): session closed for user root
Apr 10 13:12:02 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-bff1073d-b0c8-401a-b00a-ac0bc0396084 tempest-ServersNegativeTestJSON-1265470882 None] Lock "cinder-quobyte-1e76d7bd-b54b-4d41-8d15-21df35e34c6e" acquired by "delete_volume" :: waited 0.009s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:12:02 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-f7afdaaf-684b-4069-922f-76fb61e79697 tempest-ServersNegativeTestJSON-1265470882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.801s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:12:02 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-f7afdaaf-684b-4069-922f-76fb61e79697 tempest-ServersNegativeTestJSON-1265470882 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:12:02 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-f7afdaaf-684b-4069-922f-76fb61e79697 tempest-ServersNegativeTestJSON-1265470882 None] Deleted volume successfully.
Apr 10 13:12:02 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f1569eb-c005-4341-b7df-0d1e74956865]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:12:02 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-bff1073d-b0c8-401a-b00a-ac0bc0396084 tempest-ServersNegativeTestJSON-1265470882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-1e76d7bd-b54b-4d41-8d15-21df35e34c6e {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:12:02 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-f7afdaaf-684b-4069-922f-76fb61e79697 tempest-ServersNegativeTestJSON-1265470882 None] Lock "cinder-ba8c6c3d-6cd1-48e8-9177-7a6574ab8c7c-delete_volume" released by "delete_volume" :: held 2.480s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:12:02 devstack sudo[85249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-1e76d7bd-b54b-4d41-8d15-21df35e34c6e
Apr 10 13:12:02 devstack sudo[85249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:12:03 devstack sudo[85249]: pam_unix(sudo:session): session closed for user root
Apr 10 13:12:03 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-bff1073d-b0c8-401a-b00a-ac0bc0396084 tempest-ServersNegativeTestJSON-1265470882 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-1e76d7bd-b54b-4d41-8d15-21df35e34c6e" returned: 0 in 0.936s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:12:03 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-bff1073d-b0c8-401a-b00a-ac0bc0396084 tempest-ServersNegativeTestJSON-1265470882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-1e76d7bd-b54b-4d41-8d15-21df35e34c6e {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:12:03 devstack sudo[85255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-1e76d7bd-b54b-4d41-8d15-21df35e34c6e
Apr 10 13:12:03 devstack sudo[85255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:12:03 devstack sudo[85255]: pam_unix(sudo:session): session closed for user root
Apr 10 13:12:03 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-bff1073d-b0c8-401a-b00a-ac0bc0396084 tempest-ServersNegativeTestJSON-1265470882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-1e76d7bd-b54b-4d41-8d15-21df35e34c6e" returned: 0 in 0.655s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:12:04 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-bff1073d-b0c8-401a-b00a-ac0bc0396084 tempest-ServersNegativeTestJSON-1265470882 None] Lock "cinder-quobyte-1e76d7bd-b54b-4d41-8d15-21df35e34c6e" released by "delete_volume" :: held 1.641s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:12:04 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-bff1073d-b0c8-401a-b00a-ac0bc0396084 tempest-ServersNegativeTestJSON-1265470882 None] Created reservations ['6c2825fd-9822-461f-8efc-ed317c009a8c', '74b359b4-c00a-48ea-92fd-7614e5b00550', 'e9c5d5df-d177-4fab-92ee-0bf7dd66df43', '61361533-cf7b-4015-a5bc-a955a4d04982'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:12:04 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-bff1073d-b0c8-401a-b00a-ac0bc0396084 tempest-ServersNegativeTestJSON-1265470882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:12:04 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-bff1073d-b0c8-401a-b00a-ac0bc0396084 tempest-ServersNegativeTestJSON-1265470882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:12:04 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-bff1073d-b0c8-401a-b00a-ac0bc0396084 tempest-ServersNegativeTestJSON-1265470882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:12:04 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-bff1073d-b0c8-401a-b00a-ac0bc0396084 tempest-ServersNegativeTestJSON-1265470882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:12:04 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-bff1073d-b0c8-401a-b00a-ac0bc0396084 tempest-ServersNegativeTestJSON-1265470882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:12:04 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-bff1073d-b0c8-401a-b00a-ac0bc0396084 tempest-ServersNegativeTestJSON-1265470882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:12:04 devstack sudo[85284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:12:04 devstack sudo[85284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:12:04 devstack sudo[85284]: pam_unix(sudo:session): session closed for user root
Apr 10 13:12:04 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-bff1073d-b0c8-401a-b00a-ac0bc0396084 tempest-ServersNegativeTestJSON-1265470882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.668s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:12:04 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-bff1073d-b0c8-401a-b00a-ac0bc0396084 tempest-ServersNegativeTestJSON-1265470882 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:12:04 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-bff1073d-b0c8-401a-b00a-ac0bc0396084 tempest-ServersNegativeTestJSON-1265470882 None] Deleted volume successfully.
Apr 10 13:12:04 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-bff1073d-b0c8-401a-b00a-ac0bc0396084 tempest-ServersNegativeTestJSON-1265470882 None] Lock "cinder-1e76d7bd-b54b-4d41-8d15-21df35e34c6e-delete_volume" released by "delete_volume" :: held 2.541s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:12:14 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-5414488c-72e4-4b68-8d11-bf592066ac64 tempest-DeleteServersTestJSON-1566604493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:12:14 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-5414488c-72e4-4b68-8d11-bf592066ac64 tempest-DeleteServersTestJSON-1566604493 None] Flow 'volume_create_manager' (1f73f889-df1e-4be7-94cf-6a9e063ef633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:12:14 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-5414488c-72e4-4b68-8d11-bf592066ac64 tempest-DeleteServersTestJSON-1566604493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1bd892d-776a-4398-af14-f159a4a64507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:12:14 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-5414488c-72e4-4b68-8d11-bf592066ac64 tempest-DeleteServersTestJSON-1566604493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1bd892d-776a-4398-af14-f159a4a64507) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:12:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1242488460',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=346c19a3-01d8-42ba-bb93-ca127c021ac6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='380d751eebc64acda6da5e2cb9cd05d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:12:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:12:15Z,use_quota=True,user_id='f567fc034d9a475c8807362ba8d20a02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:12:14 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-5414488c-72e4-4b68-8d11-bf592066ac64 tempest-DeleteServersTestJSON-1566604493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65217b98-53af-4c61-b77d-58b9f24c8e99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:12:14 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-5414488c-72e4-4b68-8d11-bf592066ac64 tempest-DeleteServersTestJSON-1566604493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65217b98-53af-4c61-b77d-58b9f24c8e99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:12:14 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-5414488c-72e4-4b68-8d11-bf592066ac64 tempest-DeleteServersTestJSON-1566604493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5058db53-e832-49f0-899b-1ae5e76ce9c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:12:14 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-5414488c-72e4-4b68-8d11-bf592066ac64 tempest-DeleteServersTestJSON-1566604493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5058db53-e832-49f0-899b-1ae5e76ce9c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '346c19a3-01d8-42ba-bb93-ca127c021ac6', 'volume_name': 'volume-346c19a3-01d8-42ba-bb93-ca127c021ac6', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:12:14 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-5414488c-72e4-4b68-8d11-bf592066ac64 tempest-DeleteServersTestJSON-1566604493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6478c6d-f74f-4bf2-8e0a-9337c6b3f58c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:12:14 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-5414488c-72e4-4b68-8d11-bf592066ac64 tempest-DeleteServersTestJSON-1566604493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6478c6d-f74f-4bf2-8e0a-9337c6b3f58c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:12:14 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-5414488c-72e4-4b68-8d11-bf592066ac64 tempest-DeleteServersTestJSON-1566604493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (783ea9da-7e53-42db-8fbb-068b34c43289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:12:14 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-5414488c-72e4-4b68-8d11-bf592066ac64 tempest-DeleteServersTestJSON-1566604493 None] Volume 346c19a3-01d8-42ba-bb93-ca127c021ac6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-346c19a3-01d8-42ba-bb93-ca127c021ac6', 'volume_size': 1}
Apr 10 13:12:14 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-5414488c-72e4-4b68-8d11-bf592066ac64 tempest-DeleteServersTestJSON-1566604493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:12:14 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-5414488c-72e4-4b68-8d11-bf592066ac64 tempest-DeleteServersTestJSON-1566604493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:12:14 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-5414488c-72e4-4b68-8d11-bf592066ac64 tempest-DeleteServersTestJSON-1566604493 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f252bf08b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:12:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1242488460',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=346c19a3-01d8-42ba-bb93-ca127c021ac6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='380d751eebc64acda6da5e2cb9cd05d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:12:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:12:15Z,use_quota=True,user_id='f567fc034d9a475c8807362ba8d20a02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)}" {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 13:12:14 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-5414488c-72e4-4b68-8d11-bf592066ac64 tempest-DeleteServersTestJSON-1566604493 None] Creating volume 346c19a3-01d8-42ba-bb93-ca127c021ac6 {{(pid=83345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 13:12:14 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-5414488c-72e4-4b68-8d11-bf592066ac64 tempest-DeleteServersTestJSON-1566604493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:12:14 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-5414488c-72e4-4b68-8d11-bf592066ac64 tempest-DeleteServersTestJSON-1566604493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:12:14 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-5414488c-72e4-4b68-8d11-bf592066ac64 tempest-DeleteServersTestJSON-1566604493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:12:14 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-5414488c-72e4-4b68-8d11-bf592066ac64 tempest-DeleteServersTestJSON-1566604493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:12:14 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-5414488c-72e4-4b68-8d11-bf592066ac64 tempest-DeleteServersTestJSON-1566604493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:12:14 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-5414488c-72e4-4b68-8d11-bf592066ac64 tempest-DeleteServersTestJSON-1566604493 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:12:14 devstack cinder-volume[83345]: INFO cinder.volume.drivers.remotefs [None req-5414488c-72e4-4b68-8d11-bf592066ac64 tempest-DeleteServersTestJSON-1566604493 None] casted to osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331
Apr 10 13:12:14 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-5414488c-72e4-4b68-8d11-bf592066ac64 tempest-DeleteServersTestJSON-1566604493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-346c19a3-01d8-42ba-bb93-ca127c021ac6 1073741824 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:12:14 devstack sudo[85369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-346c19a3-01d8-42ba-bb93-ca127c021ac6 1073741824
Apr 10 13:12:14 devstack sudo[85369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:12:16 devstack sudo[85369]: pam_unix(sudo:session): session closed for user root
Apr 10 13:12:16 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-5414488c-72e4-4b68-8d11-bf592066ac64 tempest-DeleteServersTestJSON-1566604493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-346c19a3-01d8-42ba-bb93-ca127c021ac6 1073741824" returned: 0 in 1.510s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:12:16 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-5414488c-72e4-4b68-8d11-bf592066ac64 tempest-DeleteServersTestJSON-1566604493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-346c19a3-01d8-42ba-bb93-ca127c021ac6 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:12:16 devstack sudo[85379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-346c19a3-01d8-42ba-bb93-ca127c021ac6
Apr 10 13:12:16 devstack sudo[85379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:12:16 devstack sudo[85379]: pam_unix(sudo:session): session closed for user root
Apr 10 13:12:17 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-5414488c-72e4-4b68-8d11-bf592066ac64 tempest-DeleteServersTestJSON-1566604493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-346c19a3-01d8-42ba-bb93-ca127c021ac6" returned: 0 in 0.550s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:12:17 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-5414488c-72e4-4b68-8d11-bf592066ac64 tempest-DeleteServersTestJSON-1566604493 None] <== create_volume: return (2156ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'} {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 13:12:17 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-5414488c-72e4-4b68-8d11-bf592066ac64 tempest-DeleteServersTestJSON-1566604493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.159s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:12:17 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-5414488c-72e4-4b68-8d11-bf592066ac64 tempest-DeleteServersTestJSON-1566604493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (783ea9da-7e53-42db-8fbb-068b34c43289) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-346c19a3-01d8-42ba-bb93-ca127c021ac6', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:12:17 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-5414488c-72e4-4b68-8d11-bf592066ac64 tempest-DeleteServersTestJSON-1566604493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2f1f01b-78c0-4e35-8c13-e1e865a2f69a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:12:17 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-5414488c-72e4-4b68-8d11-bf592066ac64 tempest-DeleteServersTestJSON-1566604493 None] Volume volume-346c19a3-01d8-42ba-bb93-ca127c021ac6 (346c19a3-01d8-42ba-bb93-ca127c021ac6): created successfully
Apr 10 13:12:17 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-5414488c-72e4-4b68-8d11-bf592066ac64 tempest-DeleteServersTestJSON-1566604493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2f1f01b-78c0-4e35-8c13-e1e865a2f69a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:12:17 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-5414488c-72e4-4b68-8d11-bf592066ac64 tempest-DeleteServersTestJSON-1566604493 None] Flow 'volume_create_manager' (1f73f889-df1e-4be7-94cf-6a9e063ef633) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:12:17 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-5414488c-72e4-4b68-8d11-bf592066ac64 tempest-DeleteServersTestJSON-1566604493 None] Created volume successfully.
Apr 10 13:12:21 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [req-6b23e04e-b926-43f0-8e6d-56a077f643da req-d021a573-e521-40b0-82c4-56e4fa8d41b4 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:12:21 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [req-6b23e04e-b926-43f0-8e6d-56a077f643da req-d021a573-e521-40b0-82c4-56e4fa8d41b4 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Flow 'volume_create_manager' (2341f005-f633-43c6-a7f4-750fbab734ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:12:21 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [req-6b23e04e-b926-43f0-8e6d-56a077f643da req-d021a573-e521-40b0-82c4-56e4fa8d41b4 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f920ad0-9355-468b-b94a-dc361cd24ec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:12:21 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [req-6b23e04e-b926-43f0-8e6d-56a077f643da req-d021a573-e521-40b0-82c4-56e4fa8d41b4 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f920ad0-9355-468b-b94a-dc361cd24ec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:12:21Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cdb5a15-786c-4e45-87c4-8658670b35e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d54ed146d39f4e3dbc91a7441decfecc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:12:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:12:22Z,use_quota=True,user_id='45a7706494bf40ceb2abb68c0b9c8c78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:12:21 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [req-6b23e04e-b926-43f0-8e6d-56a077f643da req-d021a573-e521-40b0-82c4-56e4fa8d41b4 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (add0dc9f-2042-489d-96da-3fafd24865e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:12:21 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [req-6b23e04e-b926-43f0-8e6d-56a077f643da req-d021a573-e521-40b0-82c4-56e4fa8d41b4 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (add0dc9f-2042-489d-96da-3fafd24865e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:12:21 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [req-6b23e04e-b926-43f0-8e6d-56a077f643da req-d021a573-e521-40b0-82c4-56e4fa8d41b4 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66c3ab0b-e8a6-407d-a204-6693d01aac06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:12:21 devstack cinder-volume[83345]: DEBUG cinder.image.glance [req-6b23e04e-b926-43f0-8e6d-56a077f643da req-d021a573-e521-40b0-82c4-56e4fa8d41b4 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Creating Keystone auth plugin from conf {{(pid=83345) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 10 13:12:22 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [req-73497629-807d-4076-911e-254dc88542e9 req-c18a0a6a-2673-4b78-bcdd-b659dd5d3341 tempest-DeleteServersTestJSON-1566604493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:12:22 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [req-73497629-807d-4076-911e-254dc88542e9 req-c18a0a6a-2673-4b78-bcdd-b659dd5d3341 tempest-DeleteServersTestJSON-1566604493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:12:22 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aabe48e-6a05-4158-9466-3446a22f6813]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:12:22 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [req-73497629-807d-4076-911e-254dc88542e9 req-c18a0a6a-2673-4b78-bcdd-b659dd5d3341 tempest-DeleteServersTestJSON-1566604493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-346c19a3-01d8-42ba-bb93-ca127c021ac6 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:12:22 devstack sudo[85416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-346c19a3-01d8-42ba-bb93-ca127c021ac6
Apr 10 13:12:22 devstack sudo[85416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:12:22 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [req-6b23e04e-b926-43f0-8e6d-56a077f643da req-d021a573-e521-40b0-82c4-56e4fa8d41b4 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66c3ab0b-e8a6-407d-a204-6693d01aac06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6cdb5a15-786c-4e45-87c4-8658670b35e6', 'volume_name': 'volume-6cdb5a15-786c-4e45-87c4-8658670b35e6', 'volume_size': 1, 'image_id': 'dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8c498714b5e64042a43894acdb754f15', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5', 'created_at': datetime.datetime(2026, 4, 10, 11, 6, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 10, 11, 6, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f252ba653c0>}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:12:22 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [req-6b23e04e-b926-43f0-8e6d-56a077f643da req-d021a573-e521-40b0-82c4-56e4fa8d41b4 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58eb3eff-a612-4cd3-9fd4-331afaad6072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:12:22 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [req-6b23e04e-b926-43f0-8e6d-56a077f643da req-d021a573-e521-40b0-82c4-56e4fa8d41b4 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58eb3eff-a612-4cd3-9fd4-331afaad6072) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:12:22 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [req-6b23e04e-b926-43f0-8e6d-56a077f643da req-d021a573-e521-40b0-82c4-56e4fa8d41b4 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74f79f09-7c11-465c-acd3-a5c3a4c3b6ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:12:22 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [req-6b23e04e-b926-43f0-8e6d-56a077f643da req-d021a573-e521-40b0-82c4-56e4fa8d41b4 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Volume 6cdb5a15-786c-4e45-87c4-8658670b35e6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6cdb5a15-786c-4e45-87c4-8658670b35e6', 'volume_size': 1, 'image_id': 'dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8c498714b5e64042a43894acdb754f15', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5', 'created_at': datetime.datetime(2026, 4, 10, 11, 6, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 10, 11, 6, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f252ba653c0>}
Apr 10 13:12:22 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [req-6b23e04e-b926-43f0-8e6d-56a077f643da req-d021a573-e521-40b0-82c4-56e4fa8d41b4 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Trying to clone 6cdb5a15-786c-4e45-87c4-8658670b35e6 from image dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5 at location (None, [{'url': 'file:///opt/stack/data/glance/images/dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5', 'metadata': {}}]). {{(pid=83345) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 10 13:12:22 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-31727348-c0ac-41b8-87e3-7762a1d8f6e9 tempest-VolumesTestJSON-23791933 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:12:22 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-31727348-c0ac-41b8-87e3-7762a1d8f6e9 tempest-VolumesTestJSON-23791933 None] Flow 'volume_create_manager' (6f22bd0e-f733-4dc4-9940-b1094454cebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:12:22 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-31727348-c0ac-41b8-87e3-7762a1d8f6e9 tempest-VolumesTestJSON-23791933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ad95d74-36f6-45b6-88fe-1b5c639d131b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:12:23 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-31727348-c0ac-41b8-87e3-7762a1d8f6e9 tempest-VolumesTestJSON-23791933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ad95d74-36f6-45b6-88fe-1b5c639d131b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:12:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1464574263',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df1ca2c6-4dbd-405e-8d33-be32a58f836c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='41ae61ee12204efda34df3ea1e940d7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:12:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:12:23Z,use_quota=True,user_id='877ddeddbc06461cbd83b418bbcdc181',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:12:23 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-31727348-c0ac-41b8-87e3-7762a1d8f6e9 tempest-VolumesTestJSON-23791933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a04a734-3278-4f1d-9abc-e157b455cc10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:12:23 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-31727348-c0ac-41b8-87e3-7762a1d8f6e9 tempest-VolumesTestJSON-23791933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a04a734-3278-4f1d-9abc-e157b455cc10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:12:23 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-31727348-c0ac-41b8-87e3-7762a1d8f6e9 tempest-VolumesTestJSON-23791933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f134c0d-d1c1-4ced-af88-606b6da8f639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:12:23 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-31727348-c0ac-41b8-87e3-7762a1d8f6e9 tempest-VolumesTestJSON-23791933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f134c0d-d1c1-4ced-af88-606b6da8f639) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df1ca2c6-4dbd-405e-8d33-be32a58f836c', 'volume_name': 'volume-df1ca2c6-4dbd-405e-8d33-be32a58f836c', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:12:23 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-31727348-c0ac-41b8-87e3-7762a1d8f6e9 tempest-VolumesTestJSON-23791933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ecb2de3-2548-4fa6-aa8f-55b1da8aedff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:12:23 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-31727348-c0ac-41b8-87e3-7762a1d8f6e9 tempest-VolumesTestJSON-23791933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ecb2de3-2548-4fa6-aa8f-55b1da8aedff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:12:23 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-31727348-c0ac-41b8-87e3-7762a1d8f6e9 tempest-VolumesTestJSON-23791933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bb1cbba-88c6-4d73-84a4-58f81abda192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:12:23 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-31727348-c0ac-41b8-87e3-7762a1d8f6e9 tempest-VolumesTestJSON-23791933 None] Volume df1ca2c6-4dbd-405e-8d33-be32a58f836c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df1ca2c6-4dbd-405e-8d33-be32a58f836c', 'volume_size': 1}
Apr 10 13:12:23 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-31727348-c0ac-41b8-87e3-7762a1d8f6e9 tempest-VolumesTestJSON-23791933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:12:23 devstack cinder-volume[83345]: DEBUG cinder.image.image_utils [req-6b23e04e-b926-43f0-8e6d-56a077f643da req-d021a573-e521-40b0-82c4-56e4fa8d41b4 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5_f_5mr2redevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83345) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 10 13:12:23 devstack cinder-volume[83345]: INFO cinder.image.image_utils [req-6b23e04e-b926-43f0-8e6d-56a077f643da req-d021a573-e521-40b0-82c4-56e4fa8d41b4 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Image download 20.69 MB at 20.69 MB/s
Apr 10 13:12:23 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c1c2973-3e24-4077-9cd6-c25f6da20aa9]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:12:23 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [req-6b23e04e-b926-43f0-8e6d-56a077f643da req-d021a573-e521-40b0-82c4-56e4fa8d41b4 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5_f_5mr2redevstack@QuobyteHD {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:12:23 devstack sudo[85416]: pam_unix(sudo:session): session closed for user root
Apr 10 13:12:23 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [req-73497629-807d-4076-911e-254dc88542e9 req-c18a0a6a-2673-4b78-bcdd-b659dd5d3341 tempest-DeleteServersTestJSON-1566604493 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-346c19a3-01d8-42ba-bb93-ca127c021ac6" returned: 0 in 1.373s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:12:23 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [req-73497629-807d-4076-911e-254dc88542e9 req-c18a0a6a-2673-4b78-bcdd-b659dd5d3341 tempest-DeleteServersTestJSON-1566604493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.398s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:12:23 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-31727348-c0ac-41b8-87e3-7762a1d8f6e9 tempest-VolumesTestJSON-23791933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.312s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:12:23 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-31727348-c0ac-41b8-87e3-7762a1d8f6e9 tempest-VolumesTestJSON-23791933 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f252bf08b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:12:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1464574263',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df1ca2c6-4dbd-405e-8d33-be32a58f836c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='41ae61ee12204efda34df3ea1e940d7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:12:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:12:23Z,use_quota=True,user_id='877ddeddbc06461cbd83b418bbcdc181',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)}" {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 13:12:23 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-31727348-c0ac-41b8-87e3-7762a1d8f6e9 tempest-VolumesTestJSON-23791933 None] Creating volume df1ca2c6-4dbd-405e-8d33-be32a58f836c {{(pid=83345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 13:12:23 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-31727348-c0ac-41b8-87e3-7762a1d8f6e9 tempest-VolumesTestJSON-23791933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:12:23 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-31727348-c0ac-41b8-87e3-7762a1d8f6e9 tempest-VolumesTestJSON-23791933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:12:23 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-31727348-c0ac-41b8-87e3-7762a1d8f6e9 tempest-VolumesTestJSON-23791933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:12:23 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-31727348-c0ac-41b8-87e3-7762a1d8f6e9 tempest-VolumesTestJSON-23791933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:12:23 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-31727348-c0ac-41b8-87e3-7762a1d8f6e9 tempest-VolumesTestJSON-23791933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:12:23 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-31727348-c0ac-41b8-87e3-7762a1d8f6e9 tempest-VolumesTestJSON-23791933 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:12:23 devstack cinder-volume[83345]: INFO cinder.volume.drivers.remotefs [None req-31727348-c0ac-41b8-87e3-7762a1d8f6e9 tempest-VolumesTestJSON-23791933 None] casted to osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331
Apr 10 13:12:23 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-31727348-c0ac-41b8-87e3-7762a1d8f6e9 tempest-VolumesTestJSON-23791933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-df1ca2c6-4dbd-405e-8d33-be32a58f836c 1073741824 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:12:23 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [req-73497629-807d-4076-911e-254dc88542e9 req-c18a0a6a-2673-4b78-bcdd-b659dd5d3341 tempest-DeleteServersTestJSON-1566604493 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331', 'name': 'volume-346c19a3-01d8-42ba-bb93-ca127c021ac6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f128ce3a-6de9-4aa6-84a3-a55c87538098', 'enforce_multipath': True} {{(pid=83345) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 10 13:12:23 devstack sudo[85448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-df1ca2c6-4dbd-405e-8d33-be32a58f836c 1073741824
Apr 10 13:12:23 devstack sudo[85448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:12:23 devstack sudo[85444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5_f_5mr2redevstack@QuobyteHD
Apr 10 13:12:23 devstack sudo[85444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:12:23 devstack cinder-volume[83345]: INFO cinder.volume.manager [req-73497629-807d-4076-911e-254dc88542e9 req-c18a0a6a-2673-4b78-bcdd-b659dd5d3341 tempest-DeleteServersTestJSON-1566604493 None] attachment_update completed successfully.
Apr 10 13:12:24 devstack sudo[85444]: pam_unix(sudo:session): session closed for user root
Apr 10 13:12:24 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [req-6b23e04e-b926-43f0-8e6d-56a077f643da req-d021a573-e521-40b0-82c4-56e4fa8d41b4 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5_f_5mr2redevstack@QuobyteHD" returned: 0 in 0.929s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:12:24 devstack cinder-volume[83345]: DEBUG cinder.image.image_utils [req-6b23e04e-b926-43f0-8e6d-56a077f643da req-d021a573-e521-40b0-82c4-56e4fa8d41b4 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Temporary image dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5 is fetched for user 45a7706494bf40ceb2abb68c0b9c8c78. {{(pid=83345) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 10 13:12:24 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[d660bdee-16f4-4cdd-99a0-61693ab02459]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:12:24 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [req-6b23e04e-b926-43f0-8e6d-56a077f643da req-d021a573-e521-40b0-82c4-56e4fa8d41b4 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5_f_5mr2redevstack@QuobyteHD {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:12:24 devstack sudo[85483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5_f_5mr2redevstack@QuobyteHD
Apr 10 13:12:24 devstack sudo[85483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:12:24 devstack sudo[85448]: pam_unix(sudo:session): session closed for user root
Apr 10 13:12:24 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-31727348-c0ac-41b8-87e3-7762a1d8f6e9 tempest-VolumesTestJSON-23791933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-df1ca2c6-4dbd-405e-8d33-be32a58f836c 1073741824" returned: 0 in 1.454s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:12:24 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-31727348-c0ac-41b8-87e3-7762a1d8f6e9 tempest-VolumesTestJSON-23791933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-df1ca2c6-4dbd-405e-8d33-be32a58f836c {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:12:24 devstack sudo[85491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-df1ca2c6-4dbd-405e-8d33-be32a58f836c
Apr 10 13:12:24 devstack sudo[85491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:12:25 devstack sudo[85483]: pam_unix(sudo:session): session closed for user root
Apr 10 13:12:25 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [req-6b23e04e-b926-43f0-8e6d-56a077f643da req-d021a573-e521-40b0-82c4-56e4fa8d41b4 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5_f_5mr2redevstack@QuobyteHD" returned: 0 in 0.751s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:12:25 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [req-6b23e04e-b926-43f0-8e6d-56a077f643da req-d021a573-e521-40b0-82c4-56e4fa8d41b4 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:12:25 devstack sudo[85491]: pam_unix(sudo:session): session closed for user root
Apr 10 13:12:25 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-31727348-c0ac-41b8-87e3-7762a1d8f6e9 tempest-VolumesTestJSON-23791933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-df1ca2c6-4dbd-405e-8d33-be32a58f836c" returned: 0 in 0.484s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:12:25 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-31727348-c0ac-41b8-87e3-7762a1d8f6e9 tempest-VolumesTestJSON-23791933 None] <== create_volume: return (1988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'} {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 13:12:25 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-31727348-c0ac-41b8-87e3-7762a1d8f6e9 tempest-VolumesTestJSON-23791933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.991s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:12:25 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [req-6b23e04e-b926-43f0-8e6d-56a077f643da req-d021a573-e521-40b0-82c4-56e4fa8d41b4 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.264s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:12:25 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [req-6b23e04e-b926-43f0-8e6d-56a077f643da req-d021a573-e521-40b0-82c4-56e4fa8d41b4 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f252bf08b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:12:21Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cdb5a15-786c-4e45-87c4-8658670b35e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d54ed146d39f4e3dbc91a7441decfecc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:12:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:12:22Z,use_quota=True,user_id='45a7706494bf40ceb2abb68c0b9c8c78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)}" {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 13:12:25 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [req-6b23e04e-b926-43f0-8e6d-56a077f643da req-d021a573-e521-40b0-82c4-56e4fa8d41b4 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Creating volume 6cdb5a15-786c-4e45-87c4-8658670b35e6 {{(pid=83345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 13:12:25 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [req-6b23e04e-b926-43f0-8e6d-56a077f643da req-d021a573-e521-40b0-82c4-56e4fa8d41b4 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:12:25 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [req-6b23e04e-b926-43f0-8e6d-56a077f643da req-d021a573-e521-40b0-82c4-56e4fa8d41b4 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:12:25 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [req-6b23e04e-b926-43f0-8e6d-56a077f643da req-d021a573-e521-40b0-82c4-56e4fa8d41b4 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:12:25 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [req-6b23e04e-b926-43f0-8e6d-56a077f643da req-d021a573-e521-40b0-82c4-56e4fa8d41b4 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:12:25 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [req-6b23e04e-b926-43f0-8e6d-56a077f643da req-d021a573-e521-40b0-82c4-56e4fa8d41b4 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:12:25 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [req-6b23e04e-b926-43f0-8e6d-56a077f643da req-d021a573-e521-40b0-82c4-56e4fa8d41b4 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:12:25 devstack cinder-volume[83345]: INFO cinder.volume.drivers.remotefs [req-6b23e04e-b926-43f0-8e6d-56a077f643da req-d021a573-e521-40b0-82c4-56e4fa8d41b4 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] casted to osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331
Apr 10 13:12:25 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [req-6b23e04e-b926-43f0-8e6d-56a077f643da req-d021a573-e521-40b0-82c4-56e4fa8d41b4 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-6cdb5a15-786c-4e45-87c4-8658670b35e6 1073741824 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:12:25 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-31727348-c0ac-41b8-87e3-7762a1d8f6e9 tempest-VolumesTestJSON-23791933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bb1cbba-88c6-4d73-84a4-58f81abda192) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df1ca2c6-4dbd-405e-8d33-be32a58f836c', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:12:25 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-31727348-c0ac-41b8-87e3-7762a1d8f6e9 tempest-VolumesTestJSON-23791933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fea9baf4-7ed0-42bf-8408-67790ff0a332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:12:25 devstack sudo[85497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-6cdb5a15-786c-4e45-87c4-8658670b35e6 1073741824
Apr 10 13:12:25 devstack sudo[85497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:12:25 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-31727348-c0ac-41b8-87e3-7762a1d8f6e9 tempest-VolumesTestJSON-23791933 None] Volume volume-df1ca2c6-4dbd-405e-8d33-be32a58f836c (df1ca2c6-4dbd-405e-8d33-be32a58f836c): created successfully
Apr 10 13:12:25 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-31727348-c0ac-41b8-87e3-7762a1d8f6e9 tempest-VolumesTestJSON-23791933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fea9baf4-7ed0-42bf-8408-67790ff0a332) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:12:25 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-31727348-c0ac-41b8-87e3-7762a1d8f6e9 tempest-VolumesTestJSON-23791933 None] Flow 'volume_create_manager' (6f22bd0e-f733-4dc4-9940-b1094454cebb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:12:25 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-31727348-c0ac-41b8-87e3-7762a1d8f6e9 tempest-VolumesTestJSON-23791933 None] Created volume successfully.
Apr 10 13:12:26 devstack sudo[85497]: pam_unix(sudo:session): session closed for user root
Apr 10 13:12:26 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [req-6b23e04e-b926-43f0-8e6d-56a077f643da req-d021a573-e521-40b0-82c4-56e4fa8d41b4 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-6cdb5a15-786c-4e45-87c4-8658670b35e6 1073741824" returned: 0 in 0.662s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:12:26 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [req-6b23e04e-b926-43f0-8e6d-56a077f643da req-d021a573-e521-40b0-82c4-56e4fa8d41b4 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-6cdb5a15-786c-4e45-87c4-8658670b35e6 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:12:26 devstack sudo[85502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-6cdb5a15-786c-4e45-87c4-8658670b35e6
Apr 10 13:12:26 devstack sudo[85502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:12:26 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8c84166-4907-4235-980e-c172120f6a5f tempest-VolumesTestJSON-23791933 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:12:26 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-e8c84166-4907-4235-980e-c172120f6a5f tempest-VolumesTestJSON-23791933 None] Flow 'volume_create_manager' (0d27db81-4ab4-4607-9484-c1a4a88cfef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:12:26 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-e8c84166-4907-4235-980e-c172120f6a5f tempest-VolumesTestJSON-23791933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ee3ee16-aed1-4da6-ba57-20481ec313ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:12:26 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-e8c84166-4907-4235-980e-c172120f6a5f tempest-VolumesTestJSON-23791933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ee3ee16-aed1-4da6-ba57-20481ec313ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:12:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-522306119',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f399d506-a410-4df1-972e-4f77656cb8d0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='41ae61ee12204efda34df3ea1e940d7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:12:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:12:26Z,use_quota=True,user_id='877ddeddbc06461cbd83b418bbcdc181',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:12:26 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-e8c84166-4907-4235-980e-c172120f6a5f tempest-VolumesTestJSON-23791933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0920b0f3-148d-4bb8-bb8b-cbd33159f904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:12:26 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-e8c84166-4907-4235-980e-c172120f6a5f tempest-VolumesTestJSON-23791933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0920b0f3-148d-4bb8-bb8b-cbd33159f904) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:12:26 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-e8c84166-4907-4235-980e-c172120f6a5f tempest-VolumesTestJSON-23791933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9a05e91-0eba-4759-9d17-fdd6710dfc01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:12:26 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-e8c84166-4907-4235-980e-c172120f6a5f tempest-VolumesTestJSON-23791933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9a05e91-0eba-4759-9d17-fdd6710dfc01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f399d506-a410-4df1-972e-4f77656cb8d0', 'volume_name': 'volume-f399d506-a410-4df1-972e-4f77656cb8d0', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:12:26 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-e8c84166-4907-4235-980e-c172120f6a5f tempest-VolumesTestJSON-23791933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4158c013-f5f0-4662-bfd1-2fddbd248cc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:12:26 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-e8c84166-4907-4235-980e-c172120f6a5f tempest-VolumesTestJSON-23791933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4158c013-f5f0-4662-bfd1-2fddbd248cc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:12:26 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-e8c84166-4907-4235-980e-c172120f6a5f tempest-VolumesTestJSON-23791933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c851151-d17c-4299-a233-f9d18de165fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:12:26 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-e8c84166-4907-4235-980e-c172120f6a5f tempest-VolumesTestJSON-23791933 None] Volume f399d506-a410-4df1-972e-4f77656cb8d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f399d506-a410-4df1-972e-4f77656cb8d0', 'volume_size': 1}
Apr 10 13:12:26 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-e8c84166-4907-4235-980e-c172120f6a5f tempest-VolumesTestJSON-23791933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:12:26 devstack sudo[85502]: pam_unix(sudo:session): session closed for user root
Apr 10 13:12:26 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [req-6b23e04e-b926-43f0-8e6d-56a077f643da req-d021a573-e521-40b0-82c4-56e4fa8d41b4 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-6cdb5a15-786c-4e45-87c4-8658670b35e6" returned: 0 in 0.881s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:12:26 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [req-6b23e04e-b926-43f0-8e6d-56a077f643da req-d021a573-e521-40b0-82c4-56e4fa8d41b4 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] <== create_volume: return (1570ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'} {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 13:12:26 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [req-6b23e04e-b926-43f0-8e6d-56a077f643da req-d021a573-e521-40b0-82c4-56e4fa8d41b4 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.573s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:12:26 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-e8c84166-4907-4235-980e-c172120f6a5f tempest-VolumesTestJSON-23791933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.301s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:12:26 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-e8c84166-4907-4235-980e-c172120f6a5f tempest-VolumesTestJSON-23791933 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f252bf08b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:12:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-522306119',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f399d506-a410-4df1-972e-4f77656cb8d0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='41ae61ee12204efda34df3ea1e940d7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:12:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:12:26Z,use_quota=True,user_id='877ddeddbc06461cbd83b418bbcdc181',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)}" {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 13:12:26 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-e8c84166-4907-4235-980e-c172120f6a5f tempest-VolumesTestJSON-23791933 None] Creating volume f399d506-a410-4df1-972e-4f77656cb8d0 {{(pid=83345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 13:12:26 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-e8c84166-4907-4235-980e-c172120f6a5f tempest-VolumesTestJSON-23791933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:12:26 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-e8c84166-4907-4235-980e-c172120f6a5f tempest-VolumesTestJSON-23791933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:12:26 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-e8c84166-4907-4235-980e-c172120f6a5f tempest-VolumesTestJSON-23791933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:12:27 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-e8c84166-4907-4235-980e-c172120f6a5f tempest-VolumesTestJSON-23791933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:12:27 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-e8c84166-4907-4235-980e-c172120f6a5f tempest-VolumesTestJSON-23791933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:12:27 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-e8c84166-4907-4235-980e-c172120f6a5f tempest-VolumesTestJSON-23791933 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:12:27 devstack cinder-volume[83345]: INFO cinder.volume.drivers.remotefs [None req-e8c84166-4907-4235-980e-c172120f6a5f tempest-VolumesTestJSON-23791933 None] casted to osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331
Apr 10 13:12:27 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-e8c84166-4907-4235-980e-c172120f6a5f tempest-VolumesTestJSON-23791933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-f399d506-a410-4df1-972e-4f77656cb8d0 1073741824 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:12:27 devstack cinder-volume[83345]: DEBUG cinder.volume.volume_utils [req-6b23e04e-b926-43f0-8e6d-56a077f643da req-d021a573-e521-40b0-82c4-56e4fa8d41b4 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Attempting download of dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5 ((None, [{'url': 'file:///opt/stack/data/glance/images/dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5', 'metadata': {}}])) to volume 6cdb5a15-786c-4e45-87c4-8658670b35e6. {{(pid=83345) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 10 13:12:27 devstack sudo[85539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-f399d506-a410-4df1-972e-4f77656cb8d0 1073741824
Apr 10 13:12:27 devstack sudo[85539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:12:27 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[48186736-ea4e-416d-a7a5-8ad0c237d97c]: (4, 'raw') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:12:27 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [req-6b23e04e-b926-43f0-8e6d-56a077f643da req-d021a573-e521-40b0-82c4-56e4fa8d41b4 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5_7s9938yz {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:12:27 devstack sudo[85541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5_7s9938yz
Apr 10 13:12:27 devstack sudo[85541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:12:27 devstack sudo[85539]: pam_unix(sudo:session): session closed for user root
Apr 10 13:12:27 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-e8c84166-4907-4235-980e-c172120f6a5f tempest-VolumesTestJSON-23791933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-f399d506-a410-4df1-972e-4f77656cb8d0 1073741824" returned: 0 in 0.636s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:12:27 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-e8c84166-4907-4235-980e-c172120f6a5f tempest-VolumesTestJSON-23791933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-f399d506-a410-4df1-972e-4f77656cb8d0 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:12:27 devstack sudo[85546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-f399d506-a410-4df1-972e-4f77656cb8d0
Apr 10 13:12:27 devstack sudo[85546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:12:27 devstack sudo[85541]: pam_unix(sudo:session): session closed for user root
Apr 10 13:12:27 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [req-6b23e04e-b926-43f0-8e6d-56a077f643da req-d021a573-e521-40b0-82c4-56e4fa8d41b4 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5_7s9938yz" returned: 0 in 0.641s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:12:27 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [req-6b23e04e-b926-43f0-8e6d-56a077f643da req-d021a573-e521-40b0-82c4-56e4fa8d41b4 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5_7s9938yz {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:12:27 devstack sudo[85550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5_7s9938yz
Apr 10 13:12:27 devstack sudo[85550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:12:28 devstack sudo[85550]: pam_unix(sudo:session): session closed for user root
Apr 10 13:12:28 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [req-6b23e04e-b926-43f0-8e6d-56a077f643da req-d021a573-e521-40b0-82c4-56e4fa8d41b4 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5_7s9938yz" returned: 1 in 0.690s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:12:28 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [req-6b23e04e-b926-43f0-8e6d-56a077f643da req-d021a573-e521-40b0-82c4-56e4fa8d41b4 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5_7s9938yz' failed. Not Retrying. {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 10 13:12:28 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb90faa1-44ba-4078-a835-07c4134fa824]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:12:28 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [req-6b23e04e-b926-43f0-8e6d-56a077f643da req-d021a573-e521-40b0-82c4-56e4fa8d41b4 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5_f_5mr2redevstack@QuobyteHD {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:12:28 devstack sudo[85546]: pam_unix(sudo:session): session closed for user root
Apr 10 13:12:28 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-e8c84166-4907-4235-980e-c172120f6a5f tempest-VolumesTestJSON-23791933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-f399d506-a410-4df1-972e-4f77656cb8d0" returned: 0 in 0.915s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:12:28 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-e8c84166-4907-4235-980e-c172120f6a5f tempest-VolumesTestJSON-23791933 None] <== create_volume: return (1596ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'} {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 13:12:28 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-e8c84166-4907-4235-980e-c172120f6a5f tempest-VolumesTestJSON-23791933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.599s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:12:28 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-e8c84166-4907-4235-980e-c172120f6a5f tempest-VolumesTestJSON-23791933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c851151-d17c-4299-a233-f9d18de165fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f399d506-a410-4df1-972e-4f77656cb8d0', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:12:28 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-e8c84166-4907-4235-980e-c172120f6a5f tempest-VolumesTestJSON-23791933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80f4dfa5-6244-45d8-975f-0635dea61c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:12:28 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-e8c84166-4907-4235-980e-c172120f6a5f tempest-VolumesTestJSON-23791933 None] Volume volume-f399d506-a410-4df1-972e-4f77656cb8d0 (f399d506-a410-4df1-972e-4f77656cb8d0): created successfully
Apr 10 13:12:28 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-e8c84166-4907-4235-980e-c172120f6a5f tempest-VolumesTestJSON-23791933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80f4dfa5-6244-45d8-975f-0635dea61c55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:12:28 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-e8c84166-4907-4235-980e-c172120f6a5f tempest-VolumesTestJSON-23791933 None] Flow 'volume_create_manager' (0d27db81-4ab4-4607-9484-c1a4a88cfef7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:12:28 devstack sudo[85559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5_f_5mr2redevstack@QuobyteHD
Apr 10 13:12:28 devstack sudo[85559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:12:28 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-e8c84166-4907-4235-980e-c172120f6a5f tempest-VolumesTestJSON-23791933 None] Created volume successfully.
Apr 10 13:12:29 devstack sudo[85559]: pam_unix(sudo:session): session closed for user root
Apr 10 13:12:29 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [req-6b23e04e-b926-43f0-8e6d-56a077f643da req-d021a573-e521-40b0-82c4-56e4fa8d41b4 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5_f_5mr2redevstack@QuobyteHD" returned: 0 in 0.638s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:12:29 devstack cinder-volume[83345]: DEBUG cinder.image.image_utils [req-6b23e04e-b926-43f0-8e6d-56a077f643da req-d021a573-e521-40b0-82c4-56e4fa8d41b4 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5 was qcow2, converting to raw {{(pid=83345) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 10 13:12:29 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [req-6b23e04e-b926-43f0-8e6d-56a077f643da req-d021a573-e521-40b0-82c4-56e4fa8d41b4 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5_f_5mr2redevstack@QuobyteHD /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-6cdb5a15-786c-4e45-87c4-8658670b35e6 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:12:29 devstack sudo[85564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5_f_5mr2redevstack@QuobyteHD /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-6cdb5a15-786c-4e45-87c4-8658670b35e6
Apr 10 13:12:29 devstack sudo[85564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:12:30 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6b42c22-9a97-49b9-a787-243916a81305 tempest-VolumesTestJSON-23791933 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:12:30 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-b6b42c22-9a97-49b9-a787-243916a81305 tempest-VolumesTestJSON-23791933 None] Flow 'volume_create_manager' (ce4e5934-3d29-4e52-9771-f3fe50f300f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:12:30 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-b6b42c22-9a97-49b9-a787-243916a81305 tempest-VolumesTestJSON-23791933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1db5bfbc-62e9-45d8-abbd-d8f76e101dd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:12:30 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-b6b42c22-9a97-49b9-a787-243916a81305 tempest-VolumesTestJSON-23791933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1db5bfbc-62e9-45d8-abbd-d8f76e101dd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:12:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-52137306',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bc3c2e3-50e7-4544-a7e8-26f4d5ef4911,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='41ae61ee12204efda34df3ea1e940d7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:12:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:12:30Z,use_quota=True,user_id='877ddeddbc06461cbd83b418bbcdc181',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:12:30 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-b6b42c22-9a97-49b9-a787-243916a81305 tempest-VolumesTestJSON-23791933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b75b86c-07ff-43d7-8fe1-ffab2c948ec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:12:30 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-b6b42c22-9a97-49b9-a787-243916a81305 tempest-VolumesTestJSON-23791933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b75b86c-07ff-43d7-8fe1-ffab2c948ec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:12:30 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-b6b42c22-9a97-49b9-a787-243916a81305 tempest-VolumesTestJSON-23791933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a7fa623-025d-46c5-ba48-3966e4f51cda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:12:30 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-b6b42c22-9a97-49b9-a787-243916a81305 tempest-VolumesTestJSON-23791933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a7fa623-025d-46c5-ba48-3966e4f51cda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9bc3c2e3-50e7-4544-a7e8-26f4d5ef4911', 'volume_name': 'volume-9bc3c2e3-50e7-4544-a7e8-26f4d5ef4911', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:12:30 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-b6b42c22-9a97-49b9-a787-243916a81305 tempest-VolumesTestJSON-23791933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d661b4a-caf6-413a-b421-98e796d94f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:12:30 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-b6b42c22-9a97-49b9-a787-243916a81305 tempest-VolumesTestJSON-23791933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d661b4a-caf6-413a-b421-98e796d94f81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:12:30 devstack sudo[85564]: pam_unix(sudo:session): session closed for user root
Apr 10 13:12:30 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-b6b42c22-9a97-49b9-a787-243916a81305 tempest-VolumesTestJSON-23791933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53ac02f7-96e6-4e5a-a4b2-71dc9b56c7df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:12:30 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-b6b42c22-9a97-49b9-a787-243916a81305 tempest-VolumesTestJSON-23791933 None] Volume 9bc3c2e3-50e7-4544-a7e8-26f4d5ef4911: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9bc3c2e3-50e7-4544-a7e8-26f4d5ef4911', 'volume_size': 1}
Apr 10 13:12:30 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-b6b42c22-9a97-49b9-a787-243916a81305 tempest-VolumesTestJSON-23791933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:12:30 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-b6b42c22-9a97-49b9-a787-243916a81305 tempest-VolumesTestJSON-23791933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:12:30 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-b6b42c22-9a97-49b9-a787-243916a81305 tempest-VolumesTestJSON-23791933 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f252bf08b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:12:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-52137306',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bc3c2e3-50e7-4544-a7e8-26f4d5ef4911,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='41ae61ee12204efda34df3ea1e940d7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:12:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:12:30Z,use_quota=True,user_id='877ddeddbc06461cbd83b418bbcdc181',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)}" {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 13:12:30 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-b6b42c22-9a97-49b9-a787-243916a81305 tempest-VolumesTestJSON-23791933 None] Creating volume 9bc3c2e3-50e7-4544-a7e8-26f4d5ef4911 {{(pid=83345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 13:12:30 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-b6b42c22-9a97-49b9-a787-243916a81305 tempest-VolumesTestJSON-23791933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:12:30 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-b6b42c22-9a97-49b9-a787-243916a81305 tempest-VolumesTestJSON-23791933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:12:30 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-b6b42c22-9a97-49b9-a787-243916a81305 tempest-VolumesTestJSON-23791933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:12:30 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-b6b42c22-9a97-49b9-a787-243916a81305 tempest-VolumesTestJSON-23791933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:12:30 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-b6b42c22-9a97-49b9-a787-243916a81305 tempest-VolumesTestJSON-23791933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:12:30 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-b6b42c22-9a97-49b9-a787-243916a81305 tempest-VolumesTestJSON-23791933 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:12:30 devstack cinder-volume[83345]: INFO cinder.volume.drivers.remotefs [None req-b6b42c22-9a97-49b9-a787-243916a81305 tempest-VolumesTestJSON-23791933 None] casted to osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331
Apr 10 13:12:30 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-b6b42c22-9a97-49b9-a787-243916a81305 tempest-VolumesTestJSON-23791933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-9bc3c2e3-50e7-4544-a7e8-26f4d5ef4911 1073741824 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:12:30 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [req-6b23e04e-b926-43f0-8e6d-56a077f643da req-d021a573-e521-40b0-82c4-56e4fa8d41b4 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5_f_5mr2redevstack@QuobyteHD /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-6cdb5a15-786c-4e45-87c4-8658670b35e6" returned: 0 in 1.485s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:12:30 devstack cinder-volume[83345]: DEBUG cinder.image.image_utils [req-6b23e04e-b926-43f0-8e6d-56a077f643da req-d021a573-e521-40b0-82c4-56e4fa8d41b4 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5_f_5mr2redevstack@QuobyteHD, size 112.00 MB, duration 1.49 sec, destination /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-6cdb5a15-786c-4e45-87c4-8658670b35e6 {{(pid=83345) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 10 13:12:30 devstack cinder-volume[83345]: INFO cinder.image.image_utils [req-6b23e04e-b926-43f0-8e6d-56a077f643da req-d021a573-e521-40b0-82c4-56e4fa8d41b4 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Converted 112.00 MB image at 75.31 MB/s
Apr 10 13:12:30 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [req-6b23e04e-b926-43f0-8e6d-56a077f643da req-d021a573-e521-40b0-82c4-56e4fa8d41b4 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-6cdb5a15-786c-4e45-87c4-8658670b35e6 1G {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:12:30 devstack sudo[85638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-9bc3c2e3-50e7-4544-a7e8-26f4d5ef4911 1073741824
Apr 10 13:12:30 devstack sudo[85638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:12:30 devstack sudo[85639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-6cdb5a15-786c-4e45-87c4-8658670b35e6 1G
Apr 10 13:12:30 devstack sudo[85639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:12:31 devstack sudo[85638]: pam_unix(sudo:session): session closed for user root
Apr 10 13:12:31 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-b6b42c22-9a97-49b9-a787-243916a81305 tempest-VolumesTestJSON-23791933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-9bc3c2e3-50e7-4544-a7e8-26f4d5ef4911 1073741824" returned: 0 in 0.630s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:12:31 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-b6b42c22-9a97-49b9-a787-243916a81305 tempest-VolumesTestJSON-23791933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-9bc3c2e3-50e7-4544-a7e8-26f4d5ef4911 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:12:31 devstack sudo[85639]: pam_unix(sudo:session): session closed for user root
Apr 10 13:12:31 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [req-6b23e04e-b926-43f0-8e6d-56a077f643da req-d021a573-e521-40b0-82c4-56e4fa8d41b4 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-6cdb5a15-786c-4e45-87c4-8658670b35e6 1G" returned: 0 in 0.660s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:12:31 devstack sudo[85652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-9bc3c2e3-50e7-4544-a7e8-26f4d5ef4911
Apr 10 13:12:31 devstack sudo[85652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:12:31 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5387690-3e67-41ad-88f2-cccb43a08e55]: (4, 'raw') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:12:31 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [req-6b23e04e-b926-43f0-8e6d-56a077f643da req-d021a573-e521-40b0-82c4-56e4fa8d41b4 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-6cdb5a15-786c-4e45-87c4-8658670b35e6 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:12:31 devstack sudo[85654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-6cdb5a15-786c-4e45-87c4-8658670b35e6
Apr 10 13:12:31 devstack sudo[85654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:12:31 devstack sudo[85652]: pam_unix(sudo:session): session closed for user root
Apr 10 13:12:31 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-b6b42c22-9a97-49b9-a787-243916a81305 tempest-VolumesTestJSON-23791933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-9bc3c2e3-50e7-4544-a7e8-26f4d5ef4911" returned: 0 in 0.638s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:12:31 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-b6b42c22-9a97-49b9-a787-243916a81305 tempest-VolumesTestJSON-23791933 None] <== create_volume: return (1301ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'} {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 13:12:31 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-b6b42c22-9a97-49b9-a787-243916a81305 tempest-VolumesTestJSON-23791933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.304s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:12:31 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-b6b42c22-9a97-49b9-a787-243916a81305 tempest-VolumesTestJSON-23791933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53ac02f7-96e6-4e5a-a4b2-71dc9b56c7df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bc3c2e3-50e7-4544-a7e8-26f4d5ef4911', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:12:31 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-b6b42c22-9a97-49b9-a787-243916a81305 tempest-VolumesTestJSON-23791933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a112b5b-6a55-4def-aa79-81f661195614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:12:31 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-b6b42c22-9a97-49b9-a787-243916a81305 tempest-VolumesTestJSON-23791933 None] Volume volume-9bc3c2e3-50e7-4544-a7e8-26f4d5ef4911 (9bc3c2e3-50e7-4544-a7e8-26f4d5ef4911): created successfully
Apr 10 13:12:31 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-b6b42c22-9a97-49b9-a787-243916a81305 tempest-VolumesTestJSON-23791933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a112b5b-6a55-4def-aa79-81f661195614) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:12:31 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-b6b42c22-9a97-49b9-a787-243916a81305 tempest-VolumesTestJSON-23791933 None] Flow 'volume_create_manager' (ce4e5934-3d29-4e52-9771-f3fe50f300f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:12:31 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-b6b42c22-9a97-49b9-a787-243916a81305 tempest-VolumesTestJSON-23791933 None] Created volume successfully.
Apr 10 13:12:32 devstack sudo[85654]: pam_unix(sudo:session): session closed for user root
Apr 10 13:12:32 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [req-6b23e04e-b926-43f0-8e6d-56a077f643da req-d021a573-e521-40b0-82c4-56e4fa8d41b4 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-6cdb5a15-786c-4e45-87c4-8658670b35e6" returned: 0 in 0.769s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:12:32 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [req-6b23e04e-b926-43f0-8e6d-56a077f643da req-d021a573-e521-40b0-82c4-56e4fa8d41b4 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-6cdb5a15-786c-4e45-87c4-8658670b35e6 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:12:32 devstack sudo[85662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-6cdb5a15-786c-4e45-87c4-8658670b35e6
Apr 10 13:12:32 devstack sudo[85662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:12:32 devstack sudo[85662]: pam_unix(sudo:session): session closed for user root
Apr 10 13:12:32 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [req-6b23e04e-b926-43f0-8e6d-56a077f643da req-d021a573-e521-40b0-82c4-56e4fa8d41b4 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-6cdb5a15-786c-4e45-87c4-8658670b35e6" returned: 1 in 0.516s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:12:32 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [req-6b23e04e-b926-43f0-8e6d-56a077f643da req-d021a573-e521-40b0-82c4-56e4fa8d41b4 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-6cdb5a15-786c-4e45-87c4-8658670b35e6' failed. Not Retrying. {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 10 13:12:32 devstack cinder-volume[83345]: DEBUG cinder.volume.volume_utils [req-6b23e04e-b926-43f0-8e6d-56a077f643da req-d021a573-e521-40b0-82c4-56e4fa8d41b4 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Downloaded image dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5 ((None, [{'url': 'file:///opt/stack/data/glance/images/dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5', 'metadata': {}}])) to volume 6cdb5a15-786c-4e45-87c4-8658670b35e6 successfully. {{(pid=83345) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 10 13:12:32 devstack cinder-volume[83345]: DEBUG cinder.image.image_utils [req-6b23e04e-b926-43f0-8e6d-56a077f643da req-d021a573-e521-40b0-82c4-56e4fa8d41b4 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Temporary image dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5 for user 45a7706494bf40ceb2abb68c0b9c8c78 is deleted. {{(pid=83345) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 10 13:12:32 devstack cinder-volume[83345]: DEBUG cinder.volume.volume_utils [req-6b23e04e-b926-43f0-8e6d-56a077f643da req-d021a573-e521-40b0-82c4-56e4fa8d41b4 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Marking volume 6cdb5a15-786c-4e45-87c4-8658670b35e6 as bootable. {{(pid=83345) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 10 13:12:32 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [req-6b23e04e-b926-43f0-8e6d-56a077f643da req-d021a573-e521-40b0-82c4-56e4fa8d41b4 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Copying metadata from image dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5 to 6cdb5a15-786c-4e45-87c4-8658670b35e6. {{(pid=83345) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 10 13:12:32 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [req-6b23e04e-b926-43f0-8e6d-56a077f643da req-d021a573-e521-40b0-82c4-56e4fa8d41b4 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Creating volume glance metadata for volume 6cdb5a15-786c-4e45-87c4-8658670b35e6 backed by image dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83345) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 10 13:12:32 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [req-6b23e04e-b926-43f0-8e6d-56a077f643da req-d021a573-e521-40b0-82c4-56e4fa8d41b4 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74f79f09-7c11-465c-acd3-a5c3a4c3b6ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6cdb5a15-786c-4e45-87c4-8658670b35e6', 'volume_size': 1, 'image_id': 'dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8c498714b5e64042a43894acdb754f15', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5', 'created_at': datetime.datetime(2026, 4, 10, 11, 6, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 10, 11, 6, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f252ba653c0>}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:12:32 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [req-6b23e04e-b926-43f0-8e6d-56a077f643da req-d021a573-e521-40b0-82c4-56e4fa8d41b4 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68246554-10cd-42ef-a9d0-24884238bed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:12:32 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [req-6b23e04e-b926-43f0-8e6d-56a077f643da req-d021a573-e521-40b0-82c4-56e4fa8d41b4 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Volume volume-6cdb5a15-786c-4e45-87c4-8658670b35e6 (6cdb5a15-786c-4e45-87c4-8658670b35e6): created successfully
Apr 10 13:12:32 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [req-6b23e04e-b926-43f0-8e6d-56a077f643da req-d021a573-e521-40b0-82c4-56e4fa8d41b4 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68246554-10cd-42ef-a9d0-24884238bed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:12:32 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [req-6b23e04e-b926-43f0-8e6d-56a077f643da req-d021a573-e521-40b0-82c4-56e4fa8d41b4 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Flow 'volume_create_manager' (2341f005-f633-43c6-a7f4-750fbab734ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:12:32 devstack cinder-volume[83345]: INFO cinder.volume.manager [req-fed8b81b-2b3d-4c20-9374-bffc410b19bd req-92091198-2a70-4f02-8061-fda77218d088 tempest-DeleteServersTestJSON-1566604493 None] Terminate volume connection completed successfully.
Apr 10 13:12:32 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [req-fed8b81b-2b3d-4c20-9374-bffc410b19bd req-92091198-2a70-4f02-8061-fda77218d088 tempest-DeleteServersTestJSON-1566604493 None] Deleting attachment f128ce3a-6de9-4aa6-84a3-a55c87538098. {{(pid=83345) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 10 13:12:32 devstack cinder-volume[83345]: INFO cinder.volume.manager [req-6b23e04e-b926-43f0-8e6d-56a077f643da req-d021a573-e521-40b0-82c4-56e4fa8d41b4 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Created volume successfully.
Apr 10 13:12:33 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-47fa08fa-a907-4704-ae3f-01d096db7873 tempest-VolumesTestJSON-23791933 None] Acquiring lock "cinder-9bc3c2e3-50e7-4544-a7e8-26f4d5ef4911-delete_volume" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:12:33 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-47fa08fa-a907-4704-ae3f-01d096db7873 tempest-VolumesTestJSON-23791933 None] Lock "cinder-9bc3c2e3-50e7-4544-a7e8-26f4d5ef4911-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:12:33 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-47fa08fa-a907-4704-ae3f-01d096db7873 tempest-VolumesTestJSON-23791933 None] Acquiring lock "cinder-quobyte-9bc3c2e3-50e7-4544-a7e8-26f4d5ef4911" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:12:33 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-47fa08fa-a907-4704-ae3f-01d096db7873 tempest-VolumesTestJSON-23791933 None] Lock "cinder-quobyte-9bc3c2e3-50e7-4544-a7e8-26f4d5ef4911" acquired by "delete_volume" :: waited 0.008s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:12:33 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[81a38a4c-f16f-4d38-9386-d25ea2a7b198]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:12:33 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-47fa08fa-a907-4704-ae3f-01d096db7873 tempest-VolumesTestJSON-23791933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-9bc3c2e3-50e7-4544-a7e8-26f4d5ef4911 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:12:33 devstack sudo[85669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-9bc3c2e3-50e7-4544-a7e8-26f4d5ef4911
Apr 10 13:12:33 devstack sudo[85669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:12:34 devstack sudo[85669]: pam_unix(sudo:session): session closed for user root
Apr 10 13:12:34 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-47fa08fa-a907-4704-ae3f-01d096db7873 tempest-VolumesTestJSON-23791933 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-9bc3c2e3-50e7-4544-a7e8-26f4d5ef4911" returned: 0 in 0.569s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:12:34 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-47fa08fa-a907-4704-ae3f-01d096db7873 tempest-VolumesTestJSON-23791933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-9bc3c2e3-50e7-4544-a7e8-26f4d5ef4911 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:12:34 devstack sudo[85674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-9bc3c2e3-50e7-4544-a7e8-26f4d5ef4911
Apr 10 13:12:34 devstack sudo[85674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:12:34 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [req-6b23e04e-b926-43f0-8e6d-56a077f643da req-26f37479-7be2-4a8a-9975-9485add0d572 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:12:34 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [req-6b23e04e-b926-43f0-8e6d-56a077f643da req-26f37479-7be2-4a8a-9975-9485add0d572 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:12:34 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a82a61d-b19d-4939-9c3d-b9bba78e53d5 tempest-VolumesActionsTest-1285107848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:12:34 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-3a82a61d-b19d-4939-9c3d-b9bba78e53d5 tempest-VolumesActionsTest-1285107848 None] Flow 'volume_create_manager' (ef40adbb-b51e-4b83-8a62-38ee6f336070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:12:34 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-3a82a61d-b19d-4939-9c3d-b9bba78e53d5 tempest-VolumesActionsTest-1285107848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e74bbba-47bf-4291-8c24-a92b0e3ac9a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:12:34 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[29cb8824-56dd-4e91-a98d-6503ed5686ce]: (4, 'raw') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:12:34 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [req-6b23e04e-b926-43f0-8e6d-56a077f643da req-26f37479-7be2-4a8a-9975-9485add0d572 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-6cdb5a15-786c-4e45-87c4-8658670b35e6 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:12:34 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-3a82a61d-b19d-4939-9c3d-b9bba78e53d5 tempest-VolumesActionsTest-1285107848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e74bbba-47bf-4291-8c24-a92b0e3ac9a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:12:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1917328155',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bf52699-eb10-471a-ae2b-2d2260aa9ac2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2551b2b6cd9f4994a93b4b15e32392da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:12:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:12:35Z,use_quota=True,user_id='aa1e9a5c093744c0a889c58c163c8c1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:12:34 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-3a82a61d-b19d-4939-9c3d-b9bba78e53d5 tempest-VolumesActionsTest-1285107848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf3dbfb9-9207-449a-820b-650239f84e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:12:34 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-3a82a61d-b19d-4939-9c3d-b9bba78e53d5 tempest-VolumesActionsTest-1285107848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf3dbfb9-9207-449a-820b-650239f84e60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:12:34 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-3a82a61d-b19d-4939-9c3d-b9bba78e53d5 tempest-VolumesActionsTest-1285107848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50f62808-4822-4ba7-8c4a-b512b1ed3097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:12:34 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-3a82a61d-b19d-4939-9c3d-b9bba78e53d5 tempest-VolumesActionsTest-1285107848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50f62808-4822-4ba7-8c4a-b512b1ed3097) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7bf52699-eb10-471a-ae2b-2d2260aa9ac2', 'volume_name': 'volume-7bf52699-eb10-471a-ae2b-2d2260aa9ac2', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:12:34 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-3a82a61d-b19d-4939-9c3d-b9bba78e53d5 tempest-VolumesActionsTest-1285107848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1506ade9-9d7e-48da-8b80-815b2ce42474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:12:34 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-3a82a61d-b19d-4939-9c3d-b9bba78e53d5 tempest-VolumesActionsTest-1285107848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1506ade9-9d7e-48da-8b80-815b2ce42474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:12:34 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-3a82a61d-b19d-4939-9c3d-b9bba78e53d5 tempest-VolumesActionsTest-1285107848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d9dce80-67d2-4567-a036-3fea76dddd8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:12:34 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-3a82a61d-b19d-4939-9c3d-b9bba78e53d5 tempest-VolumesActionsTest-1285107848 None] Volume 7bf52699-eb10-471a-ae2b-2d2260aa9ac2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7bf52699-eb10-471a-ae2b-2d2260aa9ac2', 'volume_size': 1}
Apr 10 13:12:34 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-3a82a61d-b19d-4939-9c3d-b9bba78e53d5 tempest-VolumesActionsTest-1285107848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:12:34 devstack sudo[85686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-6cdb5a15-786c-4e45-87c4-8658670b35e6
Apr 10 13:12:34 devstack sudo[85686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:12:34 devstack sudo[85674]: pam_unix(sudo:session): session closed for user root
Apr 10 13:12:34 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-47fa08fa-a907-4704-ae3f-01d096db7873 tempest-VolumesTestJSON-23791933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-9bc3c2e3-50e7-4544-a7e8-26f4d5ef4911" returned: 0 in 0.675s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:12:34 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-47fa08fa-a907-4704-ae3f-01d096db7873 tempest-VolumesTestJSON-23791933 None] Lock "cinder-quobyte-9bc3c2e3-50e7-4544-a7e8-26f4d5ef4911" released by "delete_volume" :: held 1.283s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:12:34 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-47fa08fa-a907-4704-ae3f-01d096db7873 tempest-VolumesTestJSON-23791933 None] Created reservations ['a3d04ffe-50fb-47f8-9b7b-8be61bcf34ac', '9e95444a-636d-43ee-bbe0-5fe8686ab4f6', '9c6f08c5-c28b-45b0-96c1-f0eb6998ea1b', '58f1802f-e9e2-4af5-9ae7-362da110bde1'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:12:34 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-47fa08fa-a907-4704-ae3f-01d096db7873 tempest-VolumesTestJSON-23791933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:12:34 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-47fa08fa-a907-4704-ae3f-01d096db7873 tempest-VolumesTestJSON-23791933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:12:34 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-47fa08fa-a907-4704-ae3f-01d096db7873 tempest-VolumesTestJSON-23791933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:12:34 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-47fa08fa-a907-4704-ae3f-01d096db7873 tempest-VolumesTestJSON-23791933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:12:34 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-47fa08fa-a907-4704-ae3f-01d096db7873 tempest-VolumesTestJSON-23791933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:12:34 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-47fa08fa-a907-4704-ae3f-01d096db7873 tempest-VolumesTestJSON-23791933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:12:34 devstack sudo[85688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:12:34 devstack sudo[85688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:12:35 devstack sudo[85686]: pam_unix(sudo:session): session closed for user root
Apr 10 13:12:35 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [req-6b23e04e-b926-43f0-8e6d-56a077f643da req-26f37479-7be2-4a8a-9975-9485add0d572 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-6cdb5a15-786c-4e45-87c4-8658670b35e6" returned: 0 in 0.506s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:12:35 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [req-6b23e04e-b926-43f0-8e6d-56a077f643da req-26f37479-7be2-4a8a-9975-9485add0d572 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-6cdb5a15-786c-4e45-87c4-8658670b35e6 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:12:35 devstack sudo[85693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-6cdb5a15-786c-4e45-87c4-8658670b35e6
Apr 10 13:12:35 devstack sudo[85693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:12:35 devstack sudo[85688]: pam_unix(sudo:session): session closed for user root
Apr 10 13:12:35 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-47fa08fa-a907-4704-ae3f-01d096db7873 tempest-VolumesTestJSON-23791933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.409s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:12:35 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-47fa08fa-a907-4704-ae3f-01d096db7873 tempest-VolumesTestJSON-23791933 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:12:35 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-47fa08fa-a907-4704-ae3f-01d096db7873 tempest-VolumesTestJSON-23791933 None] Deleted volume successfully.
Apr 10 13:12:35 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-47fa08fa-a907-4704-ae3f-01d096db7873 tempest-VolumesTestJSON-23791933 None] Lock "cinder-9bc3c2e3-50e7-4544-a7e8-26f4d5ef4911-delete_volume" released by "delete_volume" :: held 1.850s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:12:35 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-afaa693b-78fd-43a9-9dd9-65521d71b230 tempest-VolumesTestJSON-23791933 None] Acquiring lock "cinder-f399d506-a410-4df1-972e-4f77656cb8d0-delete_volume" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:12:35 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-afaa693b-78fd-43a9-9dd9-65521d71b230 tempest-VolumesTestJSON-23791933 None] Lock "cinder-f399d506-a410-4df1-972e-4f77656cb8d0-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:12:35 devstack sudo[85693]: pam_unix(sudo:session): session closed for user root
Apr 10 13:12:35 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-afaa693b-78fd-43a9-9dd9-65521d71b230 tempest-VolumesTestJSON-23791933 None] Acquiring lock "cinder-quobyte-f399d506-a410-4df1-972e-4f77656cb8d0" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:12:35 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [req-6b23e04e-b926-43f0-8e6d-56a077f643da req-26f37479-7be2-4a8a-9975-9485add0d572 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-6cdb5a15-786c-4e45-87c4-8658670b35e6" returned: 1 in 0.542s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:12:35 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [req-6b23e04e-b926-43f0-8e6d-56a077f643da req-26f37479-7be2-4a8a-9975-9485add0d572 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-6cdb5a15-786c-4e45-87c4-8658670b35e6' failed. Not Retrying. {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 10 13:12:35 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [req-6b23e04e-b926-43f0-8e6d-56a077f643da req-26f37479-7be2-4a8a-9975-9485add0d572 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.102s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:12:35 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-afaa693b-78fd-43a9-9dd9-65521d71b230 tempest-VolumesTestJSON-23791933 None] Lock "cinder-quobyte-f399d506-a410-4df1-972e-4f77656cb8d0" acquired by "delete_volume" :: waited 0.022s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:12:35 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-3a82a61d-b19d-4939-9c3d-b9bba78e53d5 tempest-VolumesActionsTest-1285107848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.032s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:12:35 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-3a82a61d-b19d-4939-9c3d-b9bba78e53d5 tempest-VolumesActionsTest-1285107848 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f252bf08b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:12:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1917328155',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bf52699-eb10-471a-ae2b-2d2260aa9ac2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2551b2b6cd9f4994a93b4b15e32392da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:12:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:12:35Z,use_quota=True,user_id='aa1e9a5c093744c0a889c58c163c8c1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)}" {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 13:12:35 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-3a82a61d-b19d-4939-9c3d-b9bba78e53d5 tempest-VolumesActionsTest-1285107848 None] Creating volume 7bf52699-eb10-471a-ae2b-2d2260aa9ac2 {{(pid=83345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 13:12:35 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-3a82a61d-b19d-4939-9c3d-b9bba78e53d5 tempest-VolumesActionsTest-1285107848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:12:35 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-3a82a61d-b19d-4939-9c3d-b9bba78e53d5 tempest-VolumesActionsTest-1285107848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:12:35 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-3a82a61d-b19d-4939-9c3d-b9bba78e53d5 tempest-VolumesActionsTest-1285107848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:12:35 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-3a82a61d-b19d-4939-9c3d-b9bba78e53d5 tempest-VolumesActionsTest-1285107848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:12:35 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-3a82a61d-b19d-4939-9c3d-b9bba78e53d5 tempest-VolumesActionsTest-1285107848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:12:35 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-3a82a61d-b19d-4939-9c3d-b9bba78e53d5 tempest-VolumesActionsTest-1285107848 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:12:35 devstack cinder-volume[83345]: INFO cinder.volume.drivers.remotefs [None req-3a82a61d-b19d-4939-9c3d-b9bba78e53d5 tempest-VolumesActionsTest-1285107848 None] casted to osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331
Apr 10 13:12:35 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-3a82a61d-b19d-4939-9c3d-b9bba78e53d5 tempest-VolumesActionsTest-1285107848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7bf52699-eb10-471a-ae2b-2d2260aa9ac2 1073741824 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:12:35 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6a76a68-4675-4144-bf2d-10e4bf54a967]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:12:35 devstack sudo[85698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7bf52699-eb10-471a-ae2b-2d2260aa9ac2 1073741824
Apr 10 13:12:35 devstack sudo[85698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:12:35 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-afaa693b-78fd-43a9-9dd9-65521d71b230 tempest-VolumesTestJSON-23791933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-f399d506-a410-4df1-972e-4f77656cb8d0 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:12:35 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [req-6b23e04e-b926-43f0-8e6d-56a077f643da req-26f37479-7be2-4a8a-9975-9485add0d572 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331', 'name': 'volume-6cdb5a15-786c-4e45-87c4-8658670b35e6', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dc3faeee-d0ad-4e95-893c-4d97c4131814', 'enforce_multipath': True} {{(pid=83345) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 10 13:12:35 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-2a4db75c-d012-40ec-97dd-a32b720cbb80 tempest-DeleteServersTestJSON-1566604493 None] Acquiring lock "cinder-346c19a3-01d8-42ba-bb93-ca127c021ac6-delete_volume" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:12:35 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-2a4db75c-d012-40ec-97dd-a32b720cbb80 tempest-DeleteServersTestJSON-1566604493 None] Lock "cinder-346c19a3-01d8-42ba-bb93-ca127c021ac6-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:12:35 devstack cinder-volume[83345]: INFO cinder.volume.manager [req-6b23e04e-b926-43f0-8e6d-56a077f643da req-26f37479-7be2-4a8a-9975-9485add0d572 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] attachment_update completed successfully.
Apr 10 13:12:35 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-2a4db75c-d012-40ec-97dd-a32b720cbb80 tempest-DeleteServersTestJSON-1566604493 None] Acquiring lock "cinder-quobyte-346c19a3-01d8-42ba-bb93-ca127c021ac6" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:12:35 devstack sudo[85700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-f399d506-a410-4df1-972e-4f77656cb8d0
Apr 10 13:12:35 devstack sudo[85700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:12:36 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-2a4db75c-d012-40ec-97dd-a32b720cbb80 tempest-DeleteServersTestJSON-1566604493 None] Lock "cinder-quobyte-346c19a3-01d8-42ba-bb93-ca127c021ac6" acquired by "delete_volume" :: waited 0.011s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:12:36 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[85b670a7-7b13-41db-81c3-fca39fdbd00e]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:12:36 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-2a4db75c-d012-40ec-97dd-a32b720cbb80 tempest-DeleteServersTestJSON-1566604493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-346c19a3-01d8-42ba-bb93-ca127c021ac6 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:12:36 devstack sudo[85702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-346c19a3-01d8-42ba-bb93-ca127c021ac6
Apr 10 13:12:36 devstack sudo[85702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:12:36 devstack sudo[85698]: pam_unix(sudo:session): session closed for user root
Apr 10 13:12:36 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-3a82a61d-b19d-4939-9c3d-b9bba78e53d5 tempest-VolumesActionsTest-1285107848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7bf52699-eb10-471a-ae2b-2d2260aa9ac2 1073741824" returned: 0 in 0.600s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:12:36 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-3a82a61d-b19d-4939-9c3d-b9bba78e53d5 tempest-VolumesActionsTest-1285107848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7bf52699-eb10-471a-ae2b-2d2260aa9ac2 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:12:36 devstack sudo[85713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7bf52699-eb10-471a-ae2b-2d2260aa9ac2
Apr 10 13:12:36 devstack sudo[85700]: pam_unix(sudo:session): session closed for user root
Apr 10 13:12:36 devstack sudo[85713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:12:36 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-afaa693b-78fd-43a9-9dd9-65521d71b230 tempest-VolumesTestJSON-23791933 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-f399d506-a410-4df1-972e-4f77656cb8d0" returned: 0 in 0.619s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:12:36 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-afaa693b-78fd-43a9-9dd9-65521d71b230 tempest-VolumesTestJSON-23791933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-f399d506-a410-4df1-972e-4f77656cb8d0 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:12:36 devstack sudo[85715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-f399d506-a410-4df1-972e-4f77656cb8d0
Apr 10 13:12:36 devstack sudo[85715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:12:36 devstack sudo[85702]: pam_unix(sudo:session): session closed for user root
Apr 10 13:12:36 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-2a4db75c-d012-40ec-97dd-a32b720cbb80 tempest-DeleteServersTestJSON-1566604493 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-346c19a3-01d8-42ba-bb93-ca127c021ac6" returned: 0 in 0.532s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:12:36 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-2a4db75c-d012-40ec-97dd-a32b720cbb80 tempest-DeleteServersTestJSON-1566604493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-346c19a3-01d8-42ba-bb93-ca127c021ac6 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:12:36 devstack sudo[85717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-346c19a3-01d8-42ba-bb93-ca127c021ac6
Apr 10 13:12:36 devstack sudo[85717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:12:37 devstack sudo[85713]: pam_unix(sudo:session): session closed for user root
Apr 10 13:12:37 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-3a82a61d-b19d-4939-9c3d-b9bba78e53d5 tempest-VolumesActionsTest-1285107848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7bf52699-eb10-471a-ae2b-2d2260aa9ac2" returned: 0 in 0.556s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:12:37 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-3a82a61d-b19d-4939-9c3d-b9bba78e53d5 tempest-VolumesActionsTest-1285107848 None] <== create_volume: return (1198ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'} {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 13:12:37 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-3a82a61d-b19d-4939-9c3d-b9bba78e53d5 tempest-VolumesActionsTest-1285107848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.202s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:12:37 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-3a82a61d-b19d-4939-9c3d-b9bba78e53d5 tempest-VolumesActionsTest-1285107848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d9dce80-67d2-4567-a036-3fea76dddd8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7bf52699-eb10-471a-ae2b-2d2260aa9ac2', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:12:37 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-3a82a61d-b19d-4939-9c3d-b9bba78e53d5 tempest-VolumesActionsTest-1285107848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f07f8541-0912-4a9e-a14a-1ce322c2187f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:12:37 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-3a82a61d-b19d-4939-9c3d-b9bba78e53d5 tempest-VolumesActionsTest-1285107848 None] Volume volume-7bf52699-eb10-471a-ae2b-2d2260aa9ac2 (7bf52699-eb10-471a-ae2b-2d2260aa9ac2): created successfully
Apr 10 13:12:37 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-3a82a61d-b19d-4939-9c3d-b9bba78e53d5 tempest-VolumesActionsTest-1285107848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f07f8541-0912-4a9e-a14a-1ce322c2187f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:12:37 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-3a82a61d-b19d-4939-9c3d-b9bba78e53d5 tempest-VolumesActionsTest-1285107848 None] Flow 'volume_create_manager' (ef40adbb-b51e-4b83-8a62-38ee6f336070) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:12:37 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-3a82a61d-b19d-4939-9c3d-b9bba78e53d5 tempest-VolumesActionsTest-1285107848 None] Created volume successfully.
Apr 10 13:12:37 devstack sudo[85715]: pam_unix(sudo:session): session closed for user root
Apr 10 13:12:37 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-afaa693b-78fd-43a9-9dd9-65521d71b230 tempest-VolumesTestJSON-23791933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-f399d506-a410-4df1-972e-4f77656cb8d0" returned: 0 in 0.597s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:12:37 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-afaa693b-78fd-43a9-9dd9-65521d71b230 tempest-VolumesTestJSON-23791933 None] Lock "cinder-quobyte-f399d506-a410-4df1-972e-4f77656cb8d0" released by "delete_volume" :: held 1.291s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:12:37 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-afaa693b-78fd-43a9-9dd9-65521d71b230 tempest-VolumesTestJSON-23791933 None] Created reservations ['431cb044-fd30-4ec6-b941-233d53796480', '84051905-4895-42f8-ba25-a90e4690fa27', '0f9bebdc-4333-4e77-b77c-4daa336eb9de', 'b79bbf8b-3772-4392-9b18-aa7b9c4fbc2c'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:12:37 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-afaa693b-78fd-43a9-9dd9-65521d71b230 tempest-VolumesTestJSON-23791933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:12:37 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-afaa693b-78fd-43a9-9dd9-65521d71b230 tempest-VolumesTestJSON-23791933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:12:37 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-afaa693b-78fd-43a9-9dd9-65521d71b230 tempest-VolumesTestJSON-23791933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:12:37 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-afaa693b-78fd-43a9-9dd9-65521d71b230 tempest-VolumesTestJSON-23791933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:12:37 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-afaa693b-78fd-43a9-9dd9-65521d71b230 tempest-VolumesTestJSON-23791933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:12:37 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-afaa693b-78fd-43a9-9dd9-65521d71b230 tempest-VolumesTestJSON-23791933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:12:37 devstack sudo[85717]: pam_unix(sudo:session): session closed for user root
Apr 10 13:12:37 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-2a4db75c-d012-40ec-97dd-a32b720cbb80 tempest-DeleteServersTestJSON-1566604493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-346c19a3-01d8-42ba-bb93-ca127c021ac6" returned: 0 in 0.625s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:12:37 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-2a4db75c-d012-40ec-97dd-a32b720cbb80 tempest-DeleteServersTestJSON-1566604493 None] Lock "cinder-quobyte-346c19a3-01d8-42ba-bb93-ca127c021ac6" released by "delete_volume" :: held 1.184s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:12:37 devstack sudo[85722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:12:37 devstack sudo[85722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:12:37 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-2a4db75c-d012-40ec-97dd-a32b720cbb80 tempest-DeleteServersTestJSON-1566604493 None] Created reservations ['5d73b97f-1061-4b94-b04e-21938a86e7d7', '617b2a23-0097-4fb9-a6be-a289377ba31d', 'c560d7d5-c497-45f7-95ac-9dd6605a4555', '6bd1df5f-ba87-46b8-8497-9974142a8b4e'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:12:37 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-2a4db75c-d012-40ec-97dd-a32b720cbb80 tempest-DeleteServersTestJSON-1566604493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:12:37 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-2a4db75c-d012-40ec-97dd-a32b720cbb80 tempest-DeleteServersTestJSON-1566604493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:12:37 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-2a4db75c-d012-40ec-97dd-a32b720cbb80 tempest-DeleteServersTestJSON-1566604493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:12:37 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-2a4db75c-d012-40ec-97dd-a32b720cbb80 tempest-DeleteServersTestJSON-1566604493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:12:37 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-2a4db75c-d012-40ec-97dd-a32b720cbb80 tempest-DeleteServersTestJSON-1566604493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:12:37 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-2a4db75c-d012-40ec-97dd-a32b720cbb80 tempest-DeleteServersTestJSON-1566604493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:12:37 devstack sudo[85724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:12:37 devstack sudo[85724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:12:37 devstack sudo[85722]: pam_unix(sudo:session): session closed for user root
Apr 10 13:12:37 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-afaa693b-78fd-43a9-9dd9-65521d71b230 tempest-VolumesTestJSON-23791933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.436s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:12:37 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-afaa693b-78fd-43a9-9dd9-65521d71b230 tempest-VolumesTestJSON-23791933 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:12:37 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-afaa693b-78fd-43a9-9dd9-65521d71b230 tempest-VolumesTestJSON-23791933 None] Deleted volume successfully.
Apr 10 13:12:37 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-afaa693b-78fd-43a9-9dd9-65521d71b230 tempest-VolumesTestJSON-23791933 None] Lock "cinder-f399d506-a410-4df1-972e-4f77656cb8d0-delete_volume" released by "delete_volume" :: held 1.867s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:12:37 devstack sudo[85724]: pam_unix(sudo:session): session closed for user root
Apr 10 13:12:37 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-2a4db75c-d012-40ec-97dd-a32b720cbb80 tempest-DeleteServersTestJSON-1566604493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.434s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:12:37 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-2a4db75c-d012-40ec-97dd-a32b720cbb80 tempest-DeleteServersTestJSON-1566604493 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:12:37 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-2a4db75c-d012-40ec-97dd-a32b720cbb80 tempest-DeleteServersTestJSON-1566604493 None] Deleted volume successfully.
Apr 10 13:12:37 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-2a4db75c-d012-40ec-97dd-a32b720cbb80 tempest-DeleteServersTestJSON-1566604493 None] Lock "cinder-346c19a3-01d8-42ba-bb93-ca127c021ac6-delete_volume" released by "delete_volume" :: held 1.738s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:12:38 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-32ab1e61-4342-4163-9a54-a6f1a3a78691 tempest-VolumesActionsTest-1285107848 None] Acquiring lock "cinder-7bf52699-eb10-471a-ae2b-2d2260aa9ac2" by "attach_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:12:38 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-32ab1e61-4342-4163-9a54-a6f1a3a78691 tempest-VolumesActionsTest-1285107848 None] Lock "cinder-7bf52699-eb10-471a-ae2b-2d2260aa9ac2" acquired by "attach_volume" :: waited 0.012s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:12:38 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-cd41a5ed-b068-4083-b0f3-5cab70759c6a tempest-VolumesTestJSON-23791933 None] Acquiring lock "cinder-df1ca2c6-4dbd-405e-8d33-be32a58f836c-delete_volume" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:12:38 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-cd41a5ed-b068-4083-b0f3-5cab70759c6a tempest-VolumesTestJSON-23791933 None] Lock "cinder-df1ca2c6-4dbd-405e-8d33-be32a58f836c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:12:38 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-32ab1e61-4342-4163-9a54-a6f1a3a78691 tempest-VolumesActionsTest-1285107848 None] Attaching volume 7bf52699-eb10-471a-ae2b-2d2260aa9ac2 to instance 2fcd5975-0104-425b-80d6-ee25517656ef at mountpoint /dev/vdb on host None.
Apr 10 13:12:38 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-32ab1e61-4342-4163-9a54-a6f1a3a78691 tempest-VolumesActionsTest-1285107848 None] Attach volume completed successfully.
Apr 10 13:12:38 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-32ab1e61-4342-4163-9a54-a6f1a3a78691 tempest-VolumesActionsTest-1285107848 None] Lock "cinder-7bf52699-eb10-471a-ae2b-2d2260aa9ac2" released by "attach_volume" :: held 0.110s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:12:38 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-cd41a5ed-b068-4083-b0f3-5cab70759c6a tempest-VolumesTestJSON-23791933 None] Acquiring lock "cinder-quobyte-df1ca2c6-4dbd-405e-8d33-be32a58f836c" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:12:38 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-cd41a5ed-b068-4083-b0f3-5cab70759c6a tempest-VolumesTestJSON-23791933 None] Lock "cinder-quobyte-df1ca2c6-4dbd-405e-8d33-be32a58f836c" acquired by "delete_volume" :: waited 0.010s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:12:38 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[e34580c6-ed05-4084-a8f6-ae9f010b82fe]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:12:38 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-cd41a5ed-b068-4083-b0f3-5cab70759c6a tempest-VolumesTestJSON-23791933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-df1ca2c6-4dbd-405e-8d33-be32a58f836c {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:12:38 devstack sudo[85728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-df1ca2c6-4dbd-405e-8d33-be32a58f836c
Apr 10 13:12:38 devstack sudo[85728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:12:38 devstack sudo[85728]: pam_unix(sudo:session): session closed for user root
Apr 10 13:12:38 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-cd41a5ed-b068-4083-b0f3-5cab70759c6a tempest-VolumesTestJSON-23791933 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-df1ca2c6-4dbd-405e-8d33-be32a58f836c" returned: 0 in 0.707s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:12:38 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-cd41a5ed-b068-4083-b0f3-5cab70759c6a tempest-VolumesTestJSON-23791933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-df1ca2c6-4dbd-405e-8d33-be32a58f836c {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:12:38 devstack sudo[85736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-df1ca2c6-4dbd-405e-8d33-be32a58f836c
Apr 10 13:12:38 devstack sudo[85736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:12:39 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-6ce6c02b-f4b8-4fd6-a5a0-1d8cdd5e6cd4 tempest-VolumesActionsTest-1102846807 None] Terminate volume connection completed successfully.
Apr 10 13:12:39 devstack sudo[85736]: pam_unix(sudo:session): session closed for user root
Apr 10 13:12:39 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-cd41a5ed-b068-4083-b0f3-5cab70759c6a tempest-VolumesTestJSON-23791933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-df1ca2c6-4dbd-405e-8d33-be32a58f836c" returned: 0 in 0.624s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:12:39 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-cd41a5ed-b068-4083-b0f3-5cab70759c6a tempest-VolumesTestJSON-23791933 None] Lock "cinder-quobyte-df1ca2c6-4dbd-405e-8d33-be32a58f836c" released by "delete_volume" :: held 1.364s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:12:39 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-cd41a5ed-b068-4083-b0f3-5cab70759c6a tempest-VolumesTestJSON-23791933 None] Created reservations ['178b58e7-2eb8-461b-b3c8-efd7a6aeedca', '83bbae37-3595-4b6b-b207-eab9ec92c1ce', '23bda0bd-36fe-4322-acd8-34a83248cad9', '49441e32-186e-48c9-9a9c-f6d0e61c5322'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:12:39 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-cd41a5ed-b068-4083-b0f3-5cab70759c6a tempest-VolumesTestJSON-23791933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:12:39 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-cd41a5ed-b068-4083-b0f3-5cab70759c6a tempest-VolumesTestJSON-23791933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:12:39 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-cd41a5ed-b068-4083-b0f3-5cab70759c6a tempest-VolumesTestJSON-23791933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:12:39 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-cd41a5ed-b068-4083-b0f3-5cab70759c6a tempest-VolumesTestJSON-23791933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:12:39 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-cd41a5ed-b068-4083-b0f3-5cab70759c6a tempest-VolumesTestJSON-23791933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:12:39 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-cd41a5ed-b068-4083-b0f3-5cab70759c6a tempest-VolumesTestJSON-23791933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:12:39 devstack sudo[85740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:12:39 devstack sudo[85740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:12:39 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-6ce6c02b-f4b8-4fd6-a5a0-1d8cdd5e6cd4 tempest-VolumesActionsTest-1102846807 None] Acquiring lock "cinder-7bf52699-eb10-471a-ae2b-2d2260aa9ac2-detach_volume" by "detach_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:12:39 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-6ce6c02b-f4b8-4fd6-a5a0-1d8cdd5e6cd4 tempest-VolumesActionsTest-1102846807 None] Lock "cinder-7bf52699-eb10-471a-ae2b-2d2260aa9ac2-detach_volume" acquired by "detach_volume" :: waited 0.017s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:12:39 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-6ce6c02b-f4b8-4fd6-a5a0-1d8cdd5e6cd4 tempest-VolumesActionsTest-1102846807 None] Detaching volume 7bf52699-eb10-471a-ae2b-2d2260aa9ac2 from instance 2fcd5975-0104-425b-80d6-ee25517656ef.
Apr 10 13:12:39 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-6ce6c02b-f4b8-4fd6-a5a0-1d8cdd5e6cd4 tempest-VolumesActionsTest-1102846807 None] Detach volume completed successfully.
Apr 10 13:12:39 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-6ce6c02b-f4b8-4fd6-a5a0-1d8cdd5e6cd4 tempest-VolumesActionsTest-1102846807 None] Lock "cinder-7bf52699-eb10-471a-ae2b-2d2260aa9ac2-detach_volume" released by "detach_volume" :: held 0.098s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:12:40 devstack sudo[85740]: pam_unix(sudo:session): session closed for user root
Apr 10 13:12:40 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-cd41a5ed-b068-4083-b0f3-5cab70759c6a tempest-VolumesTestJSON-23791933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.586s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:12:40 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-cd41a5ed-b068-4083-b0f3-5cab70759c6a tempest-VolumesTestJSON-23791933 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:12:40 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-cd41a5ed-b068-4083-b0f3-5cab70759c6a tempest-VolumesTestJSON-23791933 None] Deleted volume successfully.
Apr 10 13:12:40 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-cd41a5ed-b068-4083-b0f3-5cab70759c6a tempest-VolumesTestJSON-23791933 None] Lock "cinder-df1ca2c6-4dbd-405e-8d33-be32a58f836c-delete_volume" released by "delete_volume" :: held 2.142s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:12:40 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-0a5667e0-d48f-48f9-8d5a-bdd98235976f tempest-VolumesActionsTest-1285107848 None] Acquiring lock "cinder-7bf52699-eb10-471a-ae2b-2d2260aa9ac2-detach_volume" by "detach_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:12:40 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-0a5667e0-d48f-48f9-8d5a-bdd98235976f tempest-VolumesActionsTest-1285107848 None] Lock "cinder-7bf52699-eb10-471a-ae2b-2d2260aa9ac2-detach_volume" acquired by "detach_volume" :: waited 0.019s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:12:40 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-0a5667e0-d48f-48f9-8d5a-bdd98235976f tempest-VolumesActionsTest-1285107848 None] Volume detach called, but volume not attached.
Apr 10 13:12:40 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-0a5667e0-d48f-48f9-8d5a-bdd98235976f tempest-VolumesActionsTest-1285107848 None] Lock "cinder-7bf52699-eb10-471a-ae2b-2d2260aa9ac2-detach_volume" released by "detach_volume" :: held 0.032s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:12:41 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-060f8562-f751-4f6b-b726-d29bf5bbac25 tempest-VolumesActionsTest-1285107848 None] Acquiring lock "cinder-7bf52699-eb10-471a-ae2b-2d2260aa9ac2-delete_volume" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:12:41 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-060f8562-f751-4f6b-b726-d29bf5bbac25 tempest-VolumesActionsTest-1285107848 None] Lock "cinder-7bf52699-eb10-471a-ae2b-2d2260aa9ac2-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:12:41 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-060f8562-f751-4f6b-b726-d29bf5bbac25 tempest-VolumesActionsTest-1285107848 None] Acquiring lock "cinder-quobyte-7bf52699-eb10-471a-ae2b-2d2260aa9ac2" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:12:41 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-060f8562-f751-4f6b-b726-d29bf5bbac25 tempest-VolumesActionsTest-1285107848 None] Lock "cinder-quobyte-7bf52699-eb10-471a-ae2b-2d2260aa9ac2" acquired by "delete_volume" :: waited 0.009s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:12:41 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c64c853-3c50-4c92-b0ed-40ec19484627]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:12:41 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-060f8562-f751-4f6b-b726-d29bf5bbac25 tempest-VolumesActionsTest-1285107848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7bf52699-eb10-471a-ae2b-2d2260aa9ac2 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:12:41 devstack sudo[85771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7bf52699-eb10-471a-ae2b-2d2260aa9ac2
Apr 10 13:12:41 devstack sudo[85771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:12:42 devstack sudo[85771]: pam_unix(sudo:session): session closed for user root
Apr 10 13:12:42 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-060f8562-f751-4f6b-b726-d29bf5bbac25 tempest-VolumesActionsTest-1285107848 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7bf52699-eb10-471a-ae2b-2d2260aa9ac2" returned: 0 in 1.273s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:12:42 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-060f8562-f751-4f6b-b726-d29bf5bbac25 tempest-VolumesActionsTest-1285107848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7bf52699-eb10-471a-ae2b-2d2260aa9ac2 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:12:43 devstack sudo[85778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7bf52699-eb10-471a-ae2b-2d2260aa9ac2
Apr 10 13:12:43 devstack sudo[85778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:12:44 devstack sudo[85778]: pam_unix(sudo:session): session closed for user root
Apr 10 13:12:44 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-060f8562-f751-4f6b-b726-d29bf5bbac25 tempest-VolumesActionsTest-1285107848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7bf52699-eb10-471a-ae2b-2d2260aa9ac2" returned: 0 in 1.033s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:12:44 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-060f8562-f751-4f6b-b726-d29bf5bbac25 tempest-VolumesActionsTest-1285107848 None] Lock "cinder-quobyte-7bf52699-eb10-471a-ae2b-2d2260aa9ac2" released by "delete_volume" :: held 2.399s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:12:44 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-060f8562-f751-4f6b-b726-d29bf5bbac25 tempest-VolumesActionsTest-1285107848 None] Created reservations ['b03dae20-3f0b-471e-b1e8-9b59f0dde026', '4482435e-820b-4d12-8d7c-dd0ce9e6f5e2', 'a45b25fa-0876-4c42-b884-dbb7fafbe692', 'd4ef2c57-6f29-496c-b1c4-dd8be0a7df45'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:12:44 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-060f8562-f751-4f6b-b726-d29bf5bbac25 tempest-VolumesActionsTest-1285107848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:12:44 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-060f8562-f751-4f6b-b726-d29bf5bbac25 tempest-VolumesActionsTest-1285107848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:12:44 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-060f8562-f751-4f6b-b726-d29bf5bbac25 tempest-VolumesActionsTest-1285107848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:12:44 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-060f8562-f751-4f6b-b726-d29bf5bbac25 tempest-VolumesActionsTest-1285107848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:12:44 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-060f8562-f751-4f6b-b726-d29bf5bbac25 tempest-VolumesActionsTest-1285107848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:12:44 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-060f8562-f751-4f6b-b726-d29bf5bbac25 tempest-VolumesActionsTest-1285107848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:12:44 devstack sudo[85783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:12:44 devstack sudo[85783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:12:45 devstack sudo[85783]: pam_unix(sudo:session): session closed for user root
Apr 10 13:12:45 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-060f8562-f751-4f6b-b726-d29bf5bbac25 tempest-VolumesActionsTest-1285107848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 1.334s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:12:45 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-060f8562-f751-4f6b-b726-d29bf5bbac25 tempest-VolumesActionsTest-1285107848 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:12:45 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-060f8562-f751-4f6b-b726-d29bf5bbac25 tempest-VolumesActionsTest-1285107848 None] Deleted volume successfully.
Apr 10 13:12:45 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-060f8562-f751-4f6b-b726-d29bf5bbac25 tempest-VolumesActionsTest-1285107848 None] Lock "cinder-7bf52699-eb10-471a-ae2b-2d2260aa9ac2-delete_volume" released by "delete_volume" :: held 3.997s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:12:46 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-b95f4a77-9118-45d1-b0e6-1063d1408888 tempest-GroupsV314Test-310932252 None] Group tempest-GroupsV314Test-Group-1602909047: creating
Apr 10 13:12:46 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-b95f4a77-9118-45d1-b0e6-1063d1408888 tempest-GroupsV314Test-310932252 None] Group tempest-GroupsV314Test-Group-1602909047: created successfully
Apr 10 13:12:46 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-b95f4a77-9118-45d1-b0e6-1063d1408888 tempest-GroupsV314Test-310932252 None] Create group completed successfully.
Apr 10 13:12:46 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [req-5dddb4b2-b161-420f-9e16-77851ccc3784 req-4e623ced-db03-4da4-991b-35fbb5a85dcb tempest-VolumesSnapshotsTestJSON-996193881 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:12:46 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [req-5dddb4b2-b161-420f-9e16-77851ccc3784 req-4e623ced-db03-4da4-991b-35fbb5a85dcb tempest-VolumesSnapshotsTestJSON-996193881 None] Flow 'volume_create_manager' (b04da3bf-2015-4ec6-a5a2-7c9b829f0f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:12:46 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [req-5dddb4b2-b161-420f-9e16-77851ccc3784 req-4e623ced-db03-4da4-991b-35fbb5a85dcb tempest-VolumesSnapshotsTestJSON-996193881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b109203f-4259-4f65-828a-81969876bc46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:12:46 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [req-5dddb4b2-b161-420f-9e16-77851ccc3784 req-4e623ced-db03-4da4-991b-35fbb5a85dcb tempest-VolumesSnapshotsTestJSON-996193881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b109203f-4259-4f65-828a-81969876bc46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:12:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-176383825',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=239818a9-9edf-4ca7-bfc1-26fcdd644c1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa405a75363d48c5b29657b58fb8490e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:12:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:12:47Z,use_quota=True,user_id='6ed1e405648c41118f77adf61c748cd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:12:46 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [req-5dddb4b2-b161-420f-9e16-77851ccc3784 req-4e623ced-db03-4da4-991b-35fbb5a85dcb tempest-VolumesSnapshotsTestJSON-996193881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1436d32b-06a4-465b-8075-2e12ca983e2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:12:46 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [req-5dddb4b2-b161-420f-9e16-77851ccc3784 req-4e623ced-db03-4da4-991b-35fbb5a85dcb tempest-VolumesSnapshotsTestJSON-996193881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1436d32b-06a4-465b-8075-2e12ca983e2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:12:46 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [req-5dddb4b2-b161-420f-9e16-77851ccc3784 req-4e623ced-db03-4da4-991b-35fbb5a85dcb tempest-VolumesSnapshotsTestJSON-996193881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c79b2a9a-720e-493b-9701-ec99dcafd80a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:12:46 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [req-5dddb4b2-b161-420f-9e16-77851ccc3784 req-4e623ced-db03-4da4-991b-35fbb5a85dcb tempest-VolumesSnapshotsTestJSON-996193881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c79b2a9a-720e-493b-9701-ec99dcafd80a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '239818a9-9edf-4ca7-bfc1-26fcdd644c1a', 'volume_name': 'volume-239818a9-9edf-4ca7-bfc1-26fcdd644c1a', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:12:46 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [req-5dddb4b2-b161-420f-9e16-77851ccc3784 req-4e623ced-db03-4da4-991b-35fbb5a85dcb tempest-VolumesSnapshotsTestJSON-996193881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ead3f5e-078e-4f0c-a53a-25d14f989fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:12:46 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [req-5dddb4b2-b161-420f-9e16-77851ccc3784 req-4e623ced-db03-4da4-991b-35fbb5a85dcb tempest-VolumesSnapshotsTestJSON-996193881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ead3f5e-078e-4f0c-a53a-25d14f989fe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:12:46 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [req-5dddb4b2-b161-420f-9e16-77851ccc3784 req-4e623ced-db03-4da4-991b-35fbb5a85dcb tempest-VolumesSnapshotsTestJSON-996193881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2baf8cb5-1bde-469f-8546-b107ebfb2d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:12:46 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [req-5dddb4b2-b161-420f-9e16-77851ccc3784 req-4e623ced-db03-4da4-991b-35fbb5a85dcb tempest-VolumesSnapshotsTestJSON-996193881 None] Volume 239818a9-9edf-4ca7-bfc1-26fcdd644c1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-239818a9-9edf-4ca7-bfc1-26fcdd644c1a', 'volume_size': 1}
Apr 10 13:12:46 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [req-5dddb4b2-b161-420f-9e16-77851ccc3784 req-4e623ced-db03-4da4-991b-35fbb5a85dcb tempest-VolumesSnapshotsTestJSON-996193881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:12:46 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [req-5dddb4b2-b161-420f-9e16-77851ccc3784 req-4e623ced-db03-4da4-991b-35fbb5a85dcb tempest-VolumesSnapshotsTestJSON-996193881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:12:46 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [req-5dddb4b2-b161-420f-9e16-77851ccc3784 req-4e623ced-db03-4da4-991b-35fbb5a85dcb tempest-VolumesSnapshotsTestJSON-996193881 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f252bf08b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:12:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-176383825',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=239818a9-9edf-4ca7-bfc1-26fcdd644c1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa405a75363d48c5b29657b58fb8490e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:12:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:12:47Z,use_quota=True,user_id='6ed1e405648c41118f77adf61c748cd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)}" {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 13:12:46 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [req-5dddb4b2-b161-420f-9e16-77851ccc3784 req-4e623ced-db03-4da4-991b-35fbb5a85dcb tempest-VolumesSnapshotsTestJSON-996193881 None] Creating volume 239818a9-9edf-4ca7-bfc1-26fcdd644c1a {{(pid=83345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 13:12:46 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [req-5dddb4b2-b161-420f-9e16-77851ccc3784 req-4e623ced-db03-4da4-991b-35fbb5a85dcb tempest-VolumesSnapshotsTestJSON-996193881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:12:46 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [req-5dddb4b2-b161-420f-9e16-77851ccc3784 req-4e623ced-db03-4da4-991b-35fbb5a85dcb tempest-VolumesSnapshotsTestJSON-996193881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:12:46 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [req-5dddb4b2-b161-420f-9e16-77851ccc3784 req-4e623ced-db03-4da4-991b-35fbb5a85dcb tempest-VolumesSnapshotsTestJSON-996193881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:12:46 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [req-5dddb4b2-b161-420f-9e16-77851ccc3784 req-4e623ced-db03-4da4-991b-35fbb5a85dcb tempest-VolumesSnapshotsTestJSON-996193881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:12:46 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [req-5dddb4b2-b161-420f-9e16-77851ccc3784 req-4e623ced-db03-4da4-991b-35fbb5a85dcb tempest-VolumesSnapshotsTestJSON-996193881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:12:46 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [req-5dddb4b2-b161-420f-9e16-77851ccc3784 req-4e623ced-db03-4da4-991b-35fbb5a85dcb tempest-VolumesSnapshotsTestJSON-996193881 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:12:46 devstack cinder-volume[83345]: INFO cinder.volume.drivers.remotefs [req-5dddb4b2-b161-420f-9e16-77851ccc3784 req-4e623ced-db03-4da4-991b-35fbb5a85dcb tempest-VolumesSnapshotsTestJSON-996193881 None] casted to osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331
Apr 10 13:12:46 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [req-5dddb4b2-b161-420f-9e16-77851ccc3784 req-4e623ced-db03-4da4-991b-35fbb5a85dcb tempest-VolumesSnapshotsTestJSON-996193881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-239818a9-9edf-4ca7-bfc1-26fcdd644c1a 1073741824 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:12:46 devstack sudo[85814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-239818a9-9edf-4ca7-bfc1-26fcdd644c1a 1073741824
Apr 10 13:12:46 devstack sudo[85814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:12:47 devstack sudo[85814]: pam_unix(sudo:session): session closed for user root
Apr 10 13:12:47 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [req-5dddb4b2-b161-420f-9e16-77851ccc3784 req-4e623ced-db03-4da4-991b-35fbb5a85dcb tempest-VolumesSnapshotsTestJSON-996193881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-239818a9-9edf-4ca7-bfc1-26fcdd644c1a 1073741824" returned: 0 in 0.556s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:12:47 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [req-5dddb4b2-b161-420f-9e16-77851ccc3784 req-4e623ced-db03-4da4-991b-35fbb5a85dcb tempest-VolumesSnapshotsTestJSON-996193881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-239818a9-9edf-4ca7-bfc1-26fcdd644c1a {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:12:47 devstack sudo[85820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-239818a9-9edf-4ca7-bfc1-26fcdd644c1a
Apr 10 13:12:47 devstack sudo[85820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:12:47 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bf6d8c2-190a-4612-9c39-4d99070c0f06 tempest-GroupsV314Test-310932252 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:12:47 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-0bf6d8c2-190a-4612-9c39-4d99070c0f06 tempest-GroupsV314Test-310932252 None] Flow 'volume_create_manager' (395dbdab-c0c9-41e4-94ef-0914b21ec8fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:12:47 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-0bf6d8c2-190a-4612-9c39-4d99070c0f06 tempest-GroupsV314Test-310932252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9931a82d-b0df-4ea9-b3c9-c68f5992f9f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:12:47 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-0bf6d8c2-190a-4612-9c39-4d99070c0f06 tempest-GroupsV314Test-310932252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9931a82d-b0df-4ea9-b3c9-c68f5992f9f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:12:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-325830001',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=7bec7f31-f795-4bbe-8ea6-d3b82a1cd810,host='devstack@QuobyteHD#QuobyteHD',id=dbef070b-24cb-4709-9169-a655fafa334c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebac895f3d044cd6a0768b309213f1a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:12:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:12:48Z,use_quota=True,user_id='d23a7482fd0c4b39a8affab1da80a97a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7875f2ad-8c6e-48ba-93d0-c989057a29f5),volume_type_id=7875f2ad-8c6e-48ba-93d0-c989057a29f5)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:12:47 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-0bf6d8c2-190a-4612-9c39-4d99070c0f06 tempest-GroupsV314Test-310932252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7326f848-2066-4685-8287-bcd604b7d545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:12:47 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-0bf6d8c2-190a-4612-9c39-4d99070c0f06 tempest-GroupsV314Test-310932252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7326f848-2066-4685-8287-bcd604b7d545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:12:47 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-0bf6d8c2-190a-4612-9c39-4d99070c0f06 tempest-GroupsV314Test-310932252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b7d9b3e-edf6-439f-b775-a4ce21a3f362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:12:47 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-0bf6d8c2-190a-4612-9c39-4d99070c0f06 tempest-GroupsV314Test-310932252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b7d9b3e-edf6-439f-b775-a4ce21a3f362) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbef070b-24cb-4709-9169-a655fafa334c', 'volume_name': 'volume-dbef070b-24cb-4709-9169-a655fafa334c', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:12:47 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-0bf6d8c2-190a-4612-9c39-4d99070c0f06 tempest-GroupsV314Test-310932252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d0d6e17-356a-4069-8524-3336030393d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:12:47 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-0bf6d8c2-190a-4612-9c39-4d99070c0f06 tempest-GroupsV314Test-310932252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d0d6e17-356a-4069-8524-3336030393d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:12:47 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-0bf6d8c2-190a-4612-9c39-4d99070c0f06 tempest-GroupsV314Test-310932252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61b04710-9902-429d-9f03-f41e33514a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:12:47 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-0bf6d8c2-190a-4612-9c39-4d99070c0f06 tempest-GroupsV314Test-310932252 None] Volume dbef070b-24cb-4709-9169-a655fafa334c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbef070b-24cb-4709-9169-a655fafa334c', 'volume_size': 1}
Apr 10 13:12:47 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-0bf6d8c2-190a-4612-9c39-4d99070c0f06 tempest-GroupsV314Test-310932252 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:12:47 devstack sudo[85820]: pam_unix(sudo:session): session closed for user root
Apr 10 13:12:47 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [req-5dddb4b2-b161-420f-9e16-77851ccc3784 req-4e623ced-db03-4da4-991b-35fbb5a85dcb tempest-VolumesSnapshotsTestJSON-996193881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-239818a9-9edf-4ca7-bfc1-26fcdd644c1a" returned: 0 in 0.528s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:12:47 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [req-5dddb4b2-b161-420f-9e16-77851ccc3784 req-4e623ced-db03-4da4-991b-35fbb5a85dcb tempest-VolumesSnapshotsTestJSON-996193881 None] <== create_volume: return (1114ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'} {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 13:12:47 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [req-5dddb4b2-b161-420f-9e16-77851ccc3784 req-4e623ced-db03-4da4-991b-35fbb5a85dcb tempest-VolumesSnapshotsTestJSON-996193881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.117s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:12:47 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-0bf6d8c2-190a-4612-9c39-4d99070c0f06 tempest-GroupsV314Test-310932252 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.072s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:12:47 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-0bf6d8c2-190a-4612-9c39-4d99070c0f06 tempest-GroupsV314Test-310932252 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f252bf08b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=7bec7f31-f795-4bbe-8ea6-d3b82a1cd810,created_at=2026-04-10T11:12:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-325830001',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=7bec7f31-f795-4bbe-8ea6-d3b82a1cd810,host='devstack@QuobyteHD#QuobyteHD',id=dbef070b-24cb-4709-9169-a655fafa334c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebac895f3d044cd6a0768b309213f1a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:12:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:12:48Z,use_quota=True,user_id='d23a7482fd0c4b39a8affab1da80a97a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7875f2ad-8c6e-48ba-93d0-c989057a29f5),volume_type_id=7875f2ad-8c6e-48ba-93d0-c989057a29f5)}" {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 13:12:47 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-0bf6d8c2-190a-4612-9c39-4d99070c0f06 tempest-GroupsV314Test-310932252 None] Creating volume dbef070b-24cb-4709-9169-a655fafa334c {{(pid=83345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 13:12:47 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-0bf6d8c2-190a-4612-9c39-4d99070c0f06 tempest-GroupsV314Test-310932252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:12:47 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-0bf6d8c2-190a-4612-9c39-4d99070c0f06 tempest-GroupsV314Test-310932252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:12:47 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-0bf6d8c2-190a-4612-9c39-4d99070c0f06 tempest-GroupsV314Test-310932252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:12:47 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-0bf6d8c2-190a-4612-9c39-4d99070c0f06 tempest-GroupsV314Test-310932252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:12:47 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-0bf6d8c2-190a-4612-9c39-4d99070c0f06 tempest-GroupsV314Test-310932252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:12:47 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-0bf6d8c2-190a-4612-9c39-4d99070c0f06 tempest-GroupsV314Test-310932252 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:12:47 devstack cinder-volume[83345]: INFO cinder.volume.drivers.remotefs [None req-0bf6d8c2-190a-4612-9c39-4d99070c0f06 tempest-GroupsV314Test-310932252 None] casted to osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331
Apr 10 13:12:47 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-0bf6d8c2-190a-4612-9c39-4d99070c0f06 tempest-GroupsV314Test-310932252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-dbef070b-24cb-4709-9169-a655fafa334c 1073741824 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:12:47 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [req-5dddb4b2-b161-420f-9e16-77851ccc3784 req-4e623ced-db03-4da4-991b-35fbb5a85dcb tempest-VolumesSnapshotsTestJSON-996193881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2baf8cb5-1bde-469f-8546-b107ebfb2d41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-239818a9-9edf-4ca7-bfc1-26fcdd644c1a', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:12:47 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [req-5dddb4b2-b161-420f-9e16-77851ccc3784 req-4e623ced-db03-4da4-991b-35fbb5a85dcb tempest-VolumesSnapshotsTestJSON-996193881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (863fe50f-1b64-46af-a8fb-70cd5296036d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:12:47 devstack sudo[85824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-dbef070b-24cb-4709-9169-a655fafa334c 1073741824
Apr 10 13:12:47 devstack sudo[85824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:12:47 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [req-5dddb4b2-b161-420f-9e16-77851ccc3784 req-4e623ced-db03-4da4-991b-35fbb5a85dcb tempest-VolumesSnapshotsTestJSON-996193881 None] Volume volume-239818a9-9edf-4ca7-bfc1-26fcdd644c1a (239818a9-9edf-4ca7-bfc1-26fcdd644c1a): created successfully
Apr 10 13:12:47 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [req-5dddb4b2-b161-420f-9e16-77851ccc3784 req-4e623ced-db03-4da4-991b-35fbb5a85dcb tempest-VolumesSnapshotsTestJSON-996193881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (863fe50f-1b64-46af-a8fb-70cd5296036d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:12:47 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [req-5dddb4b2-b161-420f-9e16-77851ccc3784 req-4e623ced-db03-4da4-991b-35fbb5a85dcb tempest-VolumesSnapshotsTestJSON-996193881 None] Flow 'volume_create_manager' (b04da3bf-2015-4ec6-a5a2-7c9b829f0f86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:12:47 devstack cinder-volume[83345]: INFO cinder.volume.manager [req-5dddb4b2-b161-420f-9e16-77851ccc3784 req-4e623ced-db03-4da4-991b-35fbb5a85dcb tempest-VolumesSnapshotsTestJSON-996193881 None] Created volume successfully.
Apr 10 13:12:48 devstack sudo[85824]: pam_unix(sudo:session): session closed for user root
Apr 10 13:12:48 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-0bf6d8c2-190a-4612-9c39-4d99070c0f06 tempest-GroupsV314Test-310932252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-dbef070b-24cb-4709-9169-a655fafa334c 1073741824" returned: 0 in 0.627s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:12:48 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-0bf6d8c2-190a-4612-9c39-4d99070c0f06 tempest-GroupsV314Test-310932252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-dbef070b-24cb-4709-9169-a655fafa334c {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:12:48 devstack sudo[85854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-dbef070b-24cb-4709-9169-a655fafa334c
Apr 10 13:12:48 devstack sudo[85854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:12:48 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [req-797e2082-ca0c-4085-bfbc-19186a6f6f2d req-82a3dee3-3a52-4cd2-81c5-3f8f3c438828 tempest-VolumesSnapshotsTestJSON-996193881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:12:49 devstack sudo[85854]: pam_unix(sudo:session): session closed for user root
Apr 10 13:12:49 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-0bf6d8c2-190a-4612-9c39-4d99070c0f06 tempest-GroupsV314Test-310932252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-dbef070b-24cb-4709-9169-a655fafa334c" returned: 0 in 0.520s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:12:49 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-0bf6d8c2-190a-4612-9c39-4d99070c0f06 tempest-GroupsV314Test-310932252 None] <== create_volume: return (1175ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'} {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 13:12:49 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-0bf6d8c2-190a-4612-9c39-4d99070c0f06 tempest-GroupsV314Test-310932252 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.178s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:12:49 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [req-797e2082-ca0c-4085-bfbc-19186a6f6f2d req-82a3dee3-3a52-4cd2-81c5-3f8f3c438828 tempest-VolumesSnapshotsTestJSON-996193881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.026s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:12:49 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-0bf6d8c2-190a-4612-9c39-4d99070c0f06 tempest-GroupsV314Test-310932252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61b04710-9902-429d-9f03-f41e33514a6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbef070b-24cb-4709-9169-a655fafa334c', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:12:49 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-0bf6d8c2-190a-4612-9c39-4d99070c0f06 tempest-GroupsV314Test-310932252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f32449d0-281b-42e3-b6e6-b4a6f38470a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:12:49 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [req-797e2082-ca0c-4085-bfbc-19186a6f6f2d req-82a3dee3-3a52-4cd2-81c5-3f8f3c438828 tempest-VolumesSnapshotsTestJSON-996193881 None] Creating offline snapshot 0607e8a4-875c-4fc9-926e-580580cb2e36 of volume 239818a9-9edf-4ca7-bfc1-26fcdd644c1a {{(pid=83345) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 10 13:12:49 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[23a87fcc-0097-4613-8b25-94588d5a05a1]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:12:49 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [req-797e2082-ca0c-4085-bfbc-19186a6f6f2d req-82a3dee3-3a52-4cd2-81c5-3f8f3c438828 tempest-VolumesSnapshotsTestJSON-996193881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-239818a9-9edf-4ca7-bfc1-26fcdd644c1a {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:12:49 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-0bf6d8c2-190a-4612-9c39-4d99070c0f06 tempest-GroupsV314Test-310932252 None] Volume volume-dbef070b-24cb-4709-9169-a655fafa334c (dbef070b-24cb-4709-9169-a655fafa334c): created successfully
Apr 10 13:12:49 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-0bf6d8c2-190a-4612-9c39-4d99070c0f06 tempest-GroupsV314Test-310932252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f32449d0-281b-42e3-b6e6-b4a6f38470a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:12:49 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-0bf6d8c2-190a-4612-9c39-4d99070c0f06 tempest-GroupsV314Test-310932252 None] Flow 'volume_create_manager' (395dbdab-c0c9-41e4-94ef-0914b21ec8fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:12:49 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-0bf6d8c2-190a-4612-9c39-4d99070c0f06 tempest-GroupsV314Test-310932252 None] Created volume successfully.
Apr 10 13:12:49 devstack sudo[85859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-239818a9-9edf-4ca7-bfc1-26fcdd644c1a
Apr 10 13:12:49 devstack sudo[85859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:12:49 devstack sudo[85859]: pam_unix(sudo:session): session closed for user root
Apr 10 13:12:49 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [req-797e2082-ca0c-4085-bfbc-19186a6f6f2d req-82a3dee3-3a52-4cd2-81c5-3f8f3c438828 tempest-VolumesSnapshotsTestJSON-996193881 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-239818a9-9edf-4ca7-bfc1-26fcdd644c1a" returned: 0 in 0.508s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:12:49 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [req-797e2082-ca0c-4085-bfbc-19186a6f6f2d req-82a3dee3-3a52-4cd2-81c5-3f8f3c438828 tempest-VolumesSnapshotsTestJSON-996193881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-239818a9-9edf-4ca7-bfc1-26fcdd644c1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-239818a9-9edf-4ca7-bfc1-26fcdd644c1a.0607e8a4-875c-4fc9-926e-580580cb2e36 1G {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:12:49 devstack sudo[85864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-239818a9-9edf-4ca7-bfc1-26fcdd644c1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-239818a9-9edf-4ca7-bfc1-26fcdd644c1a.0607e8a4-875c-4fc9-926e-580580cb2e36 1G
Apr 10 13:12:49 devstack sudo[85864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:12:50 devstack sudo[85864]: pam_unix(sudo:session): session closed for user root
Apr 10 13:12:50 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [req-797e2082-ca0c-4085-bfbc-19186a6f6f2d req-82a3dee3-3a52-4cd2-81c5-3f8f3c438828 tempest-VolumesSnapshotsTestJSON-996193881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-239818a9-9edf-4ca7-bfc1-26fcdd644c1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-239818a9-9edf-4ca7-bfc1-26fcdd644c1a.0607e8a4-875c-4fc9-926e-580580cb2e36 1G" returned: 0 in 0.516s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:12:50 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [req-797e2082-ca0c-4085-bfbc-19186a6f6f2d req-82a3dee3-3a52-4cd2-81c5-3f8f3c438828 tempest-VolumesSnapshotsTestJSON-996193881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-239818a9-9edf-4ca7-bfc1-26fcdd644c1a -F qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-239818a9-9edf-4ca7-bfc1-26fcdd644c1a.0607e8a4-875c-4fc9-926e-580580cb2e36 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:12:50 devstack sudo[85880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-239818a9-9edf-4ca7-bfc1-26fcdd644c1a -F qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-239818a9-9edf-4ca7-bfc1-26fcdd644c1a.0607e8a4-875c-4fc9-926e-580580cb2e36
Apr 10 13:12:50 devstack sudo[85880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:12:50 devstack sudo[85880]: pam_unix(sudo:session): session closed for user root
Apr 10 13:12:50 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [req-797e2082-ca0c-4085-bfbc-19186a6f6f2d req-82a3dee3-3a52-4cd2-81c5-3f8f3c438828 tempest-VolumesSnapshotsTestJSON-996193881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-239818a9-9edf-4ca7-bfc1-26fcdd644c1a -F qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-239818a9-9edf-4ca7-bfc1-26fcdd644c1a.0607e8a4-875c-4fc9-926e-580580cb2e36" returned: 0 in 0.472s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:12:50 devstack cinder-volume[83345]: WARNING cinder.volume.drivers.remotefs [req-797e2082-ca0c-4085-bfbc-19186a6f6f2d req-82a3dee3-3a52-4cd2-81c5-3f8f3c438828 tempest-VolumesSnapshotsTestJSON-996193881 None] /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-239818a9-9edf-4ca7-bfc1-26fcdd644c1a.0607e8a4-875c-4fc9-926e-580580cb2e36 is being set with open permissions: ugo+rw
Apr 10 13:12:50 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [req-797e2082-ca0c-4085-bfbc-19186a6f6f2d req-82a3dee3-3a52-4cd2-81c5-3f8f3c438828 tempest-VolumesSnapshotsTestJSON-996193881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-239818a9-9edf-4ca7-bfc1-26fcdd644c1a.0607e8a4-875c-4fc9-926e-580580cb2e36 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:12:50 devstack sudo[85893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-239818a9-9edf-4ca7-bfc1-26fcdd644c1a.0607e8a4-875c-4fc9-926e-580580cb2e36
Apr 10 13:12:50 devstack sudo[85893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:12:50 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-e4bbf628-386e-4716-a020-f4eac077c407 tempest-GroupsV314Test-310932252 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:12:50 devstack sudo[85893]: pam_unix(sudo:session): session closed for user root
Apr 10 13:12:50 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [req-797e2082-ca0c-4085-bfbc-19186a6f6f2d req-82a3dee3-3a52-4cd2-81c5-3f8f3c438828 tempest-VolumesSnapshotsTestJSON-996193881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-239818a9-9edf-4ca7-bfc1-26fcdd644c1a.0607e8a4-875c-4fc9-926e-580580cb2e36" returned: 0 in 0.417s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:12:51 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [req-797e2082-ca0c-4085-bfbc-19186a6f6f2d req-82a3dee3-3a52-4cd2-81c5-3f8f3c438828 tempest-VolumesSnapshotsTestJSON-996193881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-239818a9-9edf-4ca7-bfc1-26fcdd644c1a.info {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:12:51 devstack sudo[85896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-239818a9-9edf-4ca7-bfc1-26fcdd644c1a.info
Apr 10 13:12:51 devstack sudo[85896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:12:51 devstack sudo[85896]: pam_unix(sudo:session): session closed for user root
Apr 10 13:12:51 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [req-797e2082-ca0c-4085-bfbc-19186a6f6f2d req-82a3dee3-3a52-4cd2-81c5-3f8f3c438828 tempest-VolumesSnapshotsTestJSON-996193881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-239818a9-9edf-4ca7-bfc1-26fcdd644c1a.info" returned: 0 in 0.424s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:12:51 devstack cinder-volume[83345]: WARNING cinder.volume.drivers.remotefs [req-797e2082-ca0c-4085-bfbc-19186a6f6f2d req-82a3dee3-3a52-4cd2-81c5-3f8f3c438828 tempest-VolumesSnapshotsTestJSON-996193881 None] /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-239818a9-9edf-4ca7-bfc1-26fcdd644c1a.info is being set with open permissions: ugo+rw
Apr 10 13:12:51 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [req-797e2082-ca0c-4085-bfbc-19186a6f6f2d req-82a3dee3-3a52-4cd2-81c5-3f8f3c438828 tempest-VolumesSnapshotsTestJSON-996193881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-239818a9-9edf-4ca7-bfc1-26fcdd644c1a.info {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:12:51 devstack sudo[85900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-239818a9-9edf-4ca7-bfc1-26fcdd644c1a.info
Apr 10 13:12:51 devstack sudo[85900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:12:51 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-00cf8578-049c-4ae4-bc1f-04a52dd69d86 tempest-VolumesActionsTest-1285107848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:12:51 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-00cf8578-049c-4ae4-bc1f-04a52dd69d86 tempest-VolumesActionsTest-1285107848 None] Flow 'volume_create_manager' (c518c272-90e1-4a0a-b02c-ec9000f91d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:12:51 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-00cf8578-049c-4ae4-bc1f-04a52dd69d86 tempest-VolumesActionsTest-1285107848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce3645b6-5fe4-4974-a008-9ef75b2f77e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:12:51 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-00cf8578-049c-4ae4-bc1f-04a52dd69d86 tempest-VolumesActionsTest-1285107848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce3645b6-5fe4-4974-a008-9ef75b2f77e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:12:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1903165308',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9d0cc9a-c512-4ae0-b472-846c6dbc37f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2551b2b6cd9f4994a93b4b15e32392da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:12:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:12:52Z,use_quota=True,user_id='aa1e9a5c093744c0a889c58c163c8c1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:12:51 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-00cf8578-049c-4ae4-bc1f-04a52dd69d86 tempest-VolumesActionsTest-1285107848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (862669c1-8f1f-4ce6-affd-b3956eac6247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:12:51 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-00cf8578-049c-4ae4-bc1f-04a52dd69d86 tempest-VolumesActionsTest-1285107848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (862669c1-8f1f-4ce6-affd-b3956eac6247) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:12:51 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-00cf8578-049c-4ae4-bc1f-04a52dd69d86 tempest-VolumesActionsTest-1285107848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f375fd22-a350-40be-bf6c-d9763a1dc3a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:12:51 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-00cf8578-049c-4ae4-bc1f-04a52dd69d86 tempest-VolumesActionsTest-1285107848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f375fd22-a350-40be-bf6c-d9763a1dc3a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9d0cc9a-c512-4ae0-b472-846c6dbc37f7', 'volume_name': 'volume-e9d0cc9a-c512-4ae0-b472-846c6dbc37f7', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:12:51 devstack sudo[85900]: pam_unix(sudo:session): session closed for user root
Apr 10 13:12:51 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-00cf8578-049c-4ae4-bc1f-04a52dd69d86 tempest-VolumesActionsTest-1285107848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20730d9d-fefb-4504-9bba-78a48a3ede56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:12:51 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-00cf8578-049c-4ae4-bc1f-04a52dd69d86 tempest-VolumesActionsTest-1285107848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20730d9d-fefb-4504-9bba-78a48a3ede56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:12:51 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-00cf8578-049c-4ae4-bc1f-04a52dd69d86 tempest-VolumesActionsTest-1285107848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c46b796-51da-41f7-9d41-44bfec211b2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:12:51 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-00cf8578-049c-4ae4-bc1f-04a52dd69d86 tempest-VolumesActionsTest-1285107848 None] Volume e9d0cc9a-c512-4ae0-b472-846c6dbc37f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9d0cc9a-c512-4ae0-b472-846c6dbc37f7', 'volume_size': 1}
Apr 10 13:12:51 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-00cf8578-049c-4ae4-bc1f-04a52dd69d86 tempest-VolumesActionsTest-1285107848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:12:51 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [req-797e2082-ca0c-4085-bfbc-19186a6f6f2d req-82a3dee3-3a52-4cd2-81c5-3f8f3c438828 tempest-VolumesSnapshotsTestJSON-996193881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-239818a9-9edf-4ca7-bfc1-26fcdd644c1a.info" returned: 0 in 0.431s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:12:51 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [req-797e2082-ca0c-4085-bfbc-19186a6f6f2d req-82a3dee3-3a52-4cd2-81c5-3f8f3c438828 tempest-VolumesSnapshotsTestJSON-996193881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.847s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:12:51 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-e4bbf628-386e-4716-a020-f4eac077c407 tempest-GroupsV314Test-310932252 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 1.223s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:12:51 devstack cinder-volume[83345]: INFO cinder.volume.drivers.remotefs [None req-e4bbf628-386e-4716-a020-f4eac077c407 tempest-GroupsV314Test-310932252 None] Cloning volume dbef070b-24cb-4709-9169-a655fafa334c to volume 47a38fbe-d81e-40b7-ab82-999c9b1911c3
Apr 10 13:12:51 devstack cinder-volume[83345]: INFO cinder.volume.manager [req-797e2082-ca0c-4085-bfbc-19186a6f6f2d req-82a3dee3-3a52-4cd2-81c5-3f8f3c438828 tempest-VolumesSnapshotsTestJSON-996193881 None] Create snapshot completed successfully
Apr 10 13:12:51 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-e4bbf628-386e-4716-a020-f4eac077c407 tempest-GroupsV314Test-310932252 None] Creating offline snapshot 6472c03e-0a0c-4aab-b846-e4de8c42f5e3 of volume dbef070b-24cb-4709-9169-a655fafa334c {{(pid=83345) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 10 13:12:51 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[b099cd31-1f07-46ac-874b-4f27b89ecd44]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:12:51 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-e4bbf628-386e-4716-a020-f4eac077c407 tempest-GroupsV314Test-310932252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-dbef070b-24cb-4709-9169-a655fafa334c {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:12:52 devstack sudo[85903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-dbef070b-24cb-4709-9169-a655fafa334c
Apr 10 13:12:52 devstack sudo[85903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:12:52 devstack cinder-volume[83345]: DEBUG cinder.coordination [req-14cde7ed-ec68-4a71-b42b-10b54f2d12db req-4c186c1b-8d3c-4356-a603-14e35013c732 tempest-VolumesSnapshotsTestJSON-996193881 None] Acquiring lock "cinder-0607e8a4-875c-4fc9-926e-580580cb2e36-delete_snapshot" by "delete_snapshot" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:12:52 devstack cinder-volume[83345]: DEBUG cinder.coordination [req-14cde7ed-ec68-4a71-b42b-10b54f2d12db req-4c186c1b-8d3c-4356-a603-14e35013c732 tempest-VolumesSnapshotsTestJSON-996193881 None] Lock "cinder-0607e8a4-875c-4fc9-926e-580580cb2e36-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:12:52 devstack cinder-volume[83345]: DEBUG cinder.coordination [req-14cde7ed-ec68-4a71-b42b-10b54f2d12db req-4c186c1b-8d3c-4356-a603-14e35013c732 tempest-VolumesSnapshotsTestJSON-996193881 None] Acquiring lock "cinder-quobyte-239818a9-9edf-4ca7-bfc1-26fcdd644c1a" by "delete_snapshot" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:12:52 devstack cinder-volume[83345]: DEBUG cinder.coordination [req-14cde7ed-ec68-4a71-b42b-10b54f2d12db req-4c186c1b-8d3c-4356-a603-14e35013c732 tempest-VolumesSnapshotsTestJSON-996193881 None] Lock "cinder-quobyte-239818a9-9edf-4ca7-bfc1-26fcdd644c1a" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:12:52 devstack cinder-volume[83345]: DEBUG cinder.coordination [req-14cde7ed-ec68-4a71-b42b-10b54f2d12db req-4c186c1b-8d3c-4356-a603-14e35013c732 tempest-VolumesSnapshotsTestJSON-996193881 None] Acquiring lock "cinder-quobyte-0607e8a4-875c-4fc9-926e-580580cb2e36" by "_delete_snapshot" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:12:52 devstack cinder-volume[83345]: DEBUG cinder.coordination [req-14cde7ed-ec68-4a71-b42b-10b54f2d12db req-4c186c1b-8d3c-4356-a603-14e35013c732 tempest-VolumesSnapshotsTestJSON-996193881 None] Lock "cinder-quobyte-0607e8a4-875c-4fc9-926e-580580cb2e36" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:12:52 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [req-14cde7ed-ec68-4a71-b42b-10b54f2d12db req-4c186c1b-8d3c-4356-a603-14e35013c732 tempest-VolumesSnapshotsTestJSON-996193881 None] Deleting offline snapshot 0607e8a4-875c-4fc9-926e-580580cb2e36 of volume 239818a9-9edf-4ca7-bfc1-26fcdd644c1a {{(pid=83345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 10 13:12:52 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [req-14cde7ed-ec68-4a71-b42b-10b54f2d12db req-4c186c1b-8d3c-4356-a603-14e35013c732 tempest-VolumesSnapshotsTestJSON-996193881 None] snapshot_file for this snap is: volume-239818a9-9edf-4ca7-bfc1-26fcdd644c1a.0607e8a4-875c-4fc9-926e-580580cb2e36 {{(pid=83345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 10 13:12:52 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbafab51-3898-4550-a6ce-adc4068958c4]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:12:52 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [req-14cde7ed-ec68-4a71-b42b-10b54f2d12db req-4c186c1b-8d3c-4356-a603-14e35013c732 tempest-VolumesSnapshotsTestJSON-996193881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-239818a9-9edf-4ca7-bfc1-26fcdd644c1a.0607e8a4-875c-4fc9-926e-580580cb2e36 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:12:52 devstack sudo[85903]: pam_unix(sudo:session): session closed for user root
Apr 10 13:12:52 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-e4bbf628-386e-4716-a020-f4eac077c407 tempest-GroupsV314Test-310932252 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-dbef070b-24cb-4709-9169-a655fafa334c" returned: 0 in 0.533s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:12:52 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-e4bbf628-386e-4716-a020-f4eac077c407 tempest-GroupsV314Test-310932252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-dbef070b-24cb-4709-9169-a655fafa334c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-dbef070b-24cb-4709-9169-a655fafa334c.6472c03e-0a0c-4aab-b846-e4de8c42f5e3 1G {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:12:52 devstack sudo[85908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-239818a9-9edf-4ca7-bfc1-26fcdd644c1a.0607e8a4-875c-4fc9-926e-580580cb2e36
Apr 10 13:12:52 devstack sudo[85908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:12:52 devstack sudo[85909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-dbef070b-24cb-4709-9169-a655fafa334c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-dbef070b-24cb-4709-9169-a655fafa334c.6472c03e-0a0c-4aab-b846-e4de8c42f5e3 1G
Apr 10 13:12:52 devstack sudo[85909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:12:52 devstack sudo[85908]: pam_unix(sudo:session): session closed for user root
Apr 10 13:12:52 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [req-14cde7ed-ec68-4a71-b42b-10b54f2d12db req-4c186c1b-8d3c-4356-a603-14e35013c732 tempest-VolumesSnapshotsTestJSON-996193881 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-239818a9-9edf-4ca7-bfc1-26fcdd644c1a.0607e8a4-875c-4fc9-926e-580580cb2e36" returned: 0 in 0.522s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:12:52 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [req-14cde7ed-ec68-4a71-b42b-10b54f2d12db req-4c186c1b-8d3c-4356-a603-14e35013c732 tempest-VolumesSnapshotsTestJSON-996193881 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-239818a9-9edf-4ca7-bfc1-26fcdd644c1a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 13:12:52 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b9e1f90-062b-4402-aa6f-bc718b6aff77]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:12:52 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [req-14cde7ed-ec68-4a71-b42b-10b54f2d12db req-4c186c1b-8d3c-4356-a603-14e35013c732 tempest-VolumesSnapshotsTestJSON-996193881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-239818a9-9edf-4ca7-bfc1-26fcdd644c1a {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:12:53 devstack sudo[85909]: pam_unix(sudo:session): session closed for user root
Apr 10 13:12:53 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-e4bbf628-386e-4716-a020-f4eac077c407 tempest-GroupsV314Test-310932252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-dbef070b-24cb-4709-9169-a655fafa334c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-dbef070b-24cb-4709-9169-a655fafa334c.6472c03e-0a0c-4aab-b846-e4de8c42f5e3 1G" returned: 0 in 0.547s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:12:53 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-e4bbf628-386e-4716-a020-f4eac077c407 tempest-GroupsV314Test-310932252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dbef070b-24cb-4709-9169-a655fafa334c -F qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-dbef070b-24cb-4709-9169-a655fafa334c.6472c03e-0a0c-4aab-b846-e4de8c42f5e3 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:12:53 devstack sudo[85919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-239818a9-9edf-4ca7-bfc1-26fcdd644c1a
Apr 10 13:12:53 devstack sudo[85919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:12:53 devstack sudo[85920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dbef070b-24cb-4709-9169-a655fafa334c -F qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-dbef070b-24cb-4709-9169-a655fafa334c.6472c03e-0a0c-4aab-b846-e4de8c42f5e3
Apr 10 13:12:53 devstack sudo[85920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:12:53 devstack sudo[85919]: pam_unix(sudo:session): session closed for user root
Apr 10 13:12:53 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [req-14cde7ed-ec68-4a71-b42b-10b54f2d12db req-4c186c1b-8d3c-4356-a603-14e35013c732 tempest-VolumesSnapshotsTestJSON-996193881 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-239818a9-9edf-4ca7-bfc1-26fcdd644c1a" returned: 0 in 0.529s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:12:53 devstack sudo[85920]: pam_unix(sudo:session): session closed for user root
Apr 10 13:12:53 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [req-14cde7ed-ec68-4a71-b42b-10b54f2d12db req-4c186c1b-8d3c-4356-a603-14e35013c732 tempest-VolumesSnapshotsTestJSON-996193881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-239818a9-9edf-4ca7-bfc1-26fcdd644c1a.0607e8a4-875c-4fc9-926e-580580cb2e36 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:12:53 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-e4bbf628-386e-4716-a020-f4eac077c407 tempest-GroupsV314Test-310932252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dbef070b-24cb-4709-9169-a655fafa334c -F qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-dbef070b-24cb-4709-9169-a655fafa334c.6472c03e-0a0c-4aab-b846-e4de8c42f5e3" returned: 0 in 0.473s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:12:53 devstack cinder-volume[83345]: WARNING cinder.volume.drivers.remotefs [None req-e4bbf628-386e-4716-a020-f4eac077c407 tempest-GroupsV314Test-310932252 None] /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-dbef070b-24cb-4709-9169-a655fafa334c.6472c03e-0a0c-4aab-b846-e4de8c42f5e3 is being set with open permissions: ugo+rw: NotImplementedError
Apr 10 13:12:53 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-e4bbf628-386e-4716-a020-f4eac077c407 tempest-GroupsV314Test-310932252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-dbef070b-24cb-4709-9169-a655fafa334c.6472c03e-0a0c-4aab-b846-e4de8c42f5e3 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:12:53 devstack sudo[85929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-239818a9-9edf-4ca7-bfc1-26fcdd644c1a.0607e8a4-875c-4fc9-926e-580580cb2e36
Apr 10 13:12:53 devstack sudo[85929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:12:53 devstack sudo[85930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-dbef070b-24cb-4709-9169-a655fafa334c.6472c03e-0a0c-4aab-b846-e4de8c42f5e3
Apr 10 13:12:53 devstack sudo[85930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:12:53 devstack cinder-volume[83345]: DEBUG oslo_service.periodic_task [None req-c3f44832-ad7f-424b-a850-32c7352a19c5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83345) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 10 13:12:53 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-c3f44832-ad7f-424b-a850-32c7352a19c5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:12:53 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-c3f44832-ad7f-424b-a850-32c7352a19c5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:12:53 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-c3f44832-ad7f-424b-a850-32c7352a19c5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:12:53 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-c3f44832-ad7f-424b-a850-32c7352a19c5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:12:53 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-c3f44832-ad7f-424b-a850-32c7352a19c5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:12:53 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-c3f44832-ad7f-424b-a850-32c7352a19c5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:12:53 devstack sudo[85933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:12:53 devstack sudo[85933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:12:53 devstack sudo[85930]: pam_unix(sudo:session): session closed for user root
Apr 10 13:12:53 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-e4bbf628-386e-4716-a020-f4eac077c407 tempest-GroupsV314Test-310932252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-dbef070b-24cb-4709-9169-a655fafa334c.6472c03e-0a0c-4aab-b846-e4de8c42f5e3" returned: 0 in 0.445s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:12:53 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-e4bbf628-386e-4716-a020-f4eac077c407 tempest-GroupsV314Test-310932252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-dbef070b-24cb-4709-9169-a655fafa334c.info {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:12:53 devstack sudo[85929]: pam_unix(sudo:session): session closed for user root
Apr 10 13:12:53 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [req-14cde7ed-ec68-4a71-b42b-10b54f2d12db req-4c186c1b-8d3c-4356-a603-14e35013c732 tempest-VolumesSnapshotsTestJSON-996193881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-239818a9-9edf-4ca7-bfc1-26fcdd644c1a.0607e8a4-875c-4fc9-926e-580580cb2e36" returned: 0 in 0.496s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:12:53 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [req-14cde7ed-ec68-4a71-b42b-10b54f2d12db req-4c186c1b-8d3c-4356-a603-14e35013c732 tempest-VolumesSnapshotsTestJSON-996193881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-239818a9-9edf-4ca7-bfc1-26fcdd644c1a.0607e8a4-875c-4fc9-926e-580580cb2e36 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:12:53 devstack sudo[85940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-dbef070b-24cb-4709-9169-a655fafa334c.info
Apr 10 13:12:53 devstack sudo[85940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:12:53 devstack sudo[85933]: pam_unix(sudo:session): session closed for user root
Apr 10 13:12:53 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-c3f44832-ad7f-424b-a850-32c7352a19c5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.445s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:12:53 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-c3f44832-ad7f-424b-a850-32c7352a19c5 None None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:12:54 devstack sudo[85941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-239818a9-9edf-4ca7-bfc1-26fcdd644c1a.0607e8a4-875c-4fc9-926e-580580cb2e36
Apr 10 13:12:54 devstack sudo[85941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:12:54 devstack sudo[85940]: pam_unix(sudo:session): session closed for user root
Apr 10 13:12:54 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-e4bbf628-386e-4716-a020-f4eac077c407 tempest-GroupsV314Test-310932252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-dbef070b-24cb-4709-9169-a655fafa334c.info" returned: 0 in 0.402s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:12:54 devstack cinder-volume[83345]: WARNING cinder.volume.drivers.remotefs [None req-e4bbf628-386e-4716-a020-f4eac077c407 tempest-GroupsV314Test-310932252 None] /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-dbef070b-24cb-4709-9169-a655fafa334c.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 10 13:12:54 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-e4bbf628-386e-4716-a020-f4eac077c407 tempest-GroupsV314Test-310932252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-dbef070b-24cb-4709-9169-a655fafa334c.info {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:12:54 devstack sudo[85946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-dbef070b-24cb-4709-9169-a655fafa334c.info
Apr 10 13:12:54 devstack sudo[85946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:12:54 devstack sudo[85941]: pam_unix(sudo:session): session closed for user root
Apr 10 13:12:54 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [req-14cde7ed-ec68-4a71-b42b-10b54f2d12db req-4c186c1b-8d3c-4356-a603-14e35013c732 tempest-VolumesSnapshotsTestJSON-996193881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-239818a9-9edf-4ca7-bfc1-26fcdd644c1a.0607e8a4-875c-4fc9-926e-580580cb2e36" returned: 0 in 0.489s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:12:54 devstack cinder-volume[83345]: DEBUG cinder.coordination [req-14cde7ed-ec68-4a71-b42b-10b54f2d12db req-4c186c1b-8d3c-4356-a603-14e35013c732 tempest-VolumesSnapshotsTestJSON-996193881 None] Lock "cinder-quobyte-0607e8a4-875c-4fc9-926e-580580cb2e36" released by "_delete_snapshot" :: held 2.127s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:12:54 devstack cinder-volume[83345]: DEBUG cinder.coordination [req-14cde7ed-ec68-4a71-b42b-10b54f2d12db req-4c186c1b-8d3c-4356-a603-14e35013c732 tempest-VolumesSnapshotsTestJSON-996193881 None] Lock "cinder-quobyte-239818a9-9edf-4ca7-bfc1-26fcdd644c1a" released by "delete_snapshot" :: held 2.141s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:12:54 devstack cinder-volume[83345]: WARNING cinder.quota [req-14cde7ed-ec68-4a71-b42b-10b54f2d12db req-4c186c1b-8d3c-4356-a603-14e35013c732 tempest-VolumesSnapshotsTestJSON-996193881 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Apr 10 13:12:54 devstack cinder-volume[83345]: DEBUG cinder.quota [req-14cde7ed-ec68-4a71-b42b-10b54f2d12db req-4c186c1b-8d3c-4356-a603-14e35013c732 tempest-VolumesSnapshotsTestJSON-996193881 None] Created reservations ['f8bf019c-26a0-45cd-8e43-a101ff71a890', 'ae91af1e-b493-4dfe-9ec4-a56d2adee6f1', 'eb772606-4152-497d-a639-faf2784189b6', '0abf9eaf-d632-4223-923b-f54620b8ec1d'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:12:54 devstack cinder-volume[83345]: INFO cinder.volume.manager [req-14cde7ed-ec68-4a71-b42b-10b54f2d12db req-4c186c1b-8d3c-4356-a603-14e35013c732 tempest-VolumesSnapshotsTestJSON-996193881 None] Delete snapshot completed successfully.
Apr 10 13:12:54 devstack cinder-volume[83345]: DEBUG cinder.coordination [req-14cde7ed-ec68-4a71-b42b-10b54f2d12db req-4c186c1b-8d3c-4356-a603-14e35013c732 tempest-VolumesSnapshotsTestJSON-996193881 None] Lock "cinder-0607e8a4-875c-4fc9-926e-580580cb2e36-delete_snapshot" released by "delete_snapshot" :: held 2.267s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:12:54 devstack sudo[85946]: pam_unix(sudo:session): session closed for user root
Apr 10 13:12:54 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-e4bbf628-386e-4716-a020-f4eac077c407 tempest-GroupsV314Test-310932252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-dbef070b-24cb-4709-9169-a655fafa334c.info" returned: 0 in 0.542s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:12:54 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-e4bbf628-386e-4716-a020-f4eac077c407 tempest-GroupsV314Test-310932252 None] Acquiring lock "cinder-quobyte-47a38fbe-d81e-40b7-ab82-999c9b1911c3" by "_copy_volume_from_snapshot" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:12:54 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-e4bbf628-386e-4716-a020-f4eac077c407 tempest-GroupsV314Test-310932252 None] Lock "cinder-quobyte-47a38fbe-d81e-40b7-ab82-999c9b1911c3" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:12:54 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-e4bbf628-386e-4716-a020-f4eac077c407 tempest-GroupsV314Test-310932252 None] snapshot: 6472c03e-0a0c-4aab-b846-e4de8c42f5e3, volume: 47a38fbe-d81e-40b7-ab82-999c9b1911c3,  {{(pid=83345) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 10 13:12:54 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-e4bbf628-386e-4716-a020-f4eac077c407 tempest-GroupsV314Test-310932252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:12:54 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-e4bbf628-386e-4716-a020-f4eac077c407 tempest-GroupsV314Test-310932252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:12:54 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-e4bbf628-386e-4716-a020-f4eac077c407 tempest-GroupsV314Test-310932252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:12:54 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-e4bbf628-386e-4716-a020-f4eac077c407 tempest-GroupsV314Test-310932252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:12:54 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-e4bbf628-386e-4716-a020-f4eac077c407 tempest-GroupsV314Test-310932252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:12:54 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[de7d8868-c5bd-4c36-be29-a81c44fc4d6f]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:12:54 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-e4bbf628-386e-4716-a020-f4eac077c407 tempest-GroupsV314Test-310932252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-dbef070b-24cb-4709-9169-a655fafa334c.6472c03e-0a0c-4aab-b846-e4de8c42f5e3 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:12:55 devstack sudo[85976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-dbef070b-24cb-4709-9169-a655fafa334c.6472c03e-0a0c-4aab-b846-e4de8c42f5e3
Apr 10 13:12:55 devstack sudo[85976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:12:55 devstack sudo[85976]: pam_unix(sudo:session): session closed for user root
Apr 10 13:12:55 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-e4bbf628-386e-4716-a020-f4eac077c407 tempest-GroupsV314Test-310932252 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-dbef070b-24cb-4709-9169-a655fafa334c.6472c03e-0a0c-4aab-b846-e4de8c42f5e3" returned: 0 in 0.561s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:12:55 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-e4bbf628-386e-4716-a020-f4eac077c407 tempest-GroupsV314Test-310932252 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dbef070b-24cb-4709-9169-a655fafa334c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 13:12:55 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-e4bbf628-386e-4716-a020-f4eac077c407 tempest-GroupsV314Test-310932252 None] will copy from snapshot at /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-dbef070b-24cb-4709-9169-a655fafa334c {{(pid=83345) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 10 13:12:55 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-e4bbf628-386e-4716-a020-f4eac077c407 tempest-GroupsV314Test-310932252 None] Creating direct copy from snapshot {{(pid=83345) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 10 13:12:55 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9e80531-b8f7-4986-997e-48734c73ad08]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:12:55 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-e4bbf628-386e-4716-a020-f4eac077c407 tempest-GroupsV314Test-310932252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-dbef070b-24cb-4709-9169-a655fafa334c {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:12:55 devstack sudo[85982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-dbef070b-24cb-4709-9169-a655fafa334c
Apr 10 13:12:55 devstack sudo[85982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:12:55 devstack cinder-volume[83345]: DEBUG cinder.coordination [req-a22586ba-9ace-47bf-a2f4-9e8e10f2a7b0 req-3f719e34-ed60-4207-9796-0f9ad0685b52 tempest-VolumesSnapshotsTestJSON-996193881 None] Acquiring lock "cinder-239818a9-9edf-4ca7-bfc1-26fcdd644c1a-delete_volume" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:12:55 devstack cinder-volume[83345]: DEBUG cinder.coordination [req-a22586ba-9ace-47bf-a2f4-9e8e10f2a7b0 req-3f719e34-ed60-4207-9796-0f9ad0685b52 tempest-VolumesSnapshotsTestJSON-996193881 None] Lock "cinder-239818a9-9edf-4ca7-bfc1-26fcdd644c1a-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:12:55 devstack cinder-volume[83345]: DEBUG cinder.coordination [req-a22586ba-9ace-47bf-a2f4-9e8e10f2a7b0 req-3f719e34-ed60-4207-9796-0f9ad0685b52 tempest-VolumesSnapshotsTestJSON-996193881 None] Acquiring lock "cinder-quobyte-239818a9-9edf-4ca7-bfc1-26fcdd644c1a" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:12:55 devstack cinder-volume[83345]: DEBUG cinder.coordination [req-a22586ba-9ace-47bf-a2f4-9e8e10f2a7b0 req-3f719e34-ed60-4207-9796-0f9ad0685b52 tempest-VolumesSnapshotsTestJSON-996193881 None] Lock "cinder-quobyte-239818a9-9edf-4ca7-bfc1-26fcdd644c1a" acquired by "delete_volume" :: waited 0.016s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:12:55 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfa7753c-f305-4e28-9937-39cb4ad97ef0]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:12:55 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [req-a22586ba-9ace-47bf-a2f4-9e8e10f2a7b0 req-3f719e34-ed60-4207-9796-0f9ad0685b52 tempest-VolumesSnapshotsTestJSON-996193881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-239818a9-9edf-4ca7-bfc1-26fcdd644c1a {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:12:55 devstack sudo[85984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-239818a9-9edf-4ca7-bfc1-26fcdd644c1a
Apr 10 13:12:55 devstack sudo[85984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:12:56 devstack sudo[85982]: pam_unix(sudo:session): session closed for user root
Apr 10 13:12:56 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-e4bbf628-386e-4716-a020-f4eac077c407 tempest-GroupsV314Test-310932252 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-dbef070b-24cb-4709-9169-a655fafa334c" returned: 0 in 0.529s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:12:56 devstack cinder-volume[83345]: DEBUG cinder.utils [None req-e4bbf628-386e-4716-a020-f4eac077c407 tempest-GroupsV314Test-310932252 None] Path /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-47a38fbe-d81e-40b7-ab82-999c9b1911c3 not found in is_blk_device check {{(pid=83345) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 10 13:12:56 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-e4bbf628-386e-4716-a020-f4eac077c407 tempest-GroupsV314Test-310932252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-dbef070b-24cb-4709-9169-a655fafa334c /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-47a38fbe-d81e-40b7-ab82-999c9b1911c3 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:12:56 devstack sudo[85989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-dbef070b-24cb-4709-9169-a655fafa334c /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-47a38fbe-d81e-40b7-ab82-999c9b1911c3
Apr 10 13:12:56 devstack sudo[85989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:12:56 devstack sudo[85984]: pam_unix(sudo:session): session closed for user root
Apr 10 13:12:56 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [req-a22586ba-9ace-47bf-a2f4-9e8e10f2a7b0 req-3f719e34-ed60-4207-9796-0f9ad0685b52 tempest-VolumesSnapshotsTestJSON-996193881 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-239818a9-9edf-4ca7-bfc1-26fcdd644c1a" returned: 0 in 0.625s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:12:56 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [req-a22586ba-9ace-47bf-a2f4-9e8e10f2a7b0 req-3f719e34-ed60-4207-9796-0f9ad0685b52 tempest-VolumesSnapshotsTestJSON-996193881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-239818a9-9edf-4ca7-bfc1-26fcdd644c1a {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:12:56 devstack sudo[85995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-239818a9-9edf-4ca7-bfc1-26fcdd644c1a
Apr 10 13:12:56 devstack sudo[85995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:12:57 devstack sudo[85995]: pam_unix(sudo:session): session closed for user root
Apr 10 13:12:57 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [req-a22586ba-9ace-47bf-a2f4-9e8e10f2a7b0 req-3f719e34-ed60-4207-9796-0f9ad0685b52 tempest-VolumesSnapshotsTestJSON-996193881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-239818a9-9edf-4ca7-bfc1-26fcdd644c1a" returned: 0 in 0.927s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:12:57 devstack cinder-volume[83345]: DEBUG cinder.coordination [req-a22586ba-9ace-47bf-a2f4-9e8e10f2a7b0 req-3f719e34-ed60-4207-9796-0f9ad0685b52 tempest-VolumesSnapshotsTestJSON-996193881 None] Lock "cinder-quobyte-239818a9-9edf-4ca7-bfc1-26fcdd644c1a" released by "delete_volume" :: held 1.592s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:12:57 devstack cinder-volume[83345]: DEBUG dbcounter [-] [83345] Writing DB stats cinder:SELECT=85,cinder:UPDATE=108,cinder:DELETE=10,cinder:INSERT=28 {{(pid=83345) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 10 13:12:57 devstack cinder-volume[83345]: DEBUG dbcounter [-] [83345] Writing DB stats cinder:SELECT=113,cinder:INSERT=31,cinder:UPDATE=93,cinder:DELETE=7 {{(pid=83345) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 10 13:12:57 devstack cinder-volume[83345]: DEBUG cinder.quota [req-a22586ba-9ace-47bf-a2f4-9e8e10f2a7b0 req-3f719e34-ed60-4207-9796-0f9ad0685b52 tempest-VolumesSnapshotsTestJSON-996193881 None] Created reservations ['e600187e-17d1-4418-a604-2b9622ee4c9f', '11bb874d-e111-46ed-9ad2-acf886b6724a', 'cdb46576-0f45-48b6-87d3-453be63cf5bb', '37e74dfd-70a2-4b61-9c6e-22b8d6bcffc5'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:12:57 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [req-a22586ba-9ace-47bf-a2f4-9e8e10f2a7b0 req-3f719e34-ed60-4207-9796-0f9ad0685b52 tempest-VolumesSnapshotsTestJSON-996193881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:12:57 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [req-a22586ba-9ace-47bf-a2f4-9e8e10f2a7b0 req-3f719e34-ed60-4207-9796-0f9ad0685b52 tempest-VolumesSnapshotsTestJSON-996193881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:12:57 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [req-a22586ba-9ace-47bf-a2f4-9e8e10f2a7b0 req-3f719e34-ed60-4207-9796-0f9ad0685b52 tempest-VolumesSnapshotsTestJSON-996193881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:12:57 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [req-a22586ba-9ace-47bf-a2f4-9e8e10f2a7b0 req-3f719e34-ed60-4207-9796-0f9ad0685b52 tempest-VolumesSnapshotsTestJSON-996193881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:12:57 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [req-a22586ba-9ace-47bf-a2f4-9e8e10f2a7b0 req-3f719e34-ed60-4207-9796-0f9ad0685b52 tempest-VolumesSnapshotsTestJSON-996193881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:12:57 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [req-a22586ba-9ace-47bf-a2f4-9e8e10f2a7b0 req-3f719e34-ed60-4207-9796-0f9ad0685b52 tempest-VolumesSnapshotsTestJSON-996193881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:12:57 devstack sudo[86023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:12:57 devstack sudo[86023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:12:59 devstack sudo[85989]: pam_unix(sudo:session): session closed for user root
Apr 10 13:12:59 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-e4bbf628-386e-4716-a020-f4eac077c407 tempest-GroupsV314Test-310932252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-dbef070b-24cb-4709-9169-a655fafa334c /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-47a38fbe-d81e-40b7-ab82-999c9b1911c3" returned: 0 in 3.259s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:12:59 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[190b0c55-ca32-4a42-a6d6-5f10c6a5e17e]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:12:59 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-e4bbf628-386e-4716-a020-f4eac077c407 tempest-GroupsV314Test-310932252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-dbef070b-24cb-4709-9169-a655fafa334c {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:12:59 devstack sudo[86023]: pam_unix(sudo:session): session closed for user root
Apr 10 13:12:59 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [req-a22586ba-9ace-47bf-a2f4-9e8e10f2a7b0 req-3f719e34-ed60-4207-9796-0f9ad0685b52 tempest-VolumesSnapshotsTestJSON-996193881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 1.591s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:12:59 devstack cinder-volume[83345]: DEBUG cinder.manager [req-a22586ba-9ace-47bf-a2f4-9e8e10f2a7b0 req-3f719e34-ed60-4207-9796-0f9ad0685b52 tempest-VolumesSnapshotsTestJSON-996193881 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:12:59 devstack cinder-volume[83345]: INFO cinder.volume.manager [req-a22586ba-9ace-47bf-a2f4-9e8e10f2a7b0 req-3f719e34-ed60-4207-9796-0f9ad0685b52 tempest-VolumesSnapshotsTestJSON-996193881 None] Deleted volume successfully.
Apr 10 13:12:59 devstack cinder-volume[83345]: DEBUG cinder.coordination [req-a22586ba-9ace-47bf-a2f4-9e8e10f2a7b0 req-3f719e34-ed60-4207-9796-0f9ad0685b52 tempest-VolumesSnapshotsTestJSON-996193881 None] Lock "cinder-239818a9-9edf-4ca7-bfc1-26fcdd644c1a-delete_volume" released by "delete_volume" :: held 3.755s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:12:59 devstack sudo[86027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-dbef070b-24cb-4709-9169-a655fafa334c
Apr 10 13:12:59 devstack sudo[86027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:00 devstack sudo[86027]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:00 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-e4bbf628-386e-4716-a020-f4eac077c407 tempest-GroupsV314Test-310932252 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-dbef070b-24cb-4709-9169-a655fafa334c" returned: 0 in 0.790s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:00 devstack cinder-volume[83345]: DEBUG cinder.image.image_utils [None req-e4bbf628-386e-4716-a020-f4eac077c407 tempest-GroupsV314Test-310932252 None] Image conversion details: src /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-dbef070b-24cb-4709-9169-a655fafa334c, size 1024.00 MB, duration 3.26 sec, destination /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-47a38fbe-d81e-40b7-ab82-999c9b1911c3 {{(pid=83345) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 10 13:13:00 devstack cinder-volume[83345]: INFO cinder.image.image_utils [None req-e4bbf628-386e-4716-a020-f4eac077c407 tempest-GroupsV314Test-310932252 None] Converted 1024.00 MB image at 314.02 MB/s
Apr 10 13:13:00 devstack cinder-volume[83345]: WARNING cinder.volume.drivers.remotefs [None req-e4bbf628-386e-4716-a020-f4eac077c407 tempest-GroupsV314Test-310932252 None] /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-47a38fbe-d81e-40b7-ab82-999c9b1911c3 is being set with open permissions: ugo+rw: NotImplementedError
Apr 10 13:13:00 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-e4bbf628-386e-4716-a020-f4eac077c407 tempest-GroupsV314Test-310932252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-47a38fbe-d81e-40b7-ab82-999c9b1911c3 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:00 devstack sudo[86038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-47a38fbe-d81e-40b7-ab82-999c9b1911c3
Apr 10 13:13:00 devstack sudo[86038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:00 devstack sudo[86038]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:00 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-e4bbf628-386e-4716-a020-f4eac077c407 tempest-GroupsV314Test-310932252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-47a38fbe-d81e-40b7-ab82-999c9b1911c3" returned: 0 in 0.500s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:00 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-e4bbf628-386e-4716-a020-f4eac077c407 tempest-GroupsV314Test-310932252 None] Lock "cinder-quobyte-47a38fbe-d81e-40b7-ab82-999c9b1911c3" released by "_copy_volume_from_snapshot" :: held 5.702s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:13:00 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-e4bbf628-386e-4716-a020-f4eac077c407 tempest-GroupsV314Test-310932252 None] Acquiring lock "cinder-quobyte-6472c03e-0a0c-4aab-b846-e4de8c42f5e3" by "_delete_snapshot" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:13:00 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-e4bbf628-386e-4716-a020-f4eac077c407 tempest-GroupsV314Test-310932252 None] Lock "cinder-quobyte-6472c03e-0a0c-4aab-b846-e4de8c42f5e3" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:13:00 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-e4bbf628-386e-4716-a020-f4eac077c407 tempest-GroupsV314Test-310932252 None] Deleting offline snapshot 6472c03e-0a0c-4aab-b846-e4de8c42f5e3 of volume dbef070b-24cb-4709-9169-a655fafa334c {{(pid=83345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 10 13:13:00 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-e4bbf628-386e-4716-a020-f4eac077c407 tempest-GroupsV314Test-310932252 None] snapshot_file for this snap is: volume-dbef070b-24cb-4709-9169-a655fafa334c.6472c03e-0a0c-4aab-b846-e4de8c42f5e3 {{(pid=83345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 10 13:13:00 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d5c5370-b855-4075-951f-a9d74366241b]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:13:00 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-e4bbf628-386e-4716-a020-f4eac077c407 tempest-GroupsV314Test-310932252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-dbef070b-24cb-4709-9169-a655fafa334c.6472c03e-0a0c-4aab-b846-e4de8c42f5e3 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:00 devstack sudo[86061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-dbef070b-24cb-4709-9169-a655fafa334c.6472c03e-0a0c-4aab-b846-e4de8c42f5e3
Apr 10 13:13:00 devstack sudo[86061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:01 devstack sudo[86061]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:01 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-e4bbf628-386e-4716-a020-f4eac077c407 tempest-GroupsV314Test-310932252 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-dbef070b-24cb-4709-9169-a655fafa334c.6472c03e-0a0c-4aab-b846-e4de8c42f5e3" returned: 0 in 0.700s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:01 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-e4bbf628-386e-4716-a020-f4eac077c407 tempest-GroupsV314Test-310932252 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dbef070b-24cb-4709-9169-a655fafa334c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 13:13:01 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[de890dd5-5f39-4580-a2c2-abd0fe715eea]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:13:01 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-e4bbf628-386e-4716-a020-f4eac077c407 tempest-GroupsV314Test-310932252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-dbef070b-24cb-4709-9169-a655fafa334c {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:01 devstack sudo[86088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-dbef070b-24cb-4709-9169-a655fafa334c
Apr 10 13:13:01 devstack sudo[86088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:02 devstack sudo[86088]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:02 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-e4bbf628-386e-4716-a020-f4eac077c407 tempest-GroupsV314Test-310932252 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-dbef070b-24cb-4709-9169-a655fafa334c" returned: 0 in 0.674s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:02 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-e4bbf628-386e-4716-a020-f4eac077c407 tempest-GroupsV314Test-310932252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-dbef070b-24cb-4709-9169-a655fafa334c.6472c03e-0a0c-4aab-b846-e4de8c42f5e3 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:02 devstack sudo[86094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-dbef070b-24cb-4709-9169-a655fafa334c.6472c03e-0a0c-4aab-b846-e4de8c42f5e3
Apr 10 13:13:02 devstack sudo[86094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:02 devstack sudo[86094]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:02 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-e4bbf628-386e-4716-a020-f4eac077c407 tempest-GroupsV314Test-310932252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-dbef070b-24cb-4709-9169-a655fafa334c.6472c03e-0a0c-4aab-b846-e4de8c42f5e3" returned: 0 in 0.572s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:02 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-e4bbf628-386e-4716-a020-f4eac077c407 tempest-GroupsV314Test-310932252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-dbef070b-24cb-4709-9169-a655fafa334c.6472c03e-0a0c-4aab-b846-e4de8c42f5e3 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:02 devstack sudo[86101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-dbef070b-24cb-4709-9169-a655fafa334c.6472c03e-0a0c-4aab-b846-e4de8c42f5e3
Apr 10 13:13:02 devstack sudo[86101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:02 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-07f1966c-269f-443e-a935-3963b98ea4bc tempest-BackendsCapabilitiesAdminTestsJSON-266949313 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757999420166, 'free_capacity_gb': 1775.757999420166, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83345) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Apr 10 13:13:02 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-e66c7514-deca-48ae-8bc1-0179ad3093c0 tempest-BackendsCapabilitiesAdminTestsJSON-266949313 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757999420166, 'free_capacity_gb': 1775.757999420166, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83345) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Apr 10 13:13:03 devstack sudo[86101]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:03 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-e4bbf628-386e-4716-a020-f4eac077c407 tempest-GroupsV314Test-310932252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-dbef070b-24cb-4709-9169-a655fafa334c.6472c03e-0a0c-4aab-b846-e4de8c42f5e3" returned: 0 in 0.545s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:03 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-e4bbf628-386e-4716-a020-f4eac077c407 tempest-GroupsV314Test-310932252 None] Lock "cinder-quobyte-6472c03e-0a0c-4aab-b846-e4de8c42f5e3" released by "_delete_snapshot" :: held 2.551s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:13:03 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-e4bbf628-386e-4716-a020-f4eac077c407 tempest-GroupsV314Test-310932252 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.348s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:13:03 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-00cf8578-049c-4ae4-bc1f-04a52dd69d86 tempest-VolumesActionsTest-1285107848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.363s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:13:03 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-00cf8578-049c-4ae4-bc1f-04a52dd69d86 tempest-VolumesActionsTest-1285107848 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f252bf08b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:12:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1903165308',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9d0cc9a-c512-4ae0-b472-846c6dbc37f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2551b2b6cd9f4994a93b4b15e32392da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:12:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:12:52Z,use_quota=True,user_id='aa1e9a5c093744c0a889c58c163c8c1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)}" {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 13:13:03 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-00cf8578-049c-4ae4-bc1f-04a52dd69d86 tempest-VolumesActionsTest-1285107848 None] Creating volume e9d0cc9a-c512-4ae0-b472-846c6dbc37f7 {{(pid=83345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 13:13:03 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-00cf8578-049c-4ae4-bc1f-04a52dd69d86 tempest-VolumesActionsTest-1285107848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:13:03 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-00cf8578-049c-4ae4-bc1f-04a52dd69d86 tempest-VolumesActionsTest-1285107848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:13:03 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-00cf8578-049c-4ae4-bc1f-04a52dd69d86 tempest-VolumesActionsTest-1285107848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:13:03 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-00cf8578-049c-4ae4-bc1f-04a52dd69d86 tempest-VolumesActionsTest-1285107848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:13:03 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-00cf8578-049c-4ae4-bc1f-04a52dd69d86 tempest-VolumesActionsTest-1285107848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:13:03 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-00cf8578-049c-4ae4-bc1f-04a52dd69d86 tempest-VolumesActionsTest-1285107848 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:13:03 devstack cinder-volume[83345]: INFO cinder.volume.drivers.remotefs [None req-00cf8578-049c-4ae4-bc1f-04a52dd69d86 tempest-VolumesActionsTest-1285107848 None] casted to osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331
Apr 10 13:13:03 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-00cf8578-049c-4ae4-bc1f-04a52dd69d86 tempest-VolumesActionsTest-1285107848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e9d0cc9a-c512-4ae0-b472-846c6dbc37f7 1073741824 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:03 devstack sudo[86104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e9d0cc9a-c512-4ae0-b472-846c6dbc37f7 1073741824
Apr 10 13:13:03 devstack sudo[86104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:03 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-e4bbf628-386e-4716-a020-f4eac077c407 tempest-GroupsV314Test-310932252 None] Create group from source-group-7bec7f31-f795-4bbe-8ea6-d3b82a1cd810 completed successfully.
Apr 10 13:13:03 devstack sudo[86104]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:03 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-00cf8578-049c-4ae4-bc1f-04a52dd69d86 tempest-VolumesActionsTest-1285107848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e9d0cc9a-c512-4ae0-b472-846c6dbc37f7 1073741824" returned: 0 in 0.638s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:03 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-00cf8578-049c-4ae4-bc1f-04a52dd69d86 tempest-VolumesActionsTest-1285107848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e9d0cc9a-c512-4ae0-b472-846c6dbc37f7 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:03 devstack sudo[86129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e9d0cc9a-c512-4ae0-b472-846c6dbc37f7
Apr 10 13:13:03 devstack sudo[86129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:04 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-6eb3411b-e0c5-4071-9a74-889727ac2aaf tempest-GroupsV314Test-310932252 None] Acquiring lock "cinder-quobyte-47a38fbe-d81e-40b7-ab82-999c9b1911c3" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:13:04 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-6eb3411b-e0c5-4071-9a74-889727ac2aaf tempest-GroupsV314Test-310932252 None] Lock "cinder-quobyte-47a38fbe-d81e-40b7-ab82-999c9b1911c3" acquired by "delete_volume" :: waited 0.008s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:13:04 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[62cd2dd3-9578-4fbe-aa81-f93f1dc30c39]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:13:04 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-6eb3411b-e0c5-4071-9a74-889727ac2aaf tempest-GroupsV314Test-310932252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-47a38fbe-d81e-40b7-ab82-999c9b1911c3 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:04 devstack sudo[86132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-47a38fbe-d81e-40b7-ab82-999c9b1911c3
Apr 10 13:13:04 devstack sudo[86132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:04 devstack sudo[86129]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:04 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-00cf8578-049c-4ae4-bc1f-04a52dd69d86 tempest-VolumesActionsTest-1285107848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e9d0cc9a-c512-4ae0-b472-846c6dbc37f7" returned: 0 in 0.581s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:04 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-00cf8578-049c-4ae4-bc1f-04a52dd69d86 tempest-VolumesActionsTest-1285107848 None] <== create_volume: return (1264ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'} {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 13:13:04 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-00cf8578-049c-4ae4-bc1f-04a52dd69d86 tempest-VolumesActionsTest-1285107848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.267s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:13:04 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-00cf8578-049c-4ae4-bc1f-04a52dd69d86 tempest-VolumesActionsTest-1285107848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c46b796-51da-41f7-9d41-44bfec211b2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9d0cc9a-c512-4ae0-b472-846c6dbc37f7', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:13:04 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-00cf8578-049c-4ae4-bc1f-04a52dd69d86 tempest-VolumesActionsTest-1285107848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cf1d595-8d00-4722-b808-111ac941df05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:13:04 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-00cf8578-049c-4ae4-bc1f-04a52dd69d86 tempest-VolumesActionsTest-1285107848 None] Volume volume-e9d0cc9a-c512-4ae0-b472-846c6dbc37f7 (e9d0cc9a-c512-4ae0-b472-846c6dbc37f7): created successfully
Apr 10 13:13:04 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-00cf8578-049c-4ae4-bc1f-04a52dd69d86 tempest-VolumesActionsTest-1285107848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cf1d595-8d00-4722-b808-111ac941df05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:13:04 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-00cf8578-049c-4ae4-bc1f-04a52dd69d86 tempest-VolumesActionsTest-1285107848 None] Flow 'volume_create_manager' (c518c272-90e1-4a0a-b02c-ec9000f91d15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:13:04 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-00cf8578-049c-4ae4-bc1f-04a52dd69d86 tempest-VolumesActionsTest-1285107848 None] Created volume successfully.
Apr 10 13:13:04 devstack sudo[86132]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:04 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-6eb3411b-e0c5-4071-9a74-889727ac2aaf tempest-GroupsV314Test-310932252 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-47a38fbe-d81e-40b7-ab82-999c9b1911c3" returned: 0 in 0.605s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:04 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-6eb3411b-e0c5-4071-9a74-889727ac2aaf tempest-GroupsV314Test-310932252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-47a38fbe-d81e-40b7-ab82-999c9b1911c3 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:04 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-21d9dda7-9bcf-4a1b-ba13-1bb1b3e92337 tempest-VolumesActionsTest-1102846807 None] Acquiring lock "cinder-e9d0cc9a-c512-4ae0-b472-846c6dbc37f7-delete_volume" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:13:04 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-21d9dda7-9bcf-4a1b-ba13-1bb1b3e92337 tempest-VolumesActionsTest-1102846807 None] Lock "cinder-e9d0cc9a-c512-4ae0-b472-846c6dbc37f7-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:13:04 devstack sudo[86141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-47a38fbe-d81e-40b7-ab82-999c9b1911c3
Apr 10 13:13:04 devstack sudo[86141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:04 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-21d9dda7-9bcf-4a1b-ba13-1bb1b3e92337 tempest-VolumesActionsTest-1102846807 None] Acquiring lock "cinder-quobyte-e9d0cc9a-c512-4ae0-b472-846c6dbc37f7" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:13:04 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-21d9dda7-9bcf-4a1b-ba13-1bb1b3e92337 tempest-VolumesActionsTest-1102846807 None] Lock "cinder-quobyte-e9d0cc9a-c512-4ae0-b472-846c6dbc37f7" acquired by "delete_volume" :: waited 0.013s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:13:04 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[13a47f15-7685-47c6-85ff-6fbf7ad5ef55]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:13:04 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-21d9dda7-9bcf-4a1b-ba13-1bb1b3e92337 tempest-VolumesActionsTest-1102846807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e9d0cc9a-c512-4ae0-b472-846c6dbc37f7 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:05 devstack sudo[86143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e9d0cc9a-c512-4ae0-b472-846c6dbc37f7
Apr 10 13:13:05 devstack sudo[86143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:05 devstack sudo[86141]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:05 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-6eb3411b-e0c5-4071-9a74-889727ac2aaf tempest-GroupsV314Test-310932252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-47a38fbe-d81e-40b7-ab82-999c9b1911c3" returned: 0 in 0.590s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:05 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-6eb3411b-e0c5-4071-9a74-889727ac2aaf tempest-GroupsV314Test-310932252 None] Lock "cinder-quobyte-47a38fbe-d81e-40b7-ab82-999c9b1911c3" released by "delete_volume" :: held 1.229s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:13:05 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-6eb3411b-e0c5-4071-9a74-889727ac2aaf tempest-GroupsV314Test-310932252 None] Created reservations ['80a03b29-4add-4cf3-bb77-e502ded4ef81'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:13:05 devstack cinder-volume[83345]: WARNING cinder.quota [None req-6eb3411b-e0c5-4071-9a74-889727ac2aaf tempest-GroupsV314Test-310932252 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1904162833 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1904162833, it is now deprecated. Please use the default quota class for default quota.
Apr 10 13:13:05 devstack cinder-volume[83345]: WARNING cinder.quota [None req-6eb3411b-e0c5-4071-9a74-889727ac2aaf tempest-GroupsV314Test-310932252 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1904162833 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1904162833, it is now deprecated. Please use the default quota class for default quota.
Apr 10 13:13:05 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-6eb3411b-e0c5-4071-9a74-889727ac2aaf tempest-GroupsV314Test-310932252 None] Created reservations ['691c76de-f01b-4695-9179-85f231057c28', 'cc2df15c-ff8d-46e7-9a6c-d960ef8c561d', 'c60992f7-8740-4e5a-9d36-98f133cba983', '8a182370-0731-47c7-81a4-8734aca35c89'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:13:05 devstack sudo[86143]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:05 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-6eb3411b-e0c5-4071-9a74-889727ac2aaf tempest-GroupsV314Test-310932252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:13:05 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-6eb3411b-e0c5-4071-9a74-889727ac2aaf tempest-GroupsV314Test-310932252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:13:05 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-6eb3411b-e0c5-4071-9a74-889727ac2aaf tempest-GroupsV314Test-310932252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:13:05 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-6eb3411b-e0c5-4071-9a74-889727ac2aaf tempest-GroupsV314Test-310932252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:13:05 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-6eb3411b-e0c5-4071-9a74-889727ac2aaf tempest-GroupsV314Test-310932252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:13:05 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-6eb3411b-e0c5-4071-9a74-889727ac2aaf tempest-GroupsV314Test-310932252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:05 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-21d9dda7-9bcf-4a1b-ba13-1bb1b3e92337 tempest-VolumesActionsTest-1102846807 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e9d0cc9a-c512-4ae0-b472-846c6dbc37f7" returned: 0 in 0.667s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:05 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-21d9dda7-9bcf-4a1b-ba13-1bb1b3e92337 tempest-VolumesActionsTest-1102846807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e9d0cc9a-c512-4ae0-b472-846c6dbc37f7 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:05 devstack sudo[86151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:13:05 devstack sudo[86151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:05 devstack sudo[86152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e9d0cc9a-c512-4ae0-b472-846c6dbc37f7
Apr 10 13:13:05 devstack sudo[86152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:06 devstack sudo[86151]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:06 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-6eb3411b-e0c5-4071-9a74-889727ac2aaf tempest-GroupsV314Test-310932252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.493s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:06 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-6eb3411b-e0c5-4071-9a74-889727ac2aaf tempest-GroupsV314Test-310932252 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:13:06 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-6eb3411b-e0c5-4071-9a74-889727ac2aaf tempest-GroupsV314Test-310932252 None] Delete group completed successfully.
Apr 10 13:13:06 devstack sudo[86152]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:06 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-21d9dda7-9bcf-4a1b-ba13-1bb1b3e92337 tempest-VolumesActionsTest-1102846807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e9d0cc9a-c512-4ae0-b472-846c6dbc37f7" returned: 0 in 0.500s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:06 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-21d9dda7-9bcf-4a1b-ba13-1bb1b3e92337 tempest-VolumesActionsTest-1102846807 None] Lock "cinder-quobyte-e9d0cc9a-c512-4ae0-b472-846c6dbc37f7" released by "delete_volume" :: held 1.190s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:13:06 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-21d9dda7-9bcf-4a1b-ba13-1bb1b3e92337 tempest-VolumesActionsTest-1102846807 None] Created reservations ['acd9fe99-1dee-40f2-b96d-25f478a5bbe4', '0332e1cc-ad93-43a0-9681-c880907988df', '04645a42-0208-483b-a142-a6c48949d42d', '1ac22fe8-d481-4e24-9da2-73bf134f8c17'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:13:06 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-21d9dda7-9bcf-4a1b-ba13-1bb1b3e92337 tempest-VolumesActionsTest-1102846807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:13:06 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-21d9dda7-9bcf-4a1b-ba13-1bb1b3e92337 tempest-VolumesActionsTest-1102846807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:13:06 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-21d9dda7-9bcf-4a1b-ba13-1bb1b3e92337 tempest-VolumesActionsTest-1102846807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:13:06 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-21d9dda7-9bcf-4a1b-ba13-1bb1b3e92337 tempest-VolumesActionsTest-1102846807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:13:06 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-21d9dda7-9bcf-4a1b-ba13-1bb1b3e92337 tempest-VolumesActionsTest-1102846807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:13:06 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-21d9dda7-9bcf-4a1b-ba13-1bb1b3e92337 tempest-VolumesActionsTest-1102846807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:06 devstack sudo[86157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:13:06 devstack sudo[86157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:06 devstack cinder-volume[83345]: INFO cinder.volume.manager [req-26a92b69-bfaf-4a27-a38a-44329e1164bb req-0778c56f-f0b6-4468-ad7d-a048dec969a7 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Terminate volume connection completed successfully.
Apr 10 13:13:06 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [req-26a92b69-bfaf-4a27-a38a-44329e1164bb req-0778c56f-f0b6-4468-ad7d-a048dec969a7 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Deleting attachment dc3faeee-d0ad-4e95-893c-4d97c4131814. {{(pid=83345) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 10 13:13:06 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-ae472847-f517-4d99-b3c0-fa442121b777 tempest-GroupSnapshotsTest-2129977062 None] Group tempest-GroupSnapshotsTest-Group-1677540514: creating
Apr 10 13:13:06 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-ae472847-f517-4d99-b3c0-fa442121b777 tempest-GroupSnapshotsTest-2129977062 None] Group tempest-GroupSnapshotsTest-Group-1677540514: created successfully
Apr 10 13:13:06 devstack sudo[86157]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:06 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-21d9dda7-9bcf-4a1b-ba13-1bb1b3e92337 tempest-VolumesActionsTest-1102846807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.464s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:06 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-21d9dda7-9bcf-4a1b-ba13-1bb1b3e92337 tempest-VolumesActionsTest-1102846807 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:13:06 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-21d9dda7-9bcf-4a1b-ba13-1bb1b3e92337 tempest-VolumesActionsTest-1102846807 None] Deleted volume successfully.
Apr 10 13:13:06 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-ae472847-f517-4d99-b3c0-fa442121b777 tempest-GroupSnapshotsTest-2129977062 None] Create group completed successfully.
Apr 10 13:13:06 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-21d9dda7-9bcf-4a1b-ba13-1bb1b3e92337 tempest-VolumesActionsTest-1102846807 None] Lock "cinder-e9d0cc9a-c512-4ae0-b472-846c6dbc37f7-delete_volume" released by "delete_volume" :: held 1.799s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:13:06 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-565ff3ee-d05e-4175-9d5b-30f47d478823 tempest-GroupsV314Test-310932252 None] Acquiring lock "cinder-quobyte-dbef070b-24cb-4709-9169-a655fafa334c" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:13:06 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-565ff3ee-d05e-4175-9d5b-30f47d478823 tempest-GroupsV314Test-310932252 None] Lock "cinder-quobyte-dbef070b-24cb-4709-9169-a655fafa334c" acquired by "delete_volume" :: waited 0.011s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:13:06 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[94e5c60d-69fd-4c7d-907e-a657cbd96363]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:13:06 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-565ff3ee-d05e-4175-9d5b-30f47d478823 tempest-GroupsV314Test-310932252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-dbef070b-24cb-4709-9169-a655fafa334c {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:06 devstack sudo[86160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-dbef070b-24cb-4709-9169-a655fafa334c
Apr 10 13:13:06 devstack sudo[86160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:06 devstack cinder-volume[83345]: DEBUG cinder.coordination [req-26a92b69-bfaf-4a27-a38a-44329e1164bb req-458cd6e6-6d17-487b-8e84-34227a602149 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Acquiring lock "cinder-6cdb5a15-786c-4e45-87c4-8658670b35e6-delete_volume" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:13:06 devstack cinder-volume[83345]: DEBUG cinder.coordination [req-26a92b69-bfaf-4a27-a38a-44329e1164bb req-458cd6e6-6d17-487b-8e84-34227a602149 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Lock "cinder-6cdb5a15-786c-4e45-87c4-8658670b35e6-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:13:07 devstack cinder-volume[83345]: DEBUG cinder.coordination [req-26a92b69-bfaf-4a27-a38a-44329e1164bb req-458cd6e6-6d17-487b-8e84-34227a602149 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Acquiring lock "cinder-quobyte-6cdb5a15-786c-4e45-87c4-8658670b35e6" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:13:07 devstack cinder-volume[83345]: DEBUG cinder.coordination [req-26a92b69-bfaf-4a27-a38a-44329e1164bb req-458cd6e6-6d17-487b-8e84-34227a602149 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Lock "cinder-quobyte-6cdb5a15-786c-4e45-87c4-8658670b35e6" acquired by "delete_volume" :: waited 0.015s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:13:07 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[141798c7-f2bd-41a7-ab7a-cba16bc11440]: (4, 'raw') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:13:07 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [req-26a92b69-bfaf-4a27-a38a-44329e1164bb req-458cd6e6-6d17-487b-8e84-34227a602149 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-6cdb5a15-786c-4e45-87c4-8658670b35e6 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:07 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-40ba2c10-f025-46ac-b456-3c64f458c9a7 tempest-GroupSnapshotsTest-2129977062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:13:07 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-40ba2c10-f025-46ac-b456-3c64f458c9a7 tempest-GroupSnapshotsTest-2129977062 None] Flow 'volume_create_manager' (315919cf-baf4-4b9a-9819-a6d09373437d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:13:07 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-40ba2c10-f025-46ac-b456-3c64f458c9a7 tempest-GroupSnapshotsTest-2129977062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6f563e1-b4ec-4e3c-93fa-e58cefa67895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:13:07 devstack sudo[86162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-6cdb5a15-786c-4e45-87c4-8658670b35e6
Apr 10 13:13:07 devstack sudo[86162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:07 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-40ba2c10-f025-46ac-b456-3c64f458c9a7 tempest-GroupSnapshotsTest-2129977062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6f563e1-b4ec-4e3c-93fa-e58cefa67895) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:13:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1233287537',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=0418a988-6571-4eb9-a9be-55b612b41fd3,host='devstack@QuobyteHD#QuobyteHD',id=3257e4cd-f375-49ff-b3df-7a7b6f0ee3d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83b6561967ad4eb28500542ade97ab3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:13:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:13:07Z,use_quota=True,user_id='83cee95bb380438c8ca284260999dfd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d52bcdf2-48ca-453f-be4f-007f15a9bc48),volume_type_id=d52bcdf2-48ca-453f-be4f-007f15a9bc48)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:13:07 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-40ba2c10-f025-46ac-b456-3c64f458c9a7 tempest-GroupSnapshotsTest-2129977062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5039a8c-bef1-4723-a90e-c38681699ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:13:07 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-40ba2c10-f025-46ac-b456-3c64f458c9a7 tempest-GroupSnapshotsTest-2129977062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5039a8c-bef1-4723-a90e-c38681699ea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:13:07 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-40ba2c10-f025-46ac-b456-3c64f458c9a7 tempest-GroupSnapshotsTest-2129977062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b61ff4ba-df64-41a8-acd2-bad2c33d9dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:13:07 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-40ba2c10-f025-46ac-b456-3c64f458c9a7 tempest-GroupSnapshotsTest-2129977062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b61ff4ba-df64-41a8-acd2-bad2c33d9dbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3257e4cd-f375-49ff-b3df-7a7b6f0ee3d9', 'volume_name': 'volume-3257e4cd-f375-49ff-b3df-7a7b6f0ee3d9', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:13:07 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-40ba2c10-f025-46ac-b456-3c64f458c9a7 tempest-GroupSnapshotsTest-2129977062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47f2c3c0-2706-4516-9dd0-5ca3f7902c28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:13:07 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-40ba2c10-f025-46ac-b456-3c64f458c9a7 tempest-GroupSnapshotsTest-2129977062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47f2c3c0-2706-4516-9dd0-5ca3f7902c28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:13:07 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-40ba2c10-f025-46ac-b456-3c64f458c9a7 tempest-GroupSnapshotsTest-2129977062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5912ca04-0d7d-4697-9e27-8b693701cdc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:13:07 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-40ba2c10-f025-46ac-b456-3c64f458c9a7 tempest-GroupSnapshotsTest-2129977062 None] Volume 3257e4cd-f375-49ff-b3df-7a7b6f0ee3d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3257e4cd-f375-49ff-b3df-7a7b6f0ee3d9', 'volume_size': 1}
Apr 10 13:13:07 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-40ba2c10-f025-46ac-b456-3c64f458c9a7 tempest-GroupSnapshotsTest-2129977062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:13:07 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-40ba2c10-f025-46ac-b456-3c64f458c9a7 tempest-GroupSnapshotsTest-2129977062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:13:07 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-40ba2c10-f025-46ac-b456-3c64f458c9a7 tempest-GroupSnapshotsTest-2129977062 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f252bf08b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=0418a988-6571-4eb9-a9be-55b612b41fd3,created_at=2026-04-10T11:13:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1233287537',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=0418a988-6571-4eb9-a9be-55b612b41fd3,host='devstack@QuobyteHD#QuobyteHD',id=3257e4cd-f375-49ff-b3df-7a7b6f0ee3d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83b6561967ad4eb28500542ade97ab3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:13:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:13:07Z,use_quota=True,user_id='83cee95bb380438c8ca284260999dfd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d52bcdf2-48ca-453f-be4f-007f15a9bc48),volume_type_id=d52bcdf2-48ca-453f-be4f-007f15a9bc48)}" {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 13:13:07 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-40ba2c10-f025-46ac-b456-3c64f458c9a7 tempest-GroupSnapshotsTest-2129977062 None] Creating volume 3257e4cd-f375-49ff-b3df-7a7b6f0ee3d9 {{(pid=83345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 13:13:07 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-40ba2c10-f025-46ac-b456-3c64f458c9a7 tempest-GroupSnapshotsTest-2129977062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:13:07 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-40ba2c10-f025-46ac-b456-3c64f458c9a7 tempest-GroupSnapshotsTest-2129977062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:13:07 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-40ba2c10-f025-46ac-b456-3c64f458c9a7 tempest-GroupSnapshotsTest-2129977062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:13:07 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-40ba2c10-f025-46ac-b456-3c64f458c9a7 tempest-GroupSnapshotsTest-2129977062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:13:07 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-40ba2c10-f025-46ac-b456-3c64f458c9a7 tempest-GroupSnapshotsTest-2129977062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:13:07 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-40ba2c10-f025-46ac-b456-3c64f458c9a7 tempest-GroupSnapshotsTest-2129977062 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:13:07 devstack cinder-volume[83345]: INFO cinder.volume.drivers.remotefs [None req-40ba2c10-f025-46ac-b456-3c64f458c9a7 tempest-GroupSnapshotsTest-2129977062 None] casted to osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331
Apr 10 13:13:07 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-40ba2c10-f025-46ac-b456-3c64f458c9a7 tempest-GroupSnapshotsTest-2129977062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-3257e4cd-f375-49ff-b3df-7a7b6f0ee3d9 1073741824 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:07 devstack sudo[86164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-3257e4cd-f375-49ff-b3df-7a7b6f0ee3d9 1073741824
Apr 10 13:13:07 devstack sudo[86164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:07 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-eeb43596-9f56-46ba-a507-5a09e6093e6b tempest-VolumesActionsTest-1285107848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:13:07 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-eeb43596-9f56-46ba-a507-5a09e6093e6b tempest-VolumesActionsTest-1285107848 None] Flow 'volume_create_manager' (281b5a13-e20b-4b95-904a-6ce5bc75ae4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:13:07 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-eeb43596-9f56-46ba-a507-5a09e6093e6b tempest-VolumesActionsTest-1285107848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed77335e-bbe3-454c-94bf-a849e8f98b10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:13:07 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-eeb43596-9f56-46ba-a507-5a09e6093e6b tempest-VolumesActionsTest-1285107848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed77335e-bbe3-454c-94bf-a849e8f98b10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:13:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1558416958',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0203a01-5c3f-4caa-8a58-ed8651242002,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2551b2b6cd9f4994a93b4b15e32392da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:13:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:13:07Z,use_quota=True,user_id='aa1e9a5c093744c0a889c58c163c8c1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:13:07 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-eeb43596-9f56-46ba-a507-5a09e6093e6b tempest-VolumesActionsTest-1285107848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50d6ebc5-576f-4627-9c09-5f8928abec45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:13:07 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-eeb43596-9f56-46ba-a507-5a09e6093e6b tempest-VolumesActionsTest-1285107848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50d6ebc5-576f-4627-9c09-5f8928abec45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:13:07 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-eeb43596-9f56-46ba-a507-5a09e6093e6b tempest-VolumesActionsTest-1285107848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb0abf7a-0ceb-473b-8917-556f59a2f183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:13:07 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-eeb43596-9f56-46ba-a507-5a09e6093e6b tempest-VolumesActionsTest-1285107848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb0abf7a-0ceb-473b-8917-556f59a2f183) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0203a01-5c3f-4caa-8a58-ed8651242002', 'volume_name': 'volume-a0203a01-5c3f-4caa-8a58-ed8651242002', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:13:07 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-eeb43596-9f56-46ba-a507-5a09e6093e6b tempest-VolumesActionsTest-1285107848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94704207-63c7-45f6-aa8f-f66778b9df8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:13:07 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-eeb43596-9f56-46ba-a507-5a09e6093e6b tempest-VolumesActionsTest-1285107848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94704207-63c7-45f6-aa8f-f66778b9df8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:13:07 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-eeb43596-9f56-46ba-a507-5a09e6093e6b tempest-VolumesActionsTest-1285107848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e768ac34-49ca-4493-adc5-6554a5ef7355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:13:07 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-eeb43596-9f56-46ba-a507-5a09e6093e6b tempest-VolumesActionsTest-1285107848 None] Volume a0203a01-5c3f-4caa-8a58-ed8651242002: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0203a01-5c3f-4caa-8a58-ed8651242002', 'volume_size': 1}
Apr 10 13:13:07 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-eeb43596-9f56-46ba-a507-5a09e6093e6b tempest-VolumesActionsTest-1285107848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:13:07 devstack sudo[86160]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:07 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-565ff3ee-d05e-4175-9d5b-30f47d478823 tempest-GroupsV314Test-310932252 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-dbef070b-24cb-4709-9169-a655fafa334c" returned: 0 in 0.623s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:07 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-565ff3ee-d05e-4175-9d5b-30f47d478823 tempest-GroupsV314Test-310932252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-dbef070b-24cb-4709-9169-a655fafa334c {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:07 devstack sudo[86169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-dbef070b-24cb-4709-9169-a655fafa334c
Apr 10 13:13:07 devstack sudo[86169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:07 devstack sudo[86162]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:07 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [req-26a92b69-bfaf-4a27-a38a-44329e1164bb req-458cd6e6-6d17-487b-8e84-34227a602149 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-6cdb5a15-786c-4e45-87c4-8658670b35e6" returned: 0 in 0.588s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:07 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [req-26a92b69-bfaf-4a27-a38a-44329e1164bb req-458cd6e6-6d17-487b-8e84-34227a602149 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-6cdb5a15-786c-4e45-87c4-8658670b35e6 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:07 devstack sudo[86176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-6cdb5a15-786c-4e45-87c4-8658670b35e6
Apr 10 13:13:07 devstack sudo[86176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:07 devstack sudo[86164]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:07 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-40ba2c10-f025-46ac-b456-3c64f458c9a7 tempest-GroupSnapshotsTest-2129977062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-3257e4cd-f375-49ff-b3df-7a7b6f0ee3d9 1073741824" returned: 0 in 0.596s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:07 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-40ba2c10-f025-46ac-b456-3c64f458c9a7 tempest-GroupSnapshotsTest-2129977062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-3257e4cd-f375-49ff-b3df-7a7b6f0ee3d9 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:07 devstack sudo[86178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-3257e4cd-f375-49ff-b3df-7a7b6f0ee3d9
Apr 10 13:13:07 devstack sudo[86178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:08 devstack sudo[86169]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:08 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-565ff3ee-d05e-4175-9d5b-30f47d478823 tempest-GroupsV314Test-310932252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-dbef070b-24cb-4709-9169-a655fafa334c" returned: 0 in 0.543s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:08 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-565ff3ee-d05e-4175-9d5b-30f47d478823 tempest-GroupsV314Test-310932252 None] Lock "cinder-quobyte-dbef070b-24cb-4709-9169-a655fafa334c" released by "delete_volume" :: held 1.204s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:13:08 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-565ff3ee-d05e-4175-9d5b-30f47d478823 tempest-GroupsV314Test-310932252 None] Created reservations ['e4f0355f-9c71-437b-893f-cd8464eecde4'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:13:08 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-565ff3ee-d05e-4175-9d5b-30f47d478823 tempest-GroupsV314Test-310932252 None] Created reservations ['fab56892-4839-486a-a2a3-4478bf277913', '588fe157-60b0-4036-8135-339a860cde9d', '5841d78c-83af-4d2a-b94c-b193cee24787', 'b97c97df-d158-4826-996d-9b66e2e577bc'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:13:08 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-565ff3ee-d05e-4175-9d5b-30f47d478823 tempest-GroupsV314Test-310932252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:13:08 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-565ff3ee-d05e-4175-9d5b-30f47d478823 tempest-GroupsV314Test-310932252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:13:08 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-565ff3ee-d05e-4175-9d5b-30f47d478823 tempest-GroupsV314Test-310932252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:13:08 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-565ff3ee-d05e-4175-9d5b-30f47d478823 tempest-GroupsV314Test-310932252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:13:08 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-565ff3ee-d05e-4175-9d5b-30f47d478823 tempest-GroupsV314Test-310932252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:13:08 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-565ff3ee-d05e-4175-9d5b-30f47d478823 tempest-GroupsV314Test-310932252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:08 devstack sudo[86182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:13:08 devstack sudo[86182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:08 devstack sudo[86176]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:08 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [req-26a92b69-bfaf-4a27-a38a-44329e1164bb req-458cd6e6-6d17-487b-8e84-34227a602149 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-6cdb5a15-786c-4e45-87c4-8658670b35e6" returned: 1 in 0.592s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:08 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [req-26a92b69-bfaf-4a27-a38a-44329e1164bb req-458cd6e6-6d17-487b-8e84-34227a602149 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-6cdb5a15-786c-4e45-87c4-8658670b35e6' failed. Not Retrying. {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 10 13:13:08 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [req-26a92b69-bfaf-4a27-a38a-44329e1164bb req-458cd6e6-6d17-487b-8e84-34227a602149 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-6cdb5a15-786c-4e45-87c4-8658670b35e6 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:08 devstack sudo[86187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-6cdb5a15-786c-4e45-87c4-8658670b35e6
Apr 10 13:13:08 devstack sudo[86187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:08 devstack sudo[86178]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:08 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-40ba2c10-f025-46ac-b456-3c64f458c9a7 tempest-GroupSnapshotsTest-2129977062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-3257e4cd-f375-49ff-b3df-7a7b6f0ee3d9" returned: 0 in 0.505s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:08 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-40ba2c10-f025-46ac-b456-3c64f458c9a7 tempest-GroupSnapshotsTest-2129977062 None] <== create_volume: return (1128ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'} {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 13:13:08 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-40ba2c10-f025-46ac-b456-3c64f458c9a7 tempest-GroupSnapshotsTest-2129977062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.130s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:13:08 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-eeb43596-9f56-46ba-a507-5a09e6093e6b tempest-VolumesActionsTest-1285107848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.910s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:13:08 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-eeb43596-9f56-46ba-a507-5a09e6093e6b tempest-VolumesActionsTest-1285107848 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f252bf08b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:13:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1558416958',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0203a01-5c3f-4caa-8a58-ed8651242002,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2551b2b6cd9f4994a93b4b15e32392da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:13:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:13:07Z,use_quota=True,user_id='aa1e9a5c093744c0a889c58c163c8c1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)}" {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 13:13:08 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-eeb43596-9f56-46ba-a507-5a09e6093e6b tempest-VolumesActionsTest-1285107848 None] Creating volume a0203a01-5c3f-4caa-8a58-ed8651242002 {{(pid=83345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 13:13:08 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-eeb43596-9f56-46ba-a507-5a09e6093e6b tempest-VolumesActionsTest-1285107848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:13:08 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-eeb43596-9f56-46ba-a507-5a09e6093e6b tempest-VolumesActionsTest-1285107848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:13:08 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-eeb43596-9f56-46ba-a507-5a09e6093e6b tempest-VolumesActionsTest-1285107848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:13:08 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-eeb43596-9f56-46ba-a507-5a09e6093e6b tempest-VolumesActionsTest-1285107848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:13:08 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-eeb43596-9f56-46ba-a507-5a09e6093e6b tempest-VolumesActionsTest-1285107848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:13:08 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-eeb43596-9f56-46ba-a507-5a09e6093e6b tempest-VolumesActionsTest-1285107848 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:13:08 devstack cinder-volume[83345]: INFO cinder.volume.drivers.remotefs [None req-eeb43596-9f56-46ba-a507-5a09e6093e6b tempest-VolumesActionsTest-1285107848 None] casted to osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331
Apr 10 13:13:08 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-eeb43596-9f56-46ba-a507-5a09e6093e6b tempest-VolumesActionsTest-1285107848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-a0203a01-5c3f-4caa-8a58-ed8651242002 1073741824 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:08 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-40ba2c10-f025-46ac-b456-3c64f458c9a7 tempest-GroupSnapshotsTest-2129977062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5912ca04-0d7d-4697-9e27-8b693701cdc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3257e4cd-f375-49ff-b3df-7a7b6f0ee3d9', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:13:08 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-40ba2c10-f025-46ac-b456-3c64f458c9a7 tempest-GroupSnapshotsTest-2129977062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dadec63-fc1f-47fe-9b2f-a3c8b1002b88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:13:08 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-40ba2c10-f025-46ac-b456-3c64f458c9a7 tempest-GroupSnapshotsTest-2129977062 None] Volume volume-3257e4cd-f375-49ff-b3df-7a7b6f0ee3d9 (3257e4cd-f375-49ff-b3df-7a7b6f0ee3d9): created successfully
Apr 10 13:13:08 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-40ba2c10-f025-46ac-b456-3c64f458c9a7 tempest-GroupSnapshotsTest-2129977062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dadec63-fc1f-47fe-9b2f-a3c8b1002b88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:13:08 devstack sudo[86189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-a0203a01-5c3f-4caa-8a58-ed8651242002 1073741824
Apr 10 13:13:08 devstack sudo[86189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:08 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-40ba2c10-f025-46ac-b456-3c64f458c9a7 tempest-GroupSnapshotsTest-2129977062 None] Flow 'volume_create_manager' (315919cf-baf4-4b9a-9819-a6d09373437d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:13:08 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-40ba2c10-f025-46ac-b456-3c64f458c9a7 tempest-GroupSnapshotsTest-2129977062 None] Created volume successfully.
Apr 10 13:13:08 devstack sudo[86182]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:08 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-565ff3ee-d05e-4175-9d5b-30f47d478823 tempest-GroupsV314Test-310932252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.426s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:08 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-565ff3ee-d05e-4175-9d5b-30f47d478823 tempest-GroupsV314Test-310932252 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:13:08 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-565ff3ee-d05e-4175-9d5b-30f47d478823 tempest-GroupsV314Test-310932252 None] Delete group completed successfully.
Apr 10 13:13:08 devstack sudo[86187]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:08 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [req-26a92b69-bfaf-4a27-a38a-44329e1164bb req-458cd6e6-6d17-487b-8e84-34227a602149 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-6cdb5a15-786c-4e45-87c4-8658670b35e6" returned: 0 in 0.450s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:08 devstack cinder-volume[83345]: DEBUG cinder.coordination [req-26a92b69-bfaf-4a27-a38a-44329e1164bb req-458cd6e6-6d17-487b-8e84-34227a602149 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Lock "cinder-quobyte-6cdb5a15-786c-4e45-87c4-8658670b35e6" released by "delete_volume" :: held 1.702s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:13:08 devstack cinder-volume[83345]: DEBUG cinder.quota [req-26a92b69-bfaf-4a27-a38a-44329e1164bb req-458cd6e6-6d17-487b-8e84-34227a602149 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Created reservations ['5488ede4-ca04-4535-ac3b-a79380152edf', '133b1d2a-9a00-4b4b-9c14-fdabe247a505', '02c686fa-de20-41ae-a7d1-6b378e2ad82b', 'e247d36b-a18f-4d83-9ee5-367e8a87337a'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:13:08 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [req-26a92b69-bfaf-4a27-a38a-44329e1164bb req-458cd6e6-6d17-487b-8e84-34227a602149 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:13:08 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [req-26a92b69-bfaf-4a27-a38a-44329e1164bb req-458cd6e6-6d17-487b-8e84-34227a602149 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:13:08 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [req-26a92b69-bfaf-4a27-a38a-44329e1164bb req-458cd6e6-6d17-487b-8e84-34227a602149 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:13:08 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [req-26a92b69-bfaf-4a27-a38a-44329e1164bb req-458cd6e6-6d17-487b-8e84-34227a602149 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:13:08 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [req-26a92b69-bfaf-4a27-a38a-44329e1164bb req-458cd6e6-6d17-487b-8e84-34227a602149 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:13:08 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [req-26a92b69-bfaf-4a27-a38a-44329e1164bb req-458cd6e6-6d17-487b-8e84-34227a602149 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:08 devstack sudo[86196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:13:08 devstack sudo[86196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:08 devstack sudo[86189]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:08 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-eeb43596-9f56-46ba-a507-5a09e6093e6b tempest-VolumesActionsTest-1285107848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-a0203a01-5c3f-4caa-8a58-ed8651242002 1073741824" returned: 0 in 0.534s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:08 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-eeb43596-9f56-46ba-a507-5a09e6093e6b tempest-VolumesActionsTest-1285107848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-a0203a01-5c3f-4caa-8a58-ed8651242002 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:08 devstack sudo[86198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-a0203a01-5c3f-4caa-8a58-ed8651242002
Apr 10 13:13:08 devstack sudo[86198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:09 devstack sudo[86196]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:09 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [req-26a92b69-bfaf-4a27-a38a-44329e1164bb req-458cd6e6-6d17-487b-8e84-34227a602149 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.477s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:09 devstack cinder-volume[83345]: DEBUG cinder.manager [req-26a92b69-bfaf-4a27-a38a-44329e1164bb req-458cd6e6-6d17-487b-8e84-34227a602149 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:13:09 devstack cinder-volume[83345]: INFO cinder.volume.manager [req-26a92b69-bfaf-4a27-a38a-44329e1164bb req-458cd6e6-6d17-487b-8e84-34227a602149 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Deleted volume successfully.
Apr 10 13:13:09 devstack cinder-volume[83345]: DEBUG cinder.coordination [req-26a92b69-bfaf-4a27-a38a-44329e1164bb req-458cd6e6-6d17-487b-8e84-34227a602149 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Lock "cinder-6cdb5a15-786c-4e45-87c4-8658670b35e6-delete_volume" released by "delete_volume" :: held 2.353s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:13:09 devstack sudo[86198]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:09 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-eeb43596-9f56-46ba-a507-5a09e6093e6b tempest-VolumesActionsTest-1285107848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-a0203a01-5c3f-4caa-8a58-ed8651242002" returned: 0 in 0.500s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:09 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-eeb43596-9f56-46ba-a507-5a09e6093e6b tempest-VolumesActionsTest-1285107848 None] <== create_volume: return (1062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'} {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 13:13:09 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-eeb43596-9f56-46ba-a507-5a09e6093e6b tempest-VolumesActionsTest-1285107848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.065s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:13:09 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-eeb43596-9f56-46ba-a507-5a09e6093e6b tempest-VolumesActionsTest-1285107848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e768ac34-49ca-4493-adc5-6554a5ef7355) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0203a01-5c3f-4caa-8a58-ed8651242002', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:13:09 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-eeb43596-9f56-46ba-a507-5a09e6093e6b tempest-VolumesActionsTest-1285107848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (321ed6c7-af39-4ed7-b9af-fd4f9cff7a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:13:09 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-f53f72b1-e927-473e-8bd2-90c6ea013a22 tempest-GroupSnapshotsTest-2129977062 None] GroupSnapshot 627df150-5422-4b40-bca7-790adf48962d: creating.
Apr 10 13:13:09 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-eeb43596-9f56-46ba-a507-5a09e6093e6b tempest-VolumesActionsTest-1285107848 None] Volume volume-a0203a01-5c3f-4caa-8a58-ed8651242002 (a0203a01-5c3f-4caa-8a58-ed8651242002): created successfully
Apr 10 13:13:09 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-eeb43596-9f56-46ba-a507-5a09e6093e6b tempest-VolumesActionsTest-1285107848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (321ed6c7-af39-4ed7-b9af-fd4f9cff7a70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:13:09 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-eeb43596-9f56-46ba-a507-5a09e6093e6b tempest-VolumesActionsTest-1285107848 None] Flow 'volume_create_manager' (281b5a13-e20b-4b95-904a-6ce5bc75ae4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:13:09 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-f53f72b1-e927-473e-8bd2-90c6ea013a22 tempest-GroupSnapshotsTest-2129977062 None] Group snapshot 627df150-5422-4b40-bca7-790adf48962d: creating. {{(pid=83345) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 10 13:13:09 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-f53f72b1-e927-473e-8bd2-90c6ea013a22 tempest-GroupSnapshotsTest-2129977062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:13:09 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-f53f72b1-e927-473e-8bd2-90c6ea013a22 tempest-GroupSnapshotsTest-2129977062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:13:09 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-eeb43596-9f56-46ba-a507-5a09e6093e6b tempest-VolumesActionsTest-1285107848 None] Created volume successfully.
Apr 10 13:13:09 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-f53f72b1-e927-473e-8bd2-90c6ea013a22 tempest-GroupSnapshotsTest-2129977062 None] Creating offline snapshot 0f50a9d6-a952-4b41-8a99-f0dc8c421460 of volume 3257e4cd-f375-49ff-b3df-7a7b6f0ee3d9 {{(pid=83345) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 10 13:13:09 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[4819232c-e64e-4294-ba71-58498c0fb2b4]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:13:09 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-f53f72b1-e927-473e-8bd2-90c6ea013a22 tempest-GroupSnapshotsTest-2129977062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-3257e4cd-f375-49ff-b3df-7a7b6f0ee3d9 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:09 devstack sudo[86202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-3257e4cd-f375-49ff-b3df-7a7b6f0ee3d9
Apr 10 13:13:09 devstack sudo[86202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:10 devstack sudo[86202]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:10 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-f53f72b1-e927-473e-8bd2-90c6ea013a22 tempest-GroupSnapshotsTest-2129977062 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-3257e4cd-f375-49ff-b3df-7a7b6f0ee3d9" returned: 0 in 0.531s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:10 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-f53f72b1-e927-473e-8bd2-90c6ea013a22 tempest-GroupSnapshotsTest-2129977062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-3257e4cd-f375-49ff-b3df-7a7b6f0ee3d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-3257e4cd-f375-49ff-b3df-7a7b6f0ee3d9.0f50a9d6-a952-4b41-8a99-f0dc8c421460 1G {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:10 devstack sudo[86207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-3257e4cd-f375-49ff-b3df-7a7b6f0ee3d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-3257e4cd-f375-49ff-b3df-7a7b6f0ee3d9.0f50a9d6-a952-4b41-8a99-f0dc8c421460 1G
Apr 10 13:13:10 devstack sudo[86207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:10 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-51d7e42e-65f1-4703-8b39-238d48106873 tempest-VolumesActionsTest-1102846807 None] Acquiring lock "cinder-a0203a01-5c3f-4caa-8a58-ed8651242002-delete_volume" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:13:10 devstack sudo[86207]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:10 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-f53f72b1-e927-473e-8bd2-90c6ea013a22 tempest-GroupSnapshotsTest-2129977062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-3257e4cd-f375-49ff-b3df-7a7b6f0ee3d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-3257e4cd-f375-49ff-b3df-7a7b6f0ee3d9.0f50a9d6-a952-4b41-8a99-f0dc8c421460 1G" returned: 0 in 0.738s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:10 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-f53f72b1-e927-473e-8bd2-90c6ea013a22 tempest-GroupSnapshotsTest-2129977062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3257e4cd-f375-49ff-b3df-7a7b6f0ee3d9 -F qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-3257e4cd-f375-49ff-b3df-7a7b6f0ee3d9.0f50a9d6-a952-4b41-8a99-f0dc8c421460 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:10 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-51d7e42e-65f1-4703-8b39-238d48106873 tempest-VolumesActionsTest-1102846807 None] Lock "cinder-a0203a01-5c3f-4caa-8a58-ed8651242002-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:13:10 devstack sudo[86213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3257e4cd-f375-49ff-b3df-7a7b6f0ee3d9 -F qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-3257e4cd-f375-49ff-b3df-7a7b6f0ee3d9.0f50a9d6-a952-4b41-8a99-f0dc8c421460
Apr 10 13:13:10 devstack sudo[86213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:10 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-51d7e42e-65f1-4703-8b39-238d48106873 tempest-VolumesActionsTest-1102846807 None] Acquiring lock "cinder-quobyte-a0203a01-5c3f-4caa-8a58-ed8651242002" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:13:10 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-51d7e42e-65f1-4703-8b39-238d48106873 tempest-VolumesActionsTest-1102846807 None] Lock "cinder-quobyte-a0203a01-5c3f-4caa-8a58-ed8651242002" acquired by "delete_volume" :: waited 0.010s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:13:10 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f4aef02-3339-4b98-83e6-9be8883268b8]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:13:10 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-51d7e42e-65f1-4703-8b39-238d48106873 tempest-VolumesActionsTest-1102846807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-a0203a01-5c3f-4caa-8a58-ed8651242002 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:11 devstack sudo[86215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-a0203a01-5c3f-4caa-8a58-ed8651242002
Apr 10 13:13:11 devstack sudo[86215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:11 devstack sudo[86213]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:11 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-f53f72b1-e927-473e-8bd2-90c6ea013a22 tempest-GroupSnapshotsTest-2129977062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3257e4cd-f375-49ff-b3df-7a7b6f0ee3d9 -F qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-3257e4cd-f375-49ff-b3df-7a7b6f0ee3d9.0f50a9d6-a952-4b41-8a99-f0dc8c421460" returned: 0 in 0.544s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:11 devstack cinder-volume[83345]: WARNING cinder.volume.drivers.remotefs [None req-f53f72b1-e927-473e-8bd2-90c6ea013a22 tempest-GroupSnapshotsTest-2129977062 None] /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-3257e4cd-f375-49ff-b3df-7a7b6f0ee3d9.0f50a9d6-a952-4b41-8a99-f0dc8c421460 is being set with open permissions: ugo+rw: NotImplementedError
Apr 10 13:13:11 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-f53f72b1-e927-473e-8bd2-90c6ea013a22 tempest-GroupSnapshotsTest-2129977062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-3257e4cd-f375-49ff-b3df-7a7b6f0ee3d9.0f50a9d6-a952-4b41-8a99-f0dc8c421460 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:11 devstack sudo[86220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-3257e4cd-f375-49ff-b3df-7a7b6f0ee3d9.0f50a9d6-a952-4b41-8a99-f0dc8c421460
Apr 10 13:13:11 devstack sudo[86220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:11 devstack sudo[86215]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:11 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-51d7e42e-65f1-4703-8b39-238d48106873 tempest-VolumesActionsTest-1102846807 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-a0203a01-5c3f-4caa-8a58-ed8651242002" returned: 0 in 0.560s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:11 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-51d7e42e-65f1-4703-8b39-238d48106873 tempest-VolumesActionsTest-1102846807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-a0203a01-5c3f-4caa-8a58-ed8651242002 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:11 devstack sudo[86226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-a0203a01-5c3f-4caa-8a58-ed8651242002
Apr 10 13:13:11 devstack sudo[86226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:11 devstack sudo[86220]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:11 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-f53f72b1-e927-473e-8bd2-90c6ea013a22 tempest-GroupSnapshotsTest-2129977062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-3257e4cd-f375-49ff-b3df-7a7b6f0ee3d9.0f50a9d6-a952-4b41-8a99-f0dc8c421460" returned: 0 in 0.504s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:11 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-f53f72b1-e927-473e-8bd2-90c6ea013a22 tempest-GroupSnapshotsTest-2129977062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-3257e4cd-f375-49ff-b3df-7a7b6f0ee3d9.info {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:11 devstack sudo[86237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-3257e4cd-f375-49ff-b3df-7a7b6f0ee3d9.info
Apr 10 13:13:11 devstack sudo[86237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:12 devstack sudo[86226]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:12 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-51d7e42e-65f1-4703-8b39-238d48106873 tempest-VolumesActionsTest-1102846807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-a0203a01-5c3f-4caa-8a58-ed8651242002" returned: 0 in 0.702s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:12 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-51d7e42e-65f1-4703-8b39-238d48106873 tempest-VolumesActionsTest-1102846807 None] Lock "cinder-quobyte-a0203a01-5c3f-4caa-8a58-ed8651242002" released by "delete_volume" :: held 1.301s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:13:12 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-51d7e42e-65f1-4703-8b39-238d48106873 tempest-VolumesActionsTest-1102846807 None] Created reservations ['cb3874b7-5b94-456c-aac6-72b3dfda6f82', 'ab2b9e54-3b7d-475f-a4d1-10660db53365', '80dac958-9a42-478e-bab6-fcda1c928a8b', 'aedac367-8637-4fa4-8908-91f07ee62ef9'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:13:12 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-51d7e42e-65f1-4703-8b39-238d48106873 tempest-VolumesActionsTest-1102846807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:13:12 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-51d7e42e-65f1-4703-8b39-238d48106873 tempest-VolumesActionsTest-1102846807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:13:12 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-51d7e42e-65f1-4703-8b39-238d48106873 tempest-VolumesActionsTest-1102846807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:13:12 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-51d7e42e-65f1-4703-8b39-238d48106873 tempest-VolumesActionsTest-1102846807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:13:12 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-51d7e42e-65f1-4703-8b39-238d48106873 tempest-VolumesActionsTest-1102846807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:13:12 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-51d7e42e-65f1-4703-8b39-238d48106873 tempest-VolumesActionsTest-1102846807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:12 devstack sudo[86260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:13:12 devstack sudo[86260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:12 devstack sudo[86237]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:12 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-f53f72b1-e927-473e-8bd2-90c6ea013a22 tempest-GroupSnapshotsTest-2129977062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-3257e4cd-f375-49ff-b3df-7a7b6f0ee3d9.info" returned: 0 in 0.599s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:12 devstack cinder-volume[83345]: WARNING cinder.volume.drivers.remotefs [None req-f53f72b1-e927-473e-8bd2-90c6ea013a22 tempest-GroupSnapshotsTest-2129977062 None] /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-3257e4cd-f375-49ff-b3df-7a7b6f0ee3d9.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 10 13:13:12 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-f53f72b1-e927-473e-8bd2-90c6ea013a22 tempest-GroupSnapshotsTest-2129977062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-3257e4cd-f375-49ff-b3df-7a7b6f0ee3d9.info {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:12 devstack sudo[86270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-3257e4cd-f375-49ff-b3df-7a7b6f0ee3d9.info
Apr 10 13:13:12 devstack sudo[86270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:12 devstack sudo[86260]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:12 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-51d7e42e-65f1-4703-8b39-238d48106873 tempest-VolumesActionsTest-1102846807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.593s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:12 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-51d7e42e-65f1-4703-8b39-238d48106873 tempest-VolumesActionsTest-1102846807 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:13:12 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-51d7e42e-65f1-4703-8b39-238d48106873 tempest-VolumesActionsTest-1102846807 None] Deleted volume successfully.
Apr 10 13:13:12 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-51d7e42e-65f1-4703-8b39-238d48106873 tempest-VolumesActionsTest-1102846807 None] Lock "cinder-a0203a01-5c3f-4caa-8a58-ed8651242002-delete_volume" released by "delete_volume" :: held 2.100s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:13:12 devstack sudo[86270]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:12 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-f53f72b1-e927-473e-8bd2-90c6ea013a22 tempest-GroupSnapshotsTest-2129977062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-3257e4cd-f375-49ff-b3df-7a7b6f0ee3d9.info" returned: 0 in 0.486s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:12 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-f53f72b1-e927-473e-8bd2-90c6ea013a22 tempest-GroupSnapshotsTest-2129977062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.466s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:13:13 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-f53f72b1-e927-473e-8bd2-90c6ea013a22 tempest-GroupSnapshotsTest-2129977062 None] group_snapshot 627df150-5422-4b40-bca7-790adf48962d: created successfully
Apr 10 13:13:13 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cfdf72e-413b-4b9f-bfd9-78e8a5a95ba5 tempest-VolumesActionsTest-1285107848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:13:13 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-7cfdf72e-413b-4b9f-bfd9-78e8a5a95ba5 tempest-VolumesActionsTest-1285107848 None] Flow 'volume_create_manager' (90dfe8ef-c8dd-450e-89be-6c8ff58c121e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:13:13 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-7cfdf72e-413b-4b9f-bfd9-78e8a5a95ba5 tempest-VolumesActionsTest-1285107848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (447dc90f-4bf1-45af-8be1-4376a852b1d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:13:13 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-7cfdf72e-413b-4b9f-bfd9-78e8a5a95ba5 tempest-VolumesActionsTest-1285107848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (447dc90f-4bf1-45af-8be1-4376a852b1d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:13:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-393244194',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02e6445a-556d-4e10-9aeb-ba760587c544,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2551b2b6cd9f4994a93b4b15e32392da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:13:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:13:13Z,use_quota=True,user_id='aa1e9a5c093744c0a889c58c163c8c1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:13:13 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-7cfdf72e-413b-4b9f-bfd9-78e8a5a95ba5 tempest-VolumesActionsTest-1285107848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53d68b0d-3eef-4e16-a34e-7c77a402b4f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:13:13 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-7cfdf72e-413b-4b9f-bfd9-78e8a5a95ba5 tempest-VolumesActionsTest-1285107848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53d68b0d-3eef-4e16-a34e-7c77a402b4f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:13:13 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-7cfdf72e-413b-4b9f-bfd9-78e8a5a95ba5 tempest-VolumesActionsTest-1285107848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbcc776f-03b3-4681-9489-a6377189375e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:13:13 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-7cfdf72e-413b-4b9f-bfd9-78e8a5a95ba5 tempest-VolumesActionsTest-1285107848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbcc776f-03b3-4681-9489-a6377189375e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02e6445a-556d-4e10-9aeb-ba760587c544', 'volume_name': 'volume-02e6445a-556d-4e10-9aeb-ba760587c544', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:13:13 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-7cfdf72e-413b-4b9f-bfd9-78e8a5a95ba5 tempest-VolumesActionsTest-1285107848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80daa653-1cc8-442b-b3e7-bca8269259c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:13:13 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-7cfdf72e-413b-4b9f-bfd9-78e8a5a95ba5 tempest-VolumesActionsTest-1285107848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80daa653-1cc8-442b-b3e7-bca8269259c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:13:13 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-7cfdf72e-413b-4b9f-bfd9-78e8a5a95ba5 tempest-VolumesActionsTest-1285107848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23393bc8-1f25-4ad7-b64b-adb7d634909d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:13:13 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-7cfdf72e-413b-4b9f-bfd9-78e8a5a95ba5 tempest-VolumesActionsTest-1285107848 None] Volume 02e6445a-556d-4e10-9aeb-ba760587c544: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02e6445a-556d-4e10-9aeb-ba760587c544', 'volume_size': 1}
Apr 10 13:13:13 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-7cfdf72e-413b-4b9f-bfd9-78e8a5a95ba5 tempest-VolumesActionsTest-1285107848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:13:13 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-7cfdf72e-413b-4b9f-bfd9-78e8a5a95ba5 tempest-VolumesActionsTest-1285107848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:13:13 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-7cfdf72e-413b-4b9f-bfd9-78e8a5a95ba5 tempest-VolumesActionsTest-1285107848 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f252bf08b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:13:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-393244194',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02e6445a-556d-4e10-9aeb-ba760587c544,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2551b2b6cd9f4994a93b4b15e32392da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:13:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:13:13Z,use_quota=True,user_id='aa1e9a5c093744c0a889c58c163c8c1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)}" {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 13:13:13 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-7cfdf72e-413b-4b9f-bfd9-78e8a5a95ba5 tempest-VolumesActionsTest-1285107848 None] Creating volume 02e6445a-556d-4e10-9aeb-ba760587c544 {{(pid=83345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 13:13:13 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-7cfdf72e-413b-4b9f-bfd9-78e8a5a95ba5 tempest-VolumesActionsTest-1285107848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:13:13 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-7cfdf72e-413b-4b9f-bfd9-78e8a5a95ba5 tempest-VolumesActionsTest-1285107848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:13:13 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-7cfdf72e-413b-4b9f-bfd9-78e8a5a95ba5 tempest-VolumesActionsTest-1285107848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:13:13 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-7cfdf72e-413b-4b9f-bfd9-78e8a5a95ba5 tempest-VolumesActionsTest-1285107848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:13:13 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-7cfdf72e-413b-4b9f-bfd9-78e8a5a95ba5 tempest-VolumesActionsTest-1285107848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:13:13 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-7cfdf72e-413b-4b9f-bfd9-78e8a5a95ba5 tempest-VolumesActionsTest-1285107848 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:13:13 devstack cinder-volume[83345]: INFO cinder.volume.drivers.remotefs [None req-7cfdf72e-413b-4b9f-bfd9-78e8a5a95ba5 tempest-VolumesActionsTest-1285107848 None] casted to osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331
Apr 10 13:13:13 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-7cfdf72e-413b-4b9f-bfd9-78e8a5a95ba5 tempest-VolumesActionsTest-1285107848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-02e6445a-556d-4e10-9aeb-ba760587c544 1073741824 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:13 devstack sudo[86278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-02e6445a-556d-4e10-9aeb-ba760587c544 1073741824
Apr 10 13:13:13 devstack sudo[86278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:14 devstack sudo[86278]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:14 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-7cfdf72e-413b-4b9f-bfd9-78e8a5a95ba5 tempest-VolumesActionsTest-1285107848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-02e6445a-556d-4e10-9aeb-ba760587c544 1073741824" returned: 0 in 0.679s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:14 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-7cfdf72e-413b-4b9f-bfd9-78e8a5a95ba5 tempest-VolumesActionsTest-1285107848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-02e6445a-556d-4e10-9aeb-ba760587c544 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:14 devstack sudo[86286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-02e6445a-556d-4e10-9aeb-ba760587c544
Apr 10 13:13:14 devstack sudo[86286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:14 devstack sudo[86286]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:14 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-7cfdf72e-413b-4b9f-bfd9-78e8a5a95ba5 tempest-VolumesActionsTest-1285107848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-02e6445a-556d-4e10-9aeb-ba760587c544" returned: 0 in 0.482s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:14 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-7cfdf72e-413b-4b9f-bfd9-78e8a5a95ba5 tempest-VolumesActionsTest-1285107848 None] <== create_volume: return (1191ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'} {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 13:13:14 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-7cfdf72e-413b-4b9f-bfd9-78e8a5a95ba5 tempest-VolumesActionsTest-1285107848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.193s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:13:14 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-7cfdf72e-413b-4b9f-bfd9-78e8a5a95ba5 tempest-VolumesActionsTest-1285107848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23393bc8-1f25-4ad7-b64b-adb7d634909d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02e6445a-556d-4e10-9aeb-ba760587c544', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:13:14 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-7cfdf72e-413b-4b9f-bfd9-78e8a5a95ba5 tempest-VolumesActionsTest-1285107848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34cacdba-b982-45fe-9e1c-8c53b5c333f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:13:14 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-7cfdf72e-413b-4b9f-bfd9-78e8a5a95ba5 tempest-VolumesActionsTest-1285107848 None] Volume volume-02e6445a-556d-4e10-9aeb-ba760587c544 (02e6445a-556d-4e10-9aeb-ba760587c544): created successfully
Apr 10 13:13:14 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-7cfdf72e-413b-4b9f-bfd9-78e8a5a95ba5 tempest-VolumesActionsTest-1285107848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34cacdba-b982-45fe-9e1c-8c53b5c333f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:13:14 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-7cfdf72e-413b-4b9f-bfd9-78e8a5a95ba5 tempest-VolumesActionsTest-1285107848 None] Flow 'volume_create_manager' (90dfe8ef-c8dd-450e-89be-6c8ff58c121e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:13:14 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-790d64a2-b93b-40bc-8a11-30ba3c4ca55f tempest-GroupSnapshotsTest-2129977062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:13:14 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-790d64a2-b93b-40bc-8a11-30ba3c4ca55f tempest-GroupSnapshotsTest-2129977062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:13:14 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-790d64a2-b93b-40bc-8a11-30ba3c4ca55f tempest-GroupSnapshotsTest-2129977062 None] Acquiring lock "cinder-quobyte-0f50a9d6-a952-4b41-8a99-f0dc8c421460-dd1ee53a-6e65-48f4-b195-67aa486004fc" by "_create_volume_from_snapshot" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:13:14 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-7cfdf72e-413b-4b9f-bfd9-78e8a5a95ba5 tempest-VolumesActionsTest-1285107848 None] Created volume successfully.
Apr 10 13:13:14 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-790d64a2-b93b-40bc-8a11-30ba3c4ca55f tempest-GroupSnapshotsTest-2129977062 None] Lock "cinder-quobyte-0f50a9d6-a952-4b41-8a99-f0dc8c421460-dd1ee53a-6e65-48f4-b195-67aa486004fc" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:13:14 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-790d64a2-b93b-40bc-8a11-30ba3c4ca55f tempest-GroupSnapshotsTest-2129977062 None] Creating volume dd1ee53a-6e65-48f4-b195-67aa486004fc from snapshot 0f50a9d6-a952-4b41-8a99-f0dc8c421460 {{(pid=83345) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 10 13:13:14 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-790d64a2-b93b-40bc-8a11-30ba3c4ca55f tempest-GroupSnapshotsTest-2129977062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:13:14 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-790d64a2-b93b-40bc-8a11-30ba3c4ca55f tempest-GroupSnapshotsTest-2129977062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:13:14 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-790d64a2-b93b-40bc-8a11-30ba3c4ca55f tempest-GroupSnapshotsTest-2129977062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:13:14 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-790d64a2-b93b-40bc-8a11-30ba3c4ca55f tempest-GroupSnapshotsTest-2129977062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:13:14 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-790d64a2-b93b-40bc-8a11-30ba3c4ca55f tempest-GroupSnapshotsTest-2129977062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:13:14 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-790d64a2-b93b-40bc-8a11-30ba3c4ca55f tempest-GroupSnapshotsTest-2129977062 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:13:14 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-790d64a2-b93b-40bc-8a11-30ba3c4ca55f tempest-GroupSnapshotsTest-2129977062 None] Acquiring lock "cinder-quobyte-dd1ee53a-6e65-48f4-b195-67aa486004fc" by "_copy_volume_from_snapshot" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:13:14 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-790d64a2-b93b-40bc-8a11-30ba3c4ca55f tempest-GroupSnapshotsTest-2129977062 None] Lock "cinder-quobyte-dd1ee53a-6e65-48f4-b195-67aa486004fc" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:13:14 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-790d64a2-b93b-40bc-8a11-30ba3c4ca55f tempest-GroupSnapshotsTest-2129977062 None] snapshot: 0f50a9d6-a952-4b41-8a99-f0dc8c421460, volume: dd1ee53a-6e65-48f4-b195-67aa486004fc,  {{(pid=83345) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 10 13:13:14 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-790d64a2-b93b-40bc-8a11-30ba3c4ca55f tempest-GroupSnapshotsTest-2129977062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:13:14 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-790d64a2-b93b-40bc-8a11-30ba3c4ca55f tempest-GroupSnapshotsTest-2129977062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:13:14 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-790d64a2-b93b-40bc-8a11-30ba3c4ca55f tempest-GroupSnapshotsTest-2129977062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:13:14 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-790d64a2-b93b-40bc-8a11-30ba3c4ca55f tempest-GroupSnapshotsTest-2129977062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:13:14 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-790d64a2-b93b-40bc-8a11-30ba3c4ca55f tempest-GroupSnapshotsTest-2129977062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:13:14 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[29e008fd-bac2-47b4-9eff-0e9d3a1a2ac8]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:13:14 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-790d64a2-b93b-40bc-8a11-30ba3c4ca55f tempest-GroupSnapshotsTest-2129977062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-3257e4cd-f375-49ff-b3df-7a7b6f0ee3d9.0f50a9d6-a952-4b41-8a99-f0dc8c421460 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:14 devstack sudo[86289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-3257e4cd-f375-49ff-b3df-7a7b6f0ee3d9.0f50a9d6-a952-4b41-8a99-f0dc8c421460
Apr 10 13:13:14 devstack sudo[86289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:15 devstack sudo[86289]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:15 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-790d64a2-b93b-40bc-8a11-30ba3c4ca55f tempest-GroupSnapshotsTest-2129977062 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-3257e4cd-f375-49ff-b3df-7a7b6f0ee3d9.0f50a9d6-a952-4b41-8a99-f0dc8c421460" returned: 0 in 0.504s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:15 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-790d64a2-b93b-40bc-8a11-30ba3c4ca55f tempest-GroupSnapshotsTest-2129977062 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3257e4cd-f375-49ff-b3df-7a7b6f0ee3d9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 13:13:15 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-790d64a2-b93b-40bc-8a11-30ba3c4ca55f tempest-GroupSnapshotsTest-2129977062 None] will copy from snapshot at /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-3257e4cd-f375-49ff-b3df-7a7b6f0ee3d9 {{(pid=83345) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 10 13:13:15 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-790d64a2-b93b-40bc-8a11-30ba3c4ca55f tempest-GroupSnapshotsTest-2129977062 None] Creating direct copy from snapshot {{(pid=83345) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 10 13:13:15 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[43a7716f-bcef-4452-98ec-5d00727703df]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:13:15 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-790d64a2-b93b-40bc-8a11-30ba3c4ca55f tempest-GroupSnapshotsTest-2129977062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-3257e4cd-f375-49ff-b3df-7a7b6f0ee3d9 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:15 devstack sudo[86294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-3257e4cd-f375-49ff-b3df-7a7b6f0ee3d9
Apr 10 13:13:15 devstack sudo[86294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:15 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-2a2ee392-12e6-4aa2-80fd-b0ffc8aecd56 tempest-VolumesActionsTest-1102846807 None] Acquiring lock "cinder-02e6445a-556d-4e10-9aeb-ba760587c544-delete_volume" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:13:15 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-2a2ee392-12e6-4aa2-80fd-b0ffc8aecd56 tempest-VolumesActionsTest-1102846807 None] Lock "cinder-02e6445a-556d-4e10-9aeb-ba760587c544-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:13:15 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-2a2ee392-12e6-4aa2-80fd-b0ffc8aecd56 tempest-VolumesActionsTest-1102846807 None] Acquiring lock "cinder-quobyte-02e6445a-556d-4e10-9aeb-ba760587c544" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:13:15 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-2a2ee392-12e6-4aa2-80fd-b0ffc8aecd56 tempest-VolumesActionsTest-1102846807 None] Lock "cinder-quobyte-02e6445a-556d-4e10-9aeb-ba760587c544" acquired by "delete_volume" :: waited 0.012s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:13:15 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4f761ea-8813-4ca8-8dc1-d1480f91b2dd]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:13:15 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-2a2ee392-12e6-4aa2-80fd-b0ffc8aecd56 tempest-VolumesActionsTest-1102846807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-02e6445a-556d-4e10-9aeb-ba760587c544 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:15 devstack sudo[86298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-02e6445a-556d-4e10-9aeb-ba760587c544
Apr 10 13:13:15 devstack sudo[86298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:15 devstack sudo[86294]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:15 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-790d64a2-b93b-40bc-8a11-30ba3c4ca55f tempest-GroupSnapshotsTest-2129977062 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-3257e4cd-f375-49ff-b3df-7a7b6f0ee3d9" returned: 0 in 0.561s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:15 devstack cinder-volume[83345]: DEBUG cinder.utils [None req-790d64a2-b93b-40bc-8a11-30ba3c4ca55f tempest-GroupSnapshotsTest-2129977062 None] Path /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-dd1ee53a-6e65-48f4-b195-67aa486004fc not found in is_blk_device check {{(pid=83345) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 10 13:13:15 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-790d64a2-b93b-40bc-8a11-30ba3c4ca55f tempest-GroupSnapshotsTest-2129977062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-3257e4cd-f375-49ff-b3df-7a7b6f0ee3d9 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-dd1ee53a-6e65-48f4-b195-67aa486004fc {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:15 devstack sudo[86301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-3257e4cd-f375-49ff-b3df-7a7b6f0ee3d9 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-dd1ee53a-6e65-48f4-b195-67aa486004fc
Apr 10 13:13:15 devstack sudo[86301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:16 devstack sudo[86298]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:16 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-2a2ee392-12e6-4aa2-80fd-b0ffc8aecd56 tempest-VolumesActionsTest-1102846807 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-02e6445a-556d-4e10-9aeb-ba760587c544" returned: 0 in 0.599s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:16 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-2a2ee392-12e6-4aa2-80fd-b0ffc8aecd56 tempest-VolumesActionsTest-1102846807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-02e6445a-556d-4e10-9aeb-ba760587c544 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:16 devstack sudo[86309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-02e6445a-556d-4e10-9aeb-ba760587c544
Apr 10 13:13:16 devstack sudo[86309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:17 devstack sudo[86309]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:17 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-2a2ee392-12e6-4aa2-80fd-b0ffc8aecd56 tempest-VolumesActionsTest-1102846807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-02e6445a-556d-4e10-9aeb-ba760587c544" returned: 0 in 1.100s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:17 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-2a2ee392-12e6-4aa2-80fd-b0ffc8aecd56 tempest-VolumesActionsTest-1102846807 None] Lock "cinder-quobyte-02e6445a-556d-4e10-9aeb-ba760587c544" released by "delete_volume" :: held 1.740s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:13:17 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-2a2ee392-12e6-4aa2-80fd-b0ffc8aecd56 tempest-VolumesActionsTest-1102846807 None] Created reservations ['f71deaf8-d479-4512-8b56-bbfaefdacc07', 'fc2df76c-4181-45b6-8387-e2759a93603b', 'f000bec9-8ff8-413d-b1cd-3f115d0bf317', '82ec1dff-54f9-4fc8-bcba-7428c33b4764'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:13:17 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-2a2ee392-12e6-4aa2-80fd-b0ffc8aecd56 tempest-VolumesActionsTest-1102846807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:13:17 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-2a2ee392-12e6-4aa2-80fd-b0ffc8aecd56 tempest-VolumesActionsTest-1102846807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:13:17 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-2a2ee392-12e6-4aa2-80fd-b0ffc8aecd56 tempest-VolumesActionsTest-1102846807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:13:17 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-2a2ee392-12e6-4aa2-80fd-b0ffc8aecd56 tempest-VolumesActionsTest-1102846807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:13:17 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-2a2ee392-12e6-4aa2-80fd-b0ffc8aecd56 tempest-VolumesActionsTest-1102846807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:13:17 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-2a2ee392-12e6-4aa2-80fd-b0ffc8aecd56 tempest-VolumesActionsTest-1102846807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:17 devstack sudo[86320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:13:17 devstack sudo[86320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:18 devstack sudo[86301]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:18 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-790d64a2-b93b-40bc-8a11-30ba3c4ca55f tempest-GroupSnapshotsTest-2129977062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-3257e4cd-f375-49ff-b3df-7a7b6f0ee3d9 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-dd1ee53a-6e65-48f4-b195-67aa486004fc" returned: 0 in 2.700s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:18 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a4f49bd-233b-473b-94f6-7fa1664de123]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:13:18 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-790d64a2-b93b-40bc-8a11-30ba3c4ca55f tempest-GroupSnapshotsTest-2129977062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-3257e4cd-f375-49ff-b3df-7a7b6f0ee3d9 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:18 devstack sudo[86323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-3257e4cd-f375-49ff-b3df-7a7b6f0ee3d9
Apr 10 13:13:18 devstack sudo[86323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:18 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-a427b2d9-2b1d-47e6-a084-d98fa76f2769 tempest-VolumesActionsTest-1285107848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:13:18 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-a427b2d9-2b1d-47e6-a084-d98fa76f2769 tempest-VolumesActionsTest-1285107848 None] Flow 'volume_create_manager' (15697bee-1c82-4c5d-b911-ff1b95b9af74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:13:18 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-a427b2d9-2b1d-47e6-a084-d98fa76f2769 tempest-VolumesActionsTest-1285107848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a494a251-1869-4049-a529-a625a83207df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:13:18 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-a427b2d9-2b1d-47e6-a084-d98fa76f2769 tempest-VolumesActionsTest-1285107848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a494a251-1869-4049-a529-a625a83207df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:13:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1261239094',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1e65264-33f3-40e9-a7d8-8eab0b3c5068,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2551b2b6cd9f4994a93b4b15e32392da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:13:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:13:19Z,use_quota=True,user_id='aa1e9a5c093744c0a889c58c163c8c1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:13:18 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-a427b2d9-2b1d-47e6-a084-d98fa76f2769 tempest-VolumesActionsTest-1285107848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9d05cea-185c-40b8-87f6-4e124868eb52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:13:18 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-a427b2d9-2b1d-47e6-a084-d98fa76f2769 tempest-VolumesActionsTest-1285107848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9d05cea-185c-40b8-87f6-4e124868eb52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:13:18 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-a427b2d9-2b1d-47e6-a084-d98fa76f2769 tempest-VolumesActionsTest-1285107848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57fb6dcb-db18-4aee-9a14-fd06ddaea66f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:13:18 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-a427b2d9-2b1d-47e6-a084-d98fa76f2769 tempest-VolumesActionsTest-1285107848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57fb6dcb-db18-4aee-9a14-fd06ddaea66f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1e65264-33f3-40e9-a7d8-8eab0b3c5068', 'volume_name': 'volume-f1e65264-33f3-40e9-a7d8-8eab0b3c5068', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:13:18 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-a427b2d9-2b1d-47e6-a084-d98fa76f2769 tempest-VolumesActionsTest-1285107848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61b2c746-d893-4f69-b016-a9aa5cfa1a17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:13:18 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-a427b2d9-2b1d-47e6-a084-d98fa76f2769 tempest-VolumesActionsTest-1285107848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61b2c746-d893-4f69-b016-a9aa5cfa1a17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:13:18 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-a427b2d9-2b1d-47e6-a084-d98fa76f2769 tempest-VolumesActionsTest-1285107848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a0789c8-5db8-442f-9eb9-27fb0e04a186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:13:18 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-a427b2d9-2b1d-47e6-a084-d98fa76f2769 tempest-VolumesActionsTest-1285107848 None] Volume f1e65264-33f3-40e9-a7d8-8eab0b3c5068: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1e65264-33f3-40e9-a7d8-8eab0b3c5068', 'volume_size': 1}
Apr 10 13:13:18 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-a427b2d9-2b1d-47e6-a084-d98fa76f2769 tempest-VolumesActionsTest-1285107848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:13:18 devstack sudo[86320]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:18 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-2a2ee392-12e6-4aa2-80fd-b0ffc8aecd56 tempest-VolumesActionsTest-1102846807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 1.097s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:18 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-2a2ee392-12e6-4aa2-80fd-b0ffc8aecd56 tempest-VolumesActionsTest-1102846807 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:13:18 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-2a2ee392-12e6-4aa2-80fd-b0ffc8aecd56 tempest-VolumesActionsTest-1102846807 None] Deleted volume successfully.
Apr 10 13:13:18 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-2a2ee392-12e6-4aa2-80fd-b0ffc8aecd56 tempest-VolumesActionsTest-1102846807 None] Lock "cinder-02e6445a-556d-4e10-9aeb-ba760587c544-delete_volume" released by "delete_volume" :: held 3.163s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:13:19 devstack sudo[86323]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:19 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-790d64a2-b93b-40bc-8a11-30ba3c4ca55f tempest-GroupSnapshotsTest-2129977062 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-3257e4cd-f375-49ff-b3df-7a7b6f0ee3d9" returned: 0 in 0.831s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:19 devstack cinder-volume[83345]: DEBUG cinder.image.image_utils [None req-790d64a2-b93b-40bc-8a11-30ba3c4ca55f tempest-GroupSnapshotsTest-2129977062 None] Image conversion details: src /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-3257e4cd-f375-49ff-b3df-7a7b6f0ee3d9, size 1024.00 MB, duration 2.70 sec, destination /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-dd1ee53a-6e65-48f4-b195-67aa486004fc {{(pid=83345) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 10 13:13:19 devstack cinder-volume[83345]: INFO cinder.image.image_utils [None req-790d64a2-b93b-40bc-8a11-30ba3c4ca55f tempest-GroupSnapshotsTest-2129977062 None] Converted 1024.00 MB image at 378.91 MB/s
Apr 10 13:13:19 devstack cinder-volume[83345]: WARNING cinder.volume.drivers.remotefs [None req-790d64a2-b93b-40bc-8a11-30ba3c4ca55f tempest-GroupSnapshotsTest-2129977062 None] /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-dd1ee53a-6e65-48f4-b195-67aa486004fc is being set with open permissions: ugo+rw: NotImplementedError
Apr 10 13:13:19 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-790d64a2-b93b-40bc-8a11-30ba3c4ca55f tempest-GroupSnapshotsTest-2129977062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-dd1ee53a-6e65-48f4-b195-67aa486004fc {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:19 devstack sudo[86363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-dd1ee53a-6e65-48f4-b195-67aa486004fc
Apr 10 13:13:19 devstack sudo[86363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:19 devstack sudo[86363]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:19 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-790d64a2-b93b-40bc-8a11-30ba3c4ca55f tempest-GroupSnapshotsTest-2129977062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-dd1ee53a-6e65-48f4-b195-67aa486004fc" returned: 0 in 0.501s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:19 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-790d64a2-b93b-40bc-8a11-30ba3c4ca55f tempest-GroupSnapshotsTest-2129977062 None] Lock "cinder-quobyte-dd1ee53a-6e65-48f4-b195-67aa486004fc" released by "_copy_volume_from_snapshot" :: held 5.169s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:13:19 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-790d64a2-b93b-40bc-8a11-30ba3c4ca55f tempest-GroupSnapshotsTest-2129977062 None] Lock "cinder-quobyte-0f50a9d6-a952-4b41-8a99-f0dc8c421460-dd1ee53a-6e65-48f4-b195-67aa486004fc" released by "_create_volume_from_snapshot" :: held 5.187s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:13:19 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-790d64a2-b93b-40bc-8a11-30ba3c4ca55f tempest-GroupSnapshotsTest-2129977062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.209s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:13:19 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-a427b2d9-2b1d-47e6-a084-d98fa76f2769 tempest-VolumesActionsTest-1285107848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.146s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:13:19 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-a427b2d9-2b1d-47e6-a084-d98fa76f2769 tempest-VolumesActionsTest-1285107848 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f252bf08b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:13:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1261239094',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1e65264-33f3-40e9-a7d8-8eab0b3c5068,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2551b2b6cd9f4994a93b4b15e32392da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:13:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:13:19Z,use_quota=True,user_id='aa1e9a5c093744c0a889c58c163c8c1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)}" {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 13:13:19 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-a427b2d9-2b1d-47e6-a084-d98fa76f2769 tempest-VolumesActionsTest-1285107848 None] Creating volume f1e65264-33f3-40e9-a7d8-8eab0b3c5068 {{(pid=83345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 13:13:19 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-a427b2d9-2b1d-47e6-a084-d98fa76f2769 tempest-VolumesActionsTest-1285107848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:13:19 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-a427b2d9-2b1d-47e6-a084-d98fa76f2769 tempest-VolumesActionsTest-1285107848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:13:19 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-a427b2d9-2b1d-47e6-a084-d98fa76f2769 tempest-VolumesActionsTest-1285107848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:13:19 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-a427b2d9-2b1d-47e6-a084-d98fa76f2769 tempest-VolumesActionsTest-1285107848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:13:19 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-a427b2d9-2b1d-47e6-a084-d98fa76f2769 tempest-VolumesActionsTest-1285107848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:13:19 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-a427b2d9-2b1d-47e6-a084-d98fa76f2769 tempest-VolumesActionsTest-1285107848 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:13:19 devstack cinder-volume[83345]: INFO cinder.volume.drivers.remotefs [None req-a427b2d9-2b1d-47e6-a084-d98fa76f2769 tempest-VolumesActionsTest-1285107848 None] casted to osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331
Apr 10 13:13:19 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-a427b2d9-2b1d-47e6-a084-d98fa76f2769 tempest-VolumesActionsTest-1285107848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-f1e65264-33f3-40e9-a7d8-8eab0b3c5068 1073741824 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:19 devstack sudo[86367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-f1e65264-33f3-40e9-a7d8-8eab0b3c5068 1073741824
Apr 10 13:13:19 devstack sudo[86367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:19 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-790d64a2-b93b-40bc-8a11-30ba3c4ca55f tempest-GroupSnapshotsTest-2129977062 None] Create group from source-snapshot-627df150-5422-4b40-bca7-790adf48962d completed successfully.
Apr 10 13:13:20 devstack sudo[86367]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:20 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-a427b2d9-2b1d-47e6-a084-d98fa76f2769 tempest-VolumesActionsTest-1285107848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-f1e65264-33f3-40e9-a7d8-8eab0b3c5068 1073741824" returned: 0 in 0.528s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:20 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-a427b2d9-2b1d-47e6-a084-d98fa76f2769 tempest-VolumesActionsTest-1285107848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-f1e65264-33f3-40e9-a7d8-8eab0b3c5068 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:20 devstack sudo[86373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-f1e65264-33f3-40e9-a7d8-8eab0b3c5068
Apr 10 13:13:20 devstack sudo[86373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:20 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-4a7fbe60-6557-4c8e-a129-1cbd48580b75 tempest-GroupSnapshotsTest-2129977062 None] Acquiring lock "cinder-quobyte-dd1ee53a-6e65-48f4-b195-67aa486004fc" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:13:20 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-4a7fbe60-6557-4c8e-a129-1cbd48580b75 tempest-GroupSnapshotsTest-2129977062 None] Lock "cinder-quobyte-dd1ee53a-6e65-48f4-b195-67aa486004fc" acquired by "delete_volume" :: waited 0.022s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:13:20 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7105714-02f9-43e7-91ad-4f2ff511411f]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:13:20 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-4a7fbe60-6557-4c8e-a129-1cbd48580b75 tempest-GroupSnapshotsTest-2129977062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-dd1ee53a-6e65-48f4-b195-67aa486004fc {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:20 devstack sudo[86376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-dd1ee53a-6e65-48f4-b195-67aa486004fc
Apr 10 13:13:20 devstack sudo[86376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:20 devstack sudo[86373]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:20 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-a427b2d9-2b1d-47e6-a084-d98fa76f2769 tempest-VolumesActionsTest-1285107848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-f1e65264-33f3-40e9-a7d8-8eab0b3c5068" returned: 0 in 0.536s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:20 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-a427b2d9-2b1d-47e6-a084-d98fa76f2769 tempest-VolumesActionsTest-1285107848 None] <== create_volume: return (1091ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'} {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 13:13:20 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-a427b2d9-2b1d-47e6-a084-d98fa76f2769 tempest-VolumesActionsTest-1285107848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.093s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:13:20 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-a427b2d9-2b1d-47e6-a084-d98fa76f2769 tempest-VolumesActionsTest-1285107848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a0789c8-5db8-442f-9eb9-27fb0e04a186) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1e65264-33f3-40e9-a7d8-8eab0b3c5068', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:13:20 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-a427b2d9-2b1d-47e6-a084-d98fa76f2769 tempest-VolumesActionsTest-1285107848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2bd5ad1-f2d5-46ba-9208-e688f8af6355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:13:20 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-a427b2d9-2b1d-47e6-a084-d98fa76f2769 tempest-VolumesActionsTest-1285107848 None] Volume volume-f1e65264-33f3-40e9-a7d8-8eab0b3c5068 (f1e65264-33f3-40e9-a7d8-8eab0b3c5068): created successfully
Apr 10 13:13:20 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-a427b2d9-2b1d-47e6-a084-d98fa76f2769 tempest-VolumesActionsTest-1285107848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2bd5ad1-f2d5-46ba-9208-e688f8af6355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:13:20 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-a427b2d9-2b1d-47e6-a084-d98fa76f2769 tempest-VolumesActionsTest-1285107848 None] Flow 'volume_create_manager' (15697bee-1c82-4c5d-b911-ff1b95b9af74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:13:20 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-a427b2d9-2b1d-47e6-a084-d98fa76f2769 tempest-VolumesActionsTest-1285107848 None] Created volume successfully.
Apr 10 13:13:21 devstack sudo[86376]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:21 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-4a7fbe60-6557-4c8e-a129-1cbd48580b75 tempest-GroupSnapshotsTest-2129977062 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-dd1ee53a-6e65-48f4-b195-67aa486004fc" returned: 0 in 0.589s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:21 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-4a7fbe60-6557-4c8e-a129-1cbd48580b75 tempest-GroupSnapshotsTest-2129977062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-dd1ee53a-6e65-48f4-b195-67aa486004fc {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:21 devstack sudo[86384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-dd1ee53a-6e65-48f4-b195-67aa486004fc
Apr 10 13:13:21 devstack sudo[86384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:21 devstack cinder-volume[83345]: INFO cinder.volume.manager [req-49ebdc8e-bef5-46a2-a79a-a2306ca0bf11 req-bfd31f00-fc03-4d5e-bc92-5576d72c89af tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Terminate volume connection completed successfully.
Apr 10 13:13:21 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [req-49ebdc8e-bef5-46a2-a79a-a2306ca0bf11 req-bfd31f00-fc03-4d5e-bc92-5576d72c89af tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Deleting attachment 7735643a-f852-44d8-8d0e-d13dbe48d19c. {{(pid=83345) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 10 13:13:21 devstack sudo[86384]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:21 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-4a7fbe60-6557-4c8e-a129-1cbd48580b75 tempest-GroupSnapshotsTest-2129977062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-dd1ee53a-6e65-48f4-b195-67aa486004fc" returned: 0 in 0.464s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:21 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-4a7fbe60-6557-4c8e-a129-1cbd48580b75 tempest-GroupSnapshotsTest-2129977062 None] Lock "cinder-quobyte-dd1ee53a-6e65-48f4-b195-67aa486004fc" released by "delete_volume" :: held 1.082s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:13:21 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-4a7fbe60-6557-4c8e-a129-1cbd48580b75 tempest-GroupSnapshotsTest-2129977062 None] Created reservations ['b6ec305e-6f82-481a-936f-f4e6a0a713e3'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:13:21 devstack cinder-volume[83345]: WARNING cinder.quota [None req-4a7fbe60-6557-4c8e-a129-1cbd48580b75 tempest-GroupSnapshotsTest-2129977062 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1666761364 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1666761364, it is now deprecated. Please use the default quota class for default quota.
Apr 10 13:13:21 devstack cinder-volume[83345]: WARNING cinder.quota [None req-4a7fbe60-6557-4c8e-a129-1cbd48580b75 tempest-GroupSnapshotsTest-2129977062 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1666761364 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1666761364, it is now deprecated. Please use the default quota class for default quota.
Apr 10 13:13:21 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-4a7fbe60-6557-4c8e-a129-1cbd48580b75 tempest-GroupSnapshotsTest-2129977062 None] Created reservations ['f986eda5-00cd-49a7-8541-371387d7ccd8', '1c4b031e-780a-4dbf-a6ac-7cd253502fa3', '905c5e04-d485-497f-9b35-fa40fbe2e87e', 'a4756aae-e75c-47f9-b3b8-19caf71524fa'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:13:22 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-4a7fbe60-6557-4c8e-a129-1cbd48580b75 tempest-GroupSnapshotsTest-2129977062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:13:22 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-4a7fbe60-6557-4c8e-a129-1cbd48580b75 tempest-GroupSnapshotsTest-2129977062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:13:22 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-4a7fbe60-6557-4c8e-a129-1cbd48580b75 tempest-GroupSnapshotsTest-2129977062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:13:22 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-4a7fbe60-6557-4c8e-a129-1cbd48580b75 tempest-GroupSnapshotsTest-2129977062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:13:22 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-4a7fbe60-6557-4c8e-a129-1cbd48580b75 tempest-GroupSnapshotsTest-2129977062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:13:22 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-4a7fbe60-6557-4c8e-a129-1cbd48580b75 tempest-GroupSnapshotsTest-2129977062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:22 devstack sudo[86387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:13:22 devstack sudo[86387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:22 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-6a93666d-84cd-46a8-9ed6-3ebeeae9e6db tempest-VolumesActionsTest-1102846807 None] Acquiring lock "cinder-f1e65264-33f3-40e9-a7d8-8eab0b3c5068-delete_volume" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:13:22 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-6a93666d-84cd-46a8-9ed6-3ebeeae9e6db tempest-VolumesActionsTest-1102846807 None] Lock "cinder-f1e65264-33f3-40e9-a7d8-8eab0b3c5068-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:13:22 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-6a93666d-84cd-46a8-9ed6-3ebeeae9e6db tempest-VolumesActionsTest-1102846807 None] Acquiring lock "cinder-quobyte-f1e65264-33f3-40e9-a7d8-8eab0b3c5068" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:13:22 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-6a93666d-84cd-46a8-9ed6-3ebeeae9e6db tempest-VolumesActionsTest-1102846807 None] Lock "cinder-quobyte-f1e65264-33f3-40e9-a7d8-8eab0b3c5068" acquired by "delete_volume" :: waited 0.011s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:13:22 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c5173ea-b0e6-4aef-a9d3-26b7df5882c5]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:13:22 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-6a93666d-84cd-46a8-9ed6-3ebeeae9e6db tempest-VolumesActionsTest-1102846807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-f1e65264-33f3-40e9-a7d8-8eab0b3c5068 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:22 devstack cinder-volume[83345]: DEBUG cinder.coordination [req-49ebdc8e-bef5-46a2-a79a-a2306ca0bf11 req-d06bffbc-bc3c-48fc-b5d2-4868d90cf3b7 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Acquiring lock "cinder-648cb04b-29b8-434b-bf1e-971d8761dc4f-delete_volume" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:13:22 devstack cinder-volume[83345]: DEBUG cinder.coordination [req-49ebdc8e-bef5-46a2-a79a-a2306ca0bf11 req-d06bffbc-bc3c-48fc-b5d2-4868d90cf3b7 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Lock "cinder-648cb04b-29b8-434b-bf1e-971d8761dc4f-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:13:22 devstack cinder-volume[83345]: DEBUG cinder.coordination [req-49ebdc8e-bef5-46a2-a79a-a2306ca0bf11 req-d06bffbc-bc3c-48fc-b5d2-4868d90cf3b7 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Acquiring lock "cinder-quobyte-648cb04b-29b8-434b-bf1e-971d8761dc4f" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:13:22 devstack cinder-volume[83345]: DEBUG cinder.coordination [req-49ebdc8e-bef5-46a2-a79a-a2306ca0bf11 req-d06bffbc-bc3c-48fc-b5d2-4868d90cf3b7 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Lock "cinder-quobyte-648cb04b-29b8-434b-bf1e-971d8761dc4f" acquired by "delete_volume" :: waited 0.008s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:13:22 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2447d98-304f-43f5-8728-34a06a5cf3bd]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:13:22 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [req-49ebdc8e-bef5-46a2-a79a-a2306ca0bf11 req-d06bffbc-bc3c-48fc-b5d2-4868d90cf3b7 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-648cb04b-29b8-434b-bf1e-971d8761dc4f {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:22 devstack sudo[86389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-f1e65264-33f3-40e9-a7d8-8eab0b3c5068
Apr 10 13:13:22 devstack sudo[86389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:22 devstack sudo[86391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-648cb04b-29b8-434b-bf1e-971d8761dc4f
Apr 10 13:13:22 devstack sudo[86391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:22 devstack sudo[86387]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:22 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-4a7fbe60-6557-4c8e-a129-1cbd48580b75 tempest-GroupSnapshotsTest-2129977062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.523s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:22 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-4a7fbe60-6557-4c8e-a129-1cbd48580b75 tempest-GroupSnapshotsTest-2129977062 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:13:22 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-4a7fbe60-6557-4c8e-a129-1cbd48580b75 tempest-GroupSnapshotsTest-2129977062 None] Delete group completed successfully.
Apr 10 13:13:22 devstack sudo[86391]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:22 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [req-49ebdc8e-bef5-46a2-a79a-a2306ca0bf11 req-d06bffbc-bc3c-48fc-b5d2-4868d90cf3b7 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-648cb04b-29b8-434b-bf1e-971d8761dc4f" returned: 0 in 0.528s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:22 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [req-49ebdc8e-bef5-46a2-a79a-a2306ca0bf11 req-d06bffbc-bc3c-48fc-b5d2-4868d90cf3b7 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-648cb04b-29b8-434b-bf1e-971d8761dc4f {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:22 devstack sudo[86389]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:22 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-6a93666d-84cd-46a8-9ed6-3ebeeae9e6db tempest-VolumesActionsTest-1102846807 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-f1e65264-33f3-40e9-a7d8-8eab0b3c5068" returned: 0 in 0.632s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:22 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-6a93666d-84cd-46a8-9ed6-3ebeeae9e6db tempest-VolumesActionsTest-1102846807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-f1e65264-33f3-40e9-a7d8-8eab0b3c5068 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:22 devstack sudo[86401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-648cb04b-29b8-434b-bf1e-971d8761dc4f
Apr 10 13:13:22 devstack sudo[86401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:22 devstack sudo[86402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-f1e65264-33f3-40e9-a7d8-8eab0b3c5068
Apr 10 13:13:22 devstack sudo[86402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:23 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-e9d47910-b29d-43b0-85be-116035659c8b tempest-GroupSnapshotsTest-2129977062 None] group_snapshot 627df150-5422-4b40-bca7-790adf48962d: deleting
Apr 10 13:13:23 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-e9d47910-b29d-43b0-85be-116035659c8b tempest-GroupSnapshotsTest-2129977062 None] group_snapshot 627df150-5422-4b40-bca7-790adf48962d: deleting {{(pid=83345) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 10 13:13:23 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-e9d47910-b29d-43b0-85be-116035659c8b tempest-GroupSnapshotsTest-2129977062 None] Acquiring lock "cinder-quobyte-3257e4cd-f375-49ff-b3df-7a7b6f0ee3d9" by "delete_snapshot" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:13:23 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-e9d47910-b29d-43b0-85be-116035659c8b tempest-GroupSnapshotsTest-2129977062 None] Lock "cinder-quobyte-3257e4cd-f375-49ff-b3df-7a7b6f0ee3d9" acquired by "delete_snapshot" :: waited 0.014s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:13:23 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-e9d47910-b29d-43b0-85be-116035659c8b tempest-GroupSnapshotsTest-2129977062 None] Acquiring lock "cinder-quobyte-0f50a9d6-a952-4b41-8a99-f0dc8c421460" by "_delete_snapshot" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:13:23 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-e9d47910-b29d-43b0-85be-116035659c8b tempest-GroupSnapshotsTest-2129977062 None] Lock "cinder-quobyte-0f50a9d6-a952-4b41-8a99-f0dc8c421460" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:13:23 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-e9d47910-b29d-43b0-85be-116035659c8b tempest-GroupSnapshotsTest-2129977062 None] Deleting offline snapshot 0f50a9d6-a952-4b41-8a99-f0dc8c421460 of volume 3257e4cd-f375-49ff-b3df-7a7b6f0ee3d9 {{(pid=83345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 10 13:13:23 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-e9d47910-b29d-43b0-85be-116035659c8b tempest-GroupSnapshotsTest-2129977062 None] snapshot_file for this snap is: volume-3257e4cd-f375-49ff-b3df-7a7b6f0ee3d9.0f50a9d6-a952-4b41-8a99-f0dc8c421460 {{(pid=83345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 10 13:13:23 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c229973-716f-44e3-9454-29ebe164a50d]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:13:23 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-e9d47910-b29d-43b0-85be-116035659c8b tempest-GroupSnapshotsTest-2129977062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-3257e4cd-f375-49ff-b3df-7a7b6f0ee3d9.0f50a9d6-a952-4b41-8a99-f0dc8c421460 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:23 devstack sudo[86405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-3257e4cd-f375-49ff-b3df-7a7b6f0ee3d9.0f50a9d6-a952-4b41-8a99-f0dc8c421460
Apr 10 13:13:23 devstack sudo[86405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:23 devstack sudo[86401]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:23 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [req-49ebdc8e-bef5-46a2-a79a-a2306ca0bf11 req-d06bffbc-bc3c-48fc-b5d2-4868d90cf3b7 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-648cb04b-29b8-434b-bf1e-971d8761dc4f" returned: 0 in 0.550s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:23 devstack cinder-volume[83345]: DEBUG cinder.coordination [req-49ebdc8e-bef5-46a2-a79a-a2306ca0bf11 req-d06bffbc-bc3c-48fc-b5d2-4868d90cf3b7 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Lock "cinder-quobyte-648cb04b-29b8-434b-bf1e-971d8761dc4f" released by "delete_volume" :: held 1.102s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:13:23 devstack cinder-volume[83345]: DEBUG cinder.quota [req-49ebdc8e-bef5-46a2-a79a-a2306ca0bf11 req-d06bffbc-bc3c-48fc-b5d2-4868d90cf3b7 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Created reservations ['7cc60a00-00da-4989-ae49-5d41d7902bcf', 'd1210ab5-823c-4c19-aeb8-9cebdc9e5444', 'cf3811e4-4b40-468c-8aaf-929e179de1fb', 'e7c8ad12-2a23-4b7d-8a3b-de4eff858738'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:13:23 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [req-49ebdc8e-bef5-46a2-a79a-a2306ca0bf11 req-d06bffbc-bc3c-48fc-b5d2-4868d90cf3b7 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:13:23 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [req-49ebdc8e-bef5-46a2-a79a-a2306ca0bf11 req-d06bffbc-bc3c-48fc-b5d2-4868d90cf3b7 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:13:23 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [req-49ebdc8e-bef5-46a2-a79a-a2306ca0bf11 req-d06bffbc-bc3c-48fc-b5d2-4868d90cf3b7 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:13:23 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [req-49ebdc8e-bef5-46a2-a79a-a2306ca0bf11 req-d06bffbc-bc3c-48fc-b5d2-4868d90cf3b7 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:13:23 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [req-49ebdc8e-bef5-46a2-a79a-a2306ca0bf11 req-d06bffbc-bc3c-48fc-b5d2-4868d90cf3b7 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:13:23 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [req-49ebdc8e-bef5-46a2-a79a-a2306ca0bf11 req-d06bffbc-bc3c-48fc-b5d2-4868d90cf3b7 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:23 devstack sudo[86409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:13:23 devstack sudo[86409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:23 devstack sudo[86402]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:23 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-6a93666d-84cd-46a8-9ed6-3ebeeae9e6db tempest-VolumesActionsTest-1102846807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-f1e65264-33f3-40e9-a7d8-8eab0b3c5068" returned: 0 in 0.673s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:23 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-6a93666d-84cd-46a8-9ed6-3ebeeae9e6db tempest-VolumesActionsTest-1102846807 None] Lock "cinder-quobyte-f1e65264-33f3-40e9-a7d8-8eab0b3c5068" released by "delete_volume" :: held 1.333s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:13:23 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-6a93666d-84cd-46a8-9ed6-3ebeeae9e6db tempest-VolumesActionsTest-1102846807 None] Created reservations ['3566aec5-c506-4b33-b7d9-47d04b40ee57', '76d41ce7-0001-4405-8f13-420404394cd4', 'fbdeeb09-4e9f-41c7-9c2d-1381f91737cd', '23dbaae3-ca0f-47da-9a95-f0592f085ff9'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:13:23 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-6a93666d-84cd-46a8-9ed6-3ebeeae9e6db tempest-VolumesActionsTest-1102846807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:13:23 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-6a93666d-84cd-46a8-9ed6-3ebeeae9e6db tempest-VolumesActionsTest-1102846807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:13:23 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-6a93666d-84cd-46a8-9ed6-3ebeeae9e6db tempest-VolumesActionsTest-1102846807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:13:23 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-6a93666d-84cd-46a8-9ed6-3ebeeae9e6db tempest-VolumesActionsTest-1102846807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:13:23 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-6a93666d-84cd-46a8-9ed6-3ebeeae9e6db tempest-VolumesActionsTest-1102846807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:13:23 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-6a93666d-84cd-46a8-9ed6-3ebeeae9e6db tempest-VolumesActionsTest-1102846807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:23 devstack sudo[86411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:13:23 devstack sudo[86411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:23 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-600b284b-5798-4a8b-98c6-e86879b01646 tempest-VolumesServicesTestJSON-571400284 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:13:23 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-600b284b-5798-4a8b-98c6-e86879b01646 tempest-VolumesServicesTestJSON-571400284 None] Flow 'volume_create_manager' (77af817b-5c48-4eaa-af8a-118dd1257b5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:13:23 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-600b284b-5798-4a8b-98c6-e86879b01646 tempest-VolumesServicesTestJSON-571400284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d626ec8f-1075-4df4-9866-bc7e219e3b77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:13:23 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-600b284b-5798-4a8b-98c6-e86879b01646 tempest-VolumesServicesTestJSON-571400284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d626ec8f-1075-4df4-9866-bc7e219e3b77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:13:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-40476600',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26e74305-f704-40ac-88e1-a03cfe038810,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b0dce80f3ba48eb8cb85a65e8a8965d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:13:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:13:24Z,use_quota=True,user_id='6dc0df8343db4e6c8fb26629c1bd3979',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:13:23 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-600b284b-5798-4a8b-98c6-e86879b01646 tempest-VolumesServicesTestJSON-571400284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84fd245a-c2af-485f-91e2-cca70990226a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:13:23 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-600b284b-5798-4a8b-98c6-e86879b01646 tempest-VolumesServicesTestJSON-571400284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84fd245a-c2af-485f-91e2-cca70990226a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:13:23 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-600b284b-5798-4a8b-98c6-e86879b01646 tempest-VolumesServicesTestJSON-571400284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7f1cb23-d910-426d-beb7-ffcdefb75f30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:13:23 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-600b284b-5798-4a8b-98c6-e86879b01646 tempest-VolumesServicesTestJSON-571400284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7f1cb23-d910-426d-beb7-ffcdefb75f30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26e74305-f704-40ac-88e1-a03cfe038810', 'volume_name': 'volume-26e74305-f704-40ac-88e1-a03cfe038810', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:13:23 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-600b284b-5798-4a8b-98c6-e86879b01646 tempest-VolumesServicesTestJSON-571400284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f335b30-1359-4fde-a356-ed8bc2e4a171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:13:23 devstack sudo[86405]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:23 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-600b284b-5798-4a8b-98c6-e86879b01646 tempest-VolumesServicesTestJSON-571400284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f335b30-1359-4fde-a356-ed8bc2e4a171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:13:23 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-600b284b-5798-4a8b-98c6-e86879b01646 tempest-VolumesServicesTestJSON-571400284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95b48182-9ab4-4e64-8aae-17d86790ca94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:13:23 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-600b284b-5798-4a8b-98c6-e86879b01646 tempest-VolumesServicesTestJSON-571400284 None] Volume 26e74305-f704-40ac-88e1-a03cfe038810: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26e74305-f704-40ac-88e1-a03cfe038810', 'volume_size': 1}
Apr 10 13:13:23 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-600b284b-5798-4a8b-98c6-e86879b01646 tempest-VolumesServicesTestJSON-571400284 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:13:23 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-600b284b-5798-4a8b-98c6-e86879b01646 tempest-VolumesServicesTestJSON-571400284 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:13:23 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-600b284b-5798-4a8b-98c6-e86879b01646 tempest-VolumesServicesTestJSON-571400284 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f252bf08b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:13:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-40476600',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26e74305-f704-40ac-88e1-a03cfe038810,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b0dce80f3ba48eb8cb85a65e8a8965d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:13:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:13:24Z,use_quota=True,user_id='6dc0df8343db4e6c8fb26629c1bd3979',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)}" {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 13:13:23 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-600b284b-5798-4a8b-98c6-e86879b01646 tempest-VolumesServicesTestJSON-571400284 None] Creating volume 26e74305-f704-40ac-88e1-a03cfe038810 {{(pid=83345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 13:13:23 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-600b284b-5798-4a8b-98c6-e86879b01646 tempest-VolumesServicesTestJSON-571400284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:13:23 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-600b284b-5798-4a8b-98c6-e86879b01646 tempest-VolumesServicesTestJSON-571400284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:13:23 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-600b284b-5798-4a8b-98c6-e86879b01646 tempest-VolumesServicesTestJSON-571400284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:13:23 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-600b284b-5798-4a8b-98c6-e86879b01646 tempest-VolumesServicesTestJSON-571400284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:13:23 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-600b284b-5798-4a8b-98c6-e86879b01646 tempest-VolumesServicesTestJSON-571400284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:13:23 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-600b284b-5798-4a8b-98c6-e86879b01646 tempest-VolumesServicesTestJSON-571400284 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:13:23 devstack cinder-volume[83345]: INFO cinder.volume.drivers.remotefs [None req-600b284b-5798-4a8b-98c6-e86879b01646 tempest-VolumesServicesTestJSON-571400284 None] casted to osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331
Apr 10 13:13:23 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-600b284b-5798-4a8b-98c6-e86879b01646 tempest-VolumesServicesTestJSON-571400284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-26e74305-f704-40ac-88e1-a03cfe038810 1073741824 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:23 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-e9d47910-b29d-43b0-85be-116035659c8b tempest-GroupSnapshotsTest-2129977062 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-3257e4cd-f375-49ff-b3df-7a7b6f0ee3d9.0f50a9d6-a952-4b41-8a99-f0dc8c421460" returned: 0 in 0.649s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:23 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-e9d47910-b29d-43b0-85be-116035659c8b tempest-GroupSnapshotsTest-2129977062 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3257e4cd-f375-49ff-b3df-7a7b6f0ee3d9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 13:13:23 devstack sudo[86416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-26e74305-f704-40ac-88e1-a03cfe038810 1073741824
Apr 10 13:13:23 devstack sudo[86416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:23 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[90419225-9c15-4011-94d0-02d2950d3f94]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:13:23 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-e9d47910-b29d-43b0-85be-116035659c8b tempest-GroupSnapshotsTest-2129977062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-3257e4cd-f375-49ff-b3df-7a7b6f0ee3d9 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:23 devstack sudo[86418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-3257e4cd-f375-49ff-b3df-7a7b6f0ee3d9
Apr 10 13:13:23 devstack sudo[86418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:24 devstack sudo[86409]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:24 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [req-49ebdc8e-bef5-46a2-a79a-a2306ca0bf11 req-d06bffbc-bc3c-48fc-b5d2-4868d90cf3b7 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.534s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:24 devstack cinder-volume[83345]: DEBUG cinder.manager [req-49ebdc8e-bef5-46a2-a79a-a2306ca0bf11 req-d06bffbc-bc3c-48fc-b5d2-4868d90cf3b7 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:13:24 devstack cinder-volume[83345]: INFO cinder.volume.manager [req-49ebdc8e-bef5-46a2-a79a-a2306ca0bf11 req-d06bffbc-bc3c-48fc-b5d2-4868d90cf3b7 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Deleted volume successfully.
Apr 10 13:13:24 devstack cinder-volume[83345]: DEBUG cinder.coordination [req-49ebdc8e-bef5-46a2-a79a-a2306ca0bf11 req-d06bffbc-bc3c-48fc-b5d2-4868d90cf3b7 tempest-ServerBootFromVolumeStableRescueTest-864025333 None] Lock "cinder-648cb04b-29b8-434b-bf1e-971d8761dc4f-delete_volume" released by "delete_volume" :: held 1.786s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:13:24 devstack sudo[86411]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:24 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-6a93666d-84cd-46a8-9ed6-3ebeeae9e6db tempest-VolumesActionsTest-1102846807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.520s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:24 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-6a93666d-84cd-46a8-9ed6-3ebeeae9e6db tempest-VolumesActionsTest-1102846807 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:13:24 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-6a93666d-84cd-46a8-9ed6-3ebeeae9e6db tempest-VolumesActionsTest-1102846807 None] Deleted volume successfully.
Apr 10 13:13:24 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-6a93666d-84cd-46a8-9ed6-3ebeeae9e6db tempest-VolumesActionsTest-1102846807 None] Lock "cinder-f1e65264-33f3-40e9-a7d8-8eab0b3c5068-delete_volume" released by "delete_volume" :: held 2.007s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:13:24 devstack sudo[86416]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:24 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-600b284b-5798-4a8b-98c6-e86879b01646 tempest-VolumesServicesTestJSON-571400284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-26e74305-f704-40ac-88e1-a03cfe038810 1073741824" returned: 0 in 0.501s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:24 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-600b284b-5798-4a8b-98c6-e86879b01646 tempest-VolumesServicesTestJSON-571400284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-26e74305-f704-40ac-88e1-a03cfe038810 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:24 devstack sudo[86428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-26e74305-f704-40ac-88e1-a03cfe038810
Apr 10 13:13:24 devstack sudo[86428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:24 devstack sudo[86418]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:24 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-e9d47910-b29d-43b0-85be-116035659c8b tempest-GroupSnapshotsTest-2129977062 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-3257e4cd-f375-49ff-b3df-7a7b6f0ee3d9" returned: 0 in 0.591s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:24 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-e9d47910-b29d-43b0-85be-116035659c8b tempest-GroupSnapshotsTest-2129977062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-3257e4cd-f375-49ff-b3df-7a7b6f0ee3d9.0f50a9d6-a952-4b41-8a99-f0dc8c421460 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:24 devstack sudo[86430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-3257e4cd-f375-49ff-b3df-7a7b6f0ee3d9.0f50a9d6-a952-4b41-8a99-f0dc8c421460
Apr 10 13:13:24 devstack sudo[86430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:24 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c8ee55e-6b26-45dd-b2d9-312115535519 tempest-VolumesActionsTest-1285107848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:13:24 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-8c8ee55e-6b26-45dd-b2d9-312115535519 tempest-VolumesActionsTest-1285107848 None] Flow 'volume_create_manager' (f7b0ef9d-287e-4bbe-961a-8026eefa2ed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:13:24 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-8c8ee55e-6b26-45dd-b2d9-312115535519 tempest-VolumesActionsTest-1285107848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2a3ed18-87a6-4650-9701-34b7b74329ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:13:24 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-8c8ee55e-6b26-45dd-b2d9-312115535519 tempest-VolumesActionsTest-1285107848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2a3ed18-87a6-4650-9701-34b7b74329ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:13:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-973597245',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58959a00-9e4e-41cd-a5b8-33b8a29c9618,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2551b2b6cd9f4994a93b4b15e32392da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:13:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:13:25Z,use_quota=True,user_id='aa1e9a5c093744c0a889c58c163c8c1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:13:24 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-8c8ee55e-6b26-45dd-b2d9-312115535519 tempest-VolumesActionsTest-1285107848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (655bc98e-96c2-419d-91b8-561131bdbbab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:13:24 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-8c8ee55e-6b26-45dd-b2d9-312115535519 tempest-VolumesActionsTest-1285107848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (655bc98e-96c2-419d-91b8-561131bdbbab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:13:24 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-8c8ee55e-6b26-45dd-b2d9-312115535519 tempest-VolumesActionsTest-1285107848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84025325-1e35-4f01-b16e-250e7b09980c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:13:24 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-8c8ee55e-6b26-45dd-b2d9-312115535519 tempest-VolumesActionsTest-1285107848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84025325-1e35-4f01-b16e-250e7b09980c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58959a00-9e4e-41cd-a5b8-33b8a29c9618', 'volume_name': 'volume-58959a00-9e4e-41cd-a5b8-33b8a29c9618', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:13:24 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-8c8ee55e-6b26-45dd-b2d9-312115535519 tempest-VolumesActionsTest-1285107848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8cb0289-a7d9-4406-a8cb-e4b0498a2c7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:13:24 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-8c8ee55e-6b26-45dd-b2d9-312115535519 tempest-VolumesActionsTest-1285107848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8cb0289-a7d9-4406-a8cb-e4b0498a2c7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:13:24 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-8c8ee55e-6b26-45dd-b2d9-312115535519 tempest-VolumesActionsTest-1285107848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fcabe3d-30cf-4644-b4bd-f19dd42dacd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:13:24 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-8c8ee55e-6b26-45dd-b2d9-312115535519 tempest-VolumesActionsTest-1285107848 None] Volume 58959a00-9e4e-41cd-a5b8-33b8a29c9618: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58959a00-9e4e-41cd-a5b8-33b8a29c9618', 'volume_size': 1}
Apr 10 13:13:24 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-8c8ee55e-6b26-45dd-b2d9-312115535519 tempest-VolumesActionsTest-1285107848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:13:24 devstack sudo[86428]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:24 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-600b284b-5798-4a8b-98c6-e86879b01646 tempest-VolumesServicesTestJSON-571400284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-26e74305-f704-40ac-88e1-a03cfe038810" returned: 0 in 0.498s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:24 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-600b284b-5798-4a8b-98c6-e86879b01646 tempest-VolumesServicesTestJSON-571400284 None] <== create_volume: return (1027ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'} {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 13:13:24 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-600b284b-5798-4a8b-98c6-e86879b01646 tempest-VolumesServicesTestJSON-571400284 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.029s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:13:24 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-8c8ee55e-6b26-45dd-b2d9-312115535519 tempest-VolumesActionsTest-1285107848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.185s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:13:24 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-8c8ee55e-6b26-45dd-b2d9-312115535519 tempest-VolumesActionsTest-1285107848 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f252bf08b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:13:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-973597245',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58959a00-9e4e-41cd-a5b8-33b8a29c9618,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2551b2b6cd9f4994a93b4b15e32392da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:13:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:13:25Z,use_quota=True,user_id='aa1e9a5c093744c0a889c58c163c8c1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)}" {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 13:13:24 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-8c8ee55e-6b26-45dd-b2d9-312115535519 tempest-VolumesActionsTest-1285107848 None] Creating volume 58959a00-9e4e-41cd-a5b8-33b8a29c9618 {{(pid=83345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 13:13:24 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-8c8ee55e-6b26-45dd-b2d9-312115535519 tempest-VolumesActionsTest-1285107848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:13:24 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-8c8ee55e-6b26-45dd-b2d9-312115535519 tempest-VolumesActionsTest-1285107848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:13:24 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-8c8ee55e-6b26-45dd-b2d9-312115535519 tempest-VolumesActionsTest-1285107848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:13:24 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-8c8ee55e-6b26-45dd-b2d9-312115535519 tempest-VolumesActionsTest-1285107848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:13:24 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-8c8ee55e-6b26-45dd-b2d9-312115535519 tempest-VolumesActionsTest-1285107848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:13:24 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-8c8ee55e-6b26-45dd-b2d9-312115535519 tempest-VolumesActionsTest-1285107848 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:13:24 devstack cinder-volume[83345]: INFO cinder.volume.drivers.remotefs [None req-8c8ee55e-6b26-45dd-b2d9-312115535519 tempest-VolumesActionsTest-1285107848 None] casted to osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331
Apr 10 13:13:24 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-8c8ee55e-6b26-45dd-b2d9-312115535519 tempest-VolumesActionsTest-1285107848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-58959a00-9e4e-41cd-a5b8-33b8a29c9618 1073741824 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:24 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-600b284b-5798-4a8b-98c6-e86879b01646 tempest-VolumesServicesTestJSON-571400284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95b48182-9ab4-4e64-8aae-17d86790ca94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26e74305-f704-40ac-88e1-a03cfe038810', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:13:24 devstack sudo[86436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-58959a00-9e4e-41cd-a5b8-33b8a29c9618 1073741824
Apr 10 13:13:24 devstack sudo[86436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:24 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-600b284b-5798-4a8b-98c6-e86879b01646 tempest-VolumesServicesTestJSON-571400284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbe873b8-1639-499d-8954-3feac052d1fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:13:24 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-600b284b-5798-4a8b-98c6-e86879b01646 tempest-VolumesServicesTestJSON-571400284 None] Volume volume-26e74305-f704-40ac-88e1-a03cfe038810 (26e74305-f704-40ac-88e1-a03cfe038810): created successfully
Apr 10 13:13:24 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-600b284b-5798-4a8b-98c6-e86879b01646 tempest-VolumesServicesTestJSON-571400284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbe873b8-1639-499d-8954-3feac052d1fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:13:24 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-600b284b-5798-4a8b-98c6-e86879b01646 tempest-VolumesServicesTestJSON-571400284 None] Flow 'volume_create_manager' (77af817b-5c48-4eaa-af8a-118dd1257b5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:13:24 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-600b284b-5798-4a8b-98c6-e86879b01646 tempest-VolumesServicesTestJSON-571400284 None] Created volume successfully.
Apr 10 13:13:25 devstack sudo[86430]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:25 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-e9d47910-b29d-43b0-85be-116035659c8b tempest-GroupSnapshotsTest-2129977062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-3257e4cd-f375-49ff-b3df-7a7b6f0ee3d9.0f50a9d6-a952-4b41-8a99-f0dc8c421460" returned: 0 in 0.500s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:25 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-e9d47910-b29d-43b0-85be-116035659c8b tempest-GroupSnapshotsTest-2129977062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-3257e4cd-f375-49ff-b3df-7a7b6f0ee3d9.0f50a9d6-a952-4b41-8a99-f0dc8c421460 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:25 devstack sudo[86438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-3257e4cd-f375-49ff-b3df-7a7b6f0ee3d9.0f50a9d6-a952-4b41-8a99-f0dc8c421460
Apr 10 13:13:25 devstack sudo[86438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:25 devstack sudo[86436]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:25 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-8c8ee55e-6b26-45dd-b2d9-312115535519 tempest-VolumesActionsTest-1285107848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-58959a00-9e4e-41cd-a5b8-33b8a29c9618 1073741824" returned: 0 in 0.503s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:25 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-8c8ee55e-6b26-45dd-b2d9-312115535519 tempest-VolumesActionsTest-1285107848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-58959a00-9e4e-41cd-a5b8-33b8a29c9618 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:25 devstack sudo[86438]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:25 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-e9d47910-b29d-43b0-85be-116035659c8b tempest-GroupSnapshotsTest-2129977062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-3257e4cd-f375-49ff-b3df-7a7b6f0ee3d9.0f50a9d6-a952-4b41-8a99-f0dc8c421460" returned: 0 in 0.449s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:25 devstack sudo[86444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-58959a00-9e4e-41cd-a5b8-33b8a29c9618
Apr 10 13:13:25 devstack sudo[86444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:25 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-e9d47910-b29d-43b0-85be-116035659c8b tempest-GroupSnapshotsTest-2129977062 None] Lock "cinder-quobyte-0f50a9d6-a952-4b41-8a99-f0dc8c421460" released by "_delete_snapshot" :: held 2.249s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:13:25 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-e9d47910-b29d-43b0-85be-116035659c8b tempest-GroupSnapshotsTest-2129977062 None] Lock "cinder-quobyte-3257e4cd-f375-49ff-b3df-7a7b6f0ee3d9" released by "delete_snapshot" :: held 2.269s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:13:25 devstack cinder-volume[83345]: WARNING cinder.quota [None req-e9d47910-b29d-43b0-85be-116035659c8b tempest-GroupSnapshotsTest-2129977062 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1666761364 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1666761364, it is now deprecated. Please use the default quota class for default quota.
Apr 10 13:13:25 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-e9d47910-b29d-43b0-85be-116035659c8b tempest-GroupSnapshotsTest-2129977062 None] Created reservations ['bb0f36dc-173f-4c59-b280-21b05a2b4dc6', '0169dd5f-fb7f-41fe-89dd-69a1fbc8ebbb', '95d4ca02-6755-4ee6-8fc6-b9097b1b0a5d', '46b6eae1-58e1-4c32-be50-3a144b4348c8'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:13:25 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-e9d47910-b29d-43b0-85be-116035659c8b tempest-GroupSnapshotsTest-2129977062 None] group_snapshot 627df150-5422-4b40-bca7-790adf48962d: deleted successfully
Apr 10 13:13:25 devstack sudo[86444]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:25 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-8c8ee55e-6b26-45dd-b2d9-312115535519 tempest-VolumesActionsTest-1285107848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-58959a00-9e4e-41cd-a5b8-33b8a29c9618" returned: 0 in 0.471s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:25 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-8c8ee55e-6b26-45dd-b2d9-312115535519 tempest-VolumesActionsTest-1285107848 None] <== create_volume: return (999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'} {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 13:13:25 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-8c8ee55e-6b26-45dd-b2d9-312115535519 tempest-VolumesActionsTest-1285107848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.003s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:13:25 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-8c8ee55e-6b26-45dd-b2d9-312115535519 tempest-VolumesActionsTest-1285107848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fcabe3d-30cf-4644-b4bd-f19dd42dacd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58959a00-9e4e-41cd-a5b8-33b8a29c9618', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:13:25 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-8c8ee55e-6b26-45dd-b2d9-312115535519 tempest-VolumesActionsTest-1285107848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08fc1146-0c0d-4db7-b673-66a9e7f8aa00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:13:25 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-8c8ee55e-6b26-45dd-b2d9-312115535519 tempest-VolumesActionsTest-1285107848 None] Volume volume-58959a00-9e4e-41cd-a5b8-33b8a29c9618 (58959a00-9e4e-41cd-a5b8-33b8a29c9618): created successfully
Apr 10 13:13:25 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-8c8ee55e-6b26-45dd-b2d9-312115535519 tempest-VolumesActionsTest-1285107848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08fc1146-0c0d-4db7-b673-66a9e7f8aa00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:13:25 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-8c8ee55e-6b26-45dd-b2d9-312115535519 tempest-VolumesActionsTest-1285107848 None] Flow 'volume_create_manager' (f7b0ef9d-287e-4bbe-961a-8026eefa2ed0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:13:25 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-8c8ee55e-6b26-45dd-b2d9-312115535519 tempest-VolumesActionsTest-1285107848 None] Created volume successfully.
Apr 10 13:13:26 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-01ceb544-b9f7-40ef-9780-870ec5e754fb tempest-VolumesServicesTestJSON-571400284 None] Acquiring lock "cinder-26e74305-f704-40ac-88e1-a03cfe038810-delete_volume" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:13:26 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-01ceb544-b9f7-40ef-9780-870ec5e754fb tempest-VolumesServicesTestJSON-571400284 None] Lock "cinder-26e74305-f704-40ac-88e1-a03cfe038810-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:13:26 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-01ceb544-b9f7-40ef-9780-870ec5e754fb tempest-VolumesServicesTestJSON-571400284 None] Acquiring lock "cinder-quobyte-26e74305-f704-40ac-88e1-a03cfe038810" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:13:26 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-01ceb544-b9f7-40ef-9780-870ec5e754fb tempest-VolumesServicesTestJSON-571400284 None] Lock "cinder-quobyte-26e74305-f704-40ac-88e1-a03cfe038810" acquired by "delete_volume" :: waited 0.010s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:13:26 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[26856e13-9822-4f1c-81fd-da035e1c3867]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:13:26 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-01ceb544-b9f7-40ef-9780-870ec5e754fb tempest-VolumesServicesTestJSON-571400284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-26e74305-f704-40ac-88e1-a03cfe038810 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:26 devstack sudo[86448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-26e74305-f704-40ac-88e1-a03cfe038810
Apr 10 13:13:26 devstack sudo[86448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:26 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-d2b341dd-c080-446a-937c-2b52d69ed69e tempest-GroupSnapshotsTest-2129977062 None] Acquiring lock "cinder-quobyte-3257e4cd-f375-49ff-b3df-7a7b6f0ee3d9" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:13:26 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-d2b341dd-c080-446a-937c-2b52d69ed69e tempest-GroupSnapshotsTest-2129977062 None] Lock "cinder-quobyte-3257e4cd-f375-49ff-b3df-7a7b6f0ee3d9" acquired by "delete_volume" :: waited 0.009s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:13:26 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9075cd1-76e7-4946-8398-9e3ba224311d]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:13:26 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-d2b341dd-c080-446a-937c-2b52d69ed69e tempest-GroupSnapshotsTest-2129977062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-3257e4cd-f375-49ff-b3df-7a7b6f0ee3d9 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:26 devstack sudo[86451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-3257e4cd-f375-49ff-b3df-7a7b6f0ee3d9
Apr 10 13:13:26 devstack sudo[86451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:26 devstack sudo[86448]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:26 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-01ceb544-b9f7-40ef-9780-870ec5e754fb tempest-VolumesServicesTestJSON-571400284 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-26e74305-f704-40ac-88e1-a03cfe038810" returned: 0 in 0.544s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:26 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-01ceb544-b9f7-40ef-9780-870ec5e754fb tempest-VolumesServicesTestJSON-571400284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-26e74305-f704-40ac-88e1-a03cfe038810 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:26 devstack sudo[86467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-26e74305-f704-40ac-88e1-a03cfe038810
Apr 10 13:13:26 devstack sudo[86467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:27 devstack sudo[86451]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:27 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-d2b341dd-c080-446a-937c-2b52d69ed69e tempest-GroupSnapshotsTest-2129977062 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-3257e4cd-f375-49ff-b3df-7a7b6f0ee3d9" returned: 0 in 0.731s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:27 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-d2b341dd-c080-446a-937c-2b52d69ed69e tempest-GroupSnapshotsTest-2129977062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-3257e4cd-f375-49ff-b3df-7a7b6f0ee3d9 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:27 devstack sudo[86522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-3257e4cd-f375-49ff-b3df-7a7b6f0ee3d9
Apr 10 13:13:27 devstack sudo[86522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:27 devstack sudo[86467]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:27 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-01ceb544-b9f7-40ef-9780-870ec5e754fb tempest-VolumesServicesTestJSON-571400284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-26e74305-f704-40ac-88e1-a03cfe038810" returned: 0 in 0.696s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:27 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-01ceb544-b9f7-40ef-9780-870ec5e754fb tempest-VolumesServicesTestJSON-571400284 None] Lock "cinder-quobyte-26e74305-f704-40ac-88e1-a03cfe038810" released by "delete_volume" :: held 1.268s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:13:27 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-01ceb544-b9f7-40ef-9780-870ec5e754fb tempest-VolumesServicesTestJSON-571400284 None] Created reservations ['ae513418-02b5-4bd6-a3b2-68f08736d3e3', '2cc78f2f-8564-4e15-bc85-c589fc8b5571', 'aecf1c88-5543-4334-8cad-53ae29d3b900', '91bf8edc-8afb-4877-91d6-fa2742d3b423'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:13:27 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-01ceb544-b9f7-40ef-9780-870ec5e754fb tempest-VolumesServicesTestJSON-571400284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:13:27 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-01ceb544-b9f7-40ef-9780-870ec5e754fb tempest-VolumesServicesTestJSON-571400284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:13:27 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-01ceb544-b9f7-40ef-9780-870ec5e754fb tempest-VolumesServicesTestJSON-571400284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:13:27 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-01ceb544-b9f7-40ef-9780-870ec5e754fb tempest-VolumesServicesTestJSON-571400284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:13:27 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-01ceb544-b9f7-40ef-9780-870ec5e754fb tempest-VolumesServicesTestJSON-571400284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:13:27 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-01ceb544-b9f7-40ef-9780-870ec5e754fb tempest-VolumesServicesTestJSON-571400284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:27 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-cf15910b-e81d-481c-9b67-3b41e01116cc tempest-VolumesActionsTest-1285107848 None] Acquiring lock "cinder-58959a00-9e4e-41cd-a5b8-33b8a29c9618-delete_volume" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:13:27 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-cf15910b-e81d-481c-9b67-3b41e01116cc tempest-VolumesActionsTest-1285107848 None] Lock "cinder-58959a00-9e4e-41cd-a5b8-33b8a29c9618-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:13:27 devstack sudo[86524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:13:27 devstack sudo[86524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:27 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-cf15910b-e81d-481c-9b67-3b41e01116cc tempest-VolumesActionsTest-1285107848 None] Acquiring lock "cinder-quobyte-58959a00-9e4e-41cd-a5b8-33b8a29c9618" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:13:27 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-cf15910b-e81d-481c-9b67-3b41e01116cc tempest-VolumesActionsTest-1285107848 None] Lock "cinder-quobyte-58959a00-9e4e-41cd-a5b8-33b8a29c9618" acquired by "delete_volume" :: waited 0.014s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:13:27 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[34acfe1b-9392-45e0-83a4-05d071b449f1]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:13:27 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-cf15910b-e81d-481c-9b67-3b41e01116cc tempest-VolumesActionsTest-1285107848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-58959a00-9e4e-41cd-a5b8-33b8a29c9618 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:27 devstack sudo[86527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-58959a00-9e4e-41cd-a5b8-33b8a29c9618
Apr 10 13:13:27 devstack sudo[86527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:27 devstack sudo[86522]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:27 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-d2b341dd-c080-446a-937c-2b52d69ed69e tempest-GroupSnapshotsTest-2129977062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-3257e4cd-f375-49ff-b3df-7a7b6f0ee3d9" returned: 0 in 0.520s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:27 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-d2b341dd-c080-446a-937c-2b52d69ed69e tempest-GroupSnapshotsTest-2129977062 None] Lock "cinder-quobyte-3257e4cd-f375-49ff-b3df-7a7b6f0ee3d9" released by "delete_volume" :: held 1.281s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:13:27 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-d2b341dd-c080-446a-937c-2b52d69ed69e tempest-GroupSnapshotsTest-2129977062 None] Created reservations ['8a1c066e-2f07-4883-8b31-deb7b873f7d3'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:13:27 devstack cinder-volume[83345]: WARNING cinder.db.sqlalchemy.api [None req-d2b341dd-c080-446a-937c-2b52d69ed69e tempest-GroupSnapshotsTest-2129977062 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1666761364']
Apr 10 13:13:27 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-d2b341dd-c080-446a-937c-2b52d69ed69e tempest-GroupSnapshotsTest-2129977062 None] Created reservations ['465f9a34-fd8f-40cb-a703-749c72bb82ca', 'cb9a274b-be39-4190-ab79-b8adaea8e237', '774ea195-28a6-4e81-a0ca-78b7859ef2a4', 'aa3b721a-a3b9-4da9-a48c-796e854397aa'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:13:27 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-d2b341dd-c080-446a-937c-2b52d69ed69e tempest-GroupSnapshotsTest-2129977062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:13:27 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-d2b341dd-c080-446a-937c-2b52d69ed69e tempest-GroupSnapshotsTest-2129977062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:13:27 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-d2b341dd-c080-446a-937c-2b52d69ed69e tempest-GroupSnapshotsTest-2129977062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:13:27 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-d2b341dd-c080-446a-937c-2b52d69ed69e tempest-GroupSnapshotsTest-2129977062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:13:27 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-d2b341dd-c080-446a-937c-2b52d69ed69e tempest-GroupSnapshotsTest-2129977062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:13:27 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-d2b341dd-c080-446a-937c-2b52d69ed69e tempest-GroupSnapshotsTest-2129977062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:27 devstack sudo[86531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:13:27 devstack sudo[86531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:28 devstack sudo[86524]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:28 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-01ceb544-b9f7-40ef-9780-870ec5e754fb tempest-VolumesServicesTestJSON-571400284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.495s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:28 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-01ceb544-b9f7-40ef-9780-870ec5e754fb tempest-VolumesServicesTestJSON-571400284 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:13:28 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-01ceb544-b9f7-40ef-9780-870ec5e754fb tempest-VolumesServicesTestJSON-571400284 None] Deleted volume successfully.
Apr 10 13:13:28 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-01ceb544-b9f7-40ef-9780-870ec5e754fb tempest-VolumesServicesTestJSON-571400284 None] Lock "cinder-26e74305-f704-40ac-88e1-a03cfe038810-delete_volume" released by "delete_volume" :: held 1.930s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:13:28 devstack sudo[86527]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:28 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-cf15910b-e81d-481c-9b67-3b41e01116cc tempest-VolumesActionsTest-1285107848 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-58959a00-9e4e-41cd-a5b8-33b8a29c9618" returned: 0 in 0.514s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:28 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-cf15910b-e81d-481c-9b67-3b41e01116cc tempest-VolumesActionsTest-1285107848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-58959a00-9e4e-41cd-a5b8-33b8a29c9618 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:28 devstack sudo[86537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-58959a00-9e4e-41cd-a5b8-33b8a29c9618
Apr 10 13:13:28 devstack sudo[86537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:28 devstack sudo[86531]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:28 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-d2b341dd-c080-446a-937c-2b52d69ed69e tempest-GroupSnapshotsTest-2129977062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.528s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:28 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-d2b341dd-c080-446a-937c-2b52d69ed69e tempest-GroupSnapshotsTest-2129977062 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:13:28 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-d2b341dd-c080-446a-937c-2b52d69ed69e tempest-GroupSnapshotsTest-2129977062 None] Delete group completed successfully.
Apr 10 13:13:28 devstack sudo[86537]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:28 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-cf15910b-e81d-481c-9b67-3b41e01116cc tempest-VolumesActionsTest-1285107848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-58959a00-9e4e-41cd-a5b8-33b8a29c9618" returned: 0 in 0.534s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:28 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-cf15910b-e81d-481c-9b67-3b41e01116cc tempest-VolumesActionsTest-1285107848 None] Lock "cinder-quobyte-58959a00-9e4e-41cd-a5b8-33b8a29c9618" released by "delete_volume" :: held 1.079s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:13:28 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-cf15910b-e81d-481c-9b67-3b41e01116cc tempest-VolumesActionsTest-1285107848 None] Created reservations ['e3de39a7-5202-41fd-9709-b370837fa8c7', '79f18224-f353-4137-a349-938347ca6781', '6c51b1f5-75b0-43dd-b3ed-08d2f8252747', '44ca7808-8a72-4d6b-9eb4-cfa138dfeb0f'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:13:28 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-cf15910b-e81d-481c-9b67-3b41e01116cc tempest-VolumesActionsTest-1285107848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:13:28 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-cf15910b-e81d-481c-9b67-3b41e01116cc tempest-VolumesActionsTest-1285107848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:13:28 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-cf15910b-e81d-481c-9b67-3b41e01116cc tempest-VolumesActionsTest-1285107848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:13:28 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-cf15910b-e81d-481c-9b67-3b41e01116cc tempest-VolumesActionsTest-1285107848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:13:28 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-cf15910b-e81d-481c-9b67-3b41e01116cc tempest-VolumesActionsTest-1285107848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:13:28 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-cf15910b-e81d-481c-9b67-3b41e01116cc tempest-VolumesActionsTest-1285107848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:28 devstack sudo[86543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:13:28 devstack sudo[86543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:28 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-99cfc4db-ba10-40a1-a1af-7559f1b34caa tempest-GroupSnapshotsTest-2129977062 None] Group tempest-GroupSnapshotsTest-Group-1840834221: creating
Apr 10 13:13:29 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-99cfc4db-ba10-40a1-a1af-7559f1b34caa tempest-GroupSnapshotsTest-2129977062 None] Group tempest-GroupSnapshotsTest-Group-1840834221: created successfully
Apr 10 13:13:29 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-99cfc4db-ba10-40a1-a1af-7559f1b34caa tempest-GroupSnapshotsTest-2129977062 None] Create group completed successfully.
Apr 10 13:13:29 devstack sudo[86543]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:29 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-cf15910b-e81d-481c-9b67-3b41e01116cc tempest-VolumesActionsTest-1285107848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.541s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:29 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-cf15910b-e81d-481c-9b67-3b41e01116cc tempest-VolumesActionsTest-1285107848 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:13:29 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-cf15910b-e81d-481c-9b67-3b41e01116cc tempest-VolumesActionsTest-1285107848 None] Deleted volume successfully.
Apr 10 13:13:29 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-cf15910b-e81d-481c-9b67-3b41e01116cc tempest-VolumesActionsTest-1285107848 None] Lock "cinder-58959a00-9e4e-41cd-a5b8-33b8a29c9618-delete_volume" released by "delete_volume" :: held 1.842s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:13:30 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c0aeffe-cc2f-43d0-800e-05b42d8a1f34 tempest-GroupSnapshotsTest-2129977062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:13:30 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-3c0aeffe-cc2f-43d0-800e-05b42d8a1f34 tempest-GroupSnapshotsTest-2129977062 None] Flow 'volume_create_manager' (9ee86c06-c822-49b5-89ca-dd2e5c512e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:13:30 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-3c0aeffe-cc2f-43d0-800e-05b42d8a1f34 tempest-GroupSnapshotsTest-2129977062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a2c92c6-d8a0-4f74-a5f7-e6362f8cbbb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:13:30 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-3c0aeffe-cc2f-43d0-800e-05b42d8a1f34 tempest-GroupSnapshotsTest-2129977062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a2c92c6-d8a0-4f74-a5f7-e6362f8cbbb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:13:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-205024728',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=f3d7fc2c-cb39-491a-b195-891d28b9b8bf,host='devstack@QuobyteHD#QuobyteHD',id=cca8c9b4-7289-47df-8435-3c5fa2fdf75a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83b6561967ad4eb28500542ade97ab3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:13:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:13:30Z,use_quota=True,user_id='83cee95bb380438c8ca284260999dfd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9f151421-404a-494e-b6c9-2a46eae1f44b),volume_type_id=9f151421-404a-494e-b6c9-2a46eae1f44b)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:13:30 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-3c0aeffe-cc2f-43d0-800e-05b42d8a1f34 tempest-GroupSnapshotsTest-2129977062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e48ec6e8-ffb5-4cc1-bb77-dd127dc51683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:13:30 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-3c0aeffe-cc2f-43d0-800e-05b42d8a1f34 tempest-GroupSnapshotsTest-2129977062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e48ec6e8-ffb5-4cc1-bb77-dd127dc51683) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:13:30 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-3c0aeffe-cc2f-43d0-800e-05b42d8a1f34 tempest-GroupSnapshotsTest-2129977062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6bd9365-32c6-411b-a493-a0fdfad80b9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:13:30 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-3c0aeffe-cc2f-43d0-800e-05b42d8a1f34 tempest-GroupSnapshotsTest-2129977062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6bd9365-32c6-411b-a493-a0fdfad80b9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cca8c9b4-7289-47df-8435-3c5fa2fdf75a', 'volume_name': 'volume-cca8c9b4-7289-47df-8435-3c5fa2fdf75a', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:13:30 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-3c0aeffe-cc2f-43d0-800e-05b42d8a1f34 tempest-GroupSnapshotsTest-2129977062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80b02a18-9119-427e-9e79-8bcf6bafeddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:13:30 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-3c0aeffe-cc2f-43d0-800e-05b42d8a1f34 tempest-GroupSnapshotsTest-2129977062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80b02a18-9119-427e-9e79-8bcf6bafeddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:13:30 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-3c0aeffe-cc2f-43d0-800e-05b42d8a1f34 tempest-GroupSnapshotsTest-2129977062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67b03855-2cc8-4418-b065-3a00656dd1fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:13:30 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-3c0aeffe-cc2f-43d0-800e-05b42d8a1f34 tempest-GroupSnapshotsTest-2129977062 None] Volume cca8c9b4-7289-47df-8435-3c5fa2fdf75a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cca8c9b4-7289-47df-8435-3c5fa2fdf75a', 'volume_size': 1}
Apr 10 13:13:30 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-3c0aeffe-cc2f-43d0-800e-05b42d8a1f34 tempest-GroupSnapshotsTest-2129977062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:13:30 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-3c0aeffe-cc2f-43d0-800e-05b42d8a1f34 tempest-GroupSnapshotsTest-2129977062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:13:30 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-3c0aeffe-cc2f-43d0-800e-05b42d8a1f34 tempest-GroupSnapshotsTest-2129977062 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f252bf08b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=f3d7fc2c-cb39-491a-b195-891d28b9b8bf,created_at=2026-04-10T11:13:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-205024728',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=f3d7fc2c-cb39-491a-b195-891d28b9b8bf,host='devstack@QuobyteHD#QuobyteHD',id=cca8c9b4-7289-47df-8435-3c5fa2fdf75a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83b6561967ad4eb28500542ade97ab3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:13:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:13:30Z,use_quota=True,user_id='83cee95bb380438c8ca284260999dfd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9f151421-404a-494e-b6c9-2a46eae1f44b),volume_type_id=9f151421-404a-494e-b6c9-2a46eae1f44b)}" {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 13:13:30 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-3c0aeffe-cc2f-43d0-800e-05b42d8a1f34 tempest-GroupSnapshotsTest-2129977062 None] Creating volume cca8c9b4-7289-47df-8435-3c5fa2fdf75a {{(pid=83345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 13:13:30 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-3c0aeffe-cc2f-43d0-800e-05b42d8a1f34 tempest-GroupSnapshotsTest-2129977062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:13:30 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-3c0aeffe-cc2f-43d0-800e-05b42d8a1f34 tempest-GroupSnapshotsTest-2129977062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:13:30 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-3c0aeffe-cc2f-43d0-800e-05b42d8a1f34 tempest-GroupSnapshotsTest-2129977062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:13:30 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-3c0aeffe-cc2f-43d0-800e-05b42d8a1f34 tempest-GroupSnapshotsTest-2129977062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:13:30 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-3c0aeffe-cc2f-43d0-800e-05b42d8a1f34 tempest-GroupSnapshotsTest-2129977062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:13:30 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-3c0aeffe-cc2f-43d0-800e-05b42d8a1f34 tempest-GroupSnapshotsTest-2129977062 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:13:30 devstack cinder-volume[83345]: INFO cinder.volume.drivers.remotefs [None req-3c0aeffe-cc2f-43d0-800e-05b42d8a1f34 tempest-GroupSnapshotsTest-2129977062 None] casted to osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331
Apr 10 13:13:30 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-3c0aeffe-cc2f-43d0-800e-05b42d8a1f34 tempest-GroupSnapshotsTest-2129977062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-cca8c9b4-7289-47df-8435-3c5fa2fdf75a 1073741824 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:30 devstack sudo[86547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-cca8c9b4-7289-47df-8435-3c5fa2fdf75a 1073741824
Apr 10 13:13:30 devstack sudo[86547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:31 devstack sudo[86547]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:31 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-3c0aeffe-cc2f-43d0-800e-05b42d8a1f34 tempest-GroupSnapshotsTest-2129977062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-cca8c9b4-7289-47df-8435-3c5fa2fdf75a 1073741824" returned: 0 in 0.641s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:31 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-3c0aeffe-cc2f-43d0-800e-05b42d8a1f34 tempest-GroupSnapshotsTest-2129977062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-cca8c9b4-7289-47df-8435-3c5fa2fdf75a {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:31 devstack sudo[86553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-cca8c9b4-7289-47df-8435-3c5fa2fdf75a
Apr 10 13:13:31 devstack sudo[86553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:31 devstack sudo[86553]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:31 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-3c0aeffe-cc2f-43d0-800e-05b42d8a1f34 tempest-GroupSnapshotsTest-2129977062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-cca8c9b4-7289-47df-8435-3c5fa2fdf75a" returned: 0 in 0.539s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:31 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-3c0aeffe-cc2f-43d0-800e-05b42d8a1f34 tempest-GroupSnapshotsTest-2129977062 None] <== create_volume: return (1206ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'} {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 13:13:31 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-3c0aeffe-cc2f-43d0-800e-05b42d8a1f34 tempest-GroupSnapshotsTest-2129977062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.209s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:13:31 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-3c0aeffe-cc2f-43d0-800e-05b42d8a1f34 tempest-GroupSnapshotsTest-2129977062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67b03855-2cc8-4418-b065-3a00656dd1fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cca8c9b4-7289-47df-8435-3c5fa2fdf75a', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:13:31 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-3c0aeffe-cc2f-43d0-800e-05b42d8a1f34 tempest-GroupSnapshotsTest-2129977062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f41a213e-da15-4144-9736-20db719bfee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:13:31 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-3c0aeffe-cc2f-43d0-800e-05b42d8a1f34 tempest-GroupSnapshotsTest-2129977062 None] Volume volume-cca8c9b4-7289-47df-8435-3c5fa2fdf75a (cca8c9b4-7289-47df-8435-3c5fa2fdf75a): created successfully
Apr 10 13:13:31 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-3c0aeffe-cc2f-43d0-800e-05b42d8a1f34 tempest-GroupSnapshotsTest-2129977062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f41a213e-da15-4144-9736-20db719bfee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:13:31 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-3c0aeffe-cc2f-43d0-800e-05b42d8a1f34 tempest-GroupSnapshotsTest-2129977062 None] Flow 'volume_create_manager' (9ee86c06-c822-49b5-89ca-dd2e5c512e13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:13:31 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-3c0aeffe-cc2f-43d0-800e-05b42d8a1f34 tempest-GroupSnapshotsTest-2129977062 None] Created volume successfully.
Apr 10 13:13:32 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-8eede0aa-a049-4f3f-a5c6-4733b34658c8 tempest-GroupSnapshotsTest-2129977062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:13:32 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-8eede0aa-a049-4f3f-a5c6-4733b34658c8 tempest-GroupSnapshotsTest-2129977062 None] Flow 'volume_create_manager' (313e15cc-9c43-41fc-8607-a6b7f50e25c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:13:32 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-8eede0aa-a049-4f3f-a5c6-4733b34658c8 tempest-GroupSnapshotsTest-2129977062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4ab2d93-8c40-4fb5-aeaa-ca2d219b947b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:13:32 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-8eede0aa-a049-4f3f-a5c6-4733b34658c8 tempest-GroupSnapshotsTest-2129977062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4ab2d93-8c40-4fb5-aeaa-ca2d219b947b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:13:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1581421138',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=f3d7fc2c-cb39-491a-b195-891d28b9b8bf,host='devstack@QuobyteHD#QuobyteHD',id=b2a4c2ae-704d-4b49-81aa-413280bfccdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83b6561967ad4eb28500542ade97ab3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:13:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:13:33Z,use_quota=True,user_id='83cee95bb380438c8ca284260999dfd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9f151421-404a-494e-b6c9-2a46eae1f44b),volume_type_id=9f151421-404a-494e-b6c9-2a46eae1f44b)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:13:32 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-8eede0aa-a049-4f3f-a5c6-4733b34658c8 tempest-GroupSnapshotsTest-2129977062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af680ec4-6770-46c2-b287-150716e79239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:13:32 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-8eede0aa-a049-4f3f-a5c6-4733b34658c8 tempest-GroupSnapshotsTest-2129977062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af680ec4-6770-46c2-b287-150716e79239) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:13:32 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-8eede0aa-a049-4f3f-a5c6-4733b34658c8 tempest-GroupSnapshotsTest-2129977062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ba9ab10-ba53-4fd5-bfc5-11c1a022b620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:13:32 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-8eede0aa-a049-4f3f-a5c6-4733b34658c8 tempest-GroupSnapshotsTest-2129977062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ba9ab10-ba53-4fd5-bfc5-11c1a022b620) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2a4c2ae-704d-4b49-81aa-413280bfccdd', 'volume_name': 'volume-b2a4c2ae-704d-4b49-81aa-413280bfccdd', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:13:32 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-8eede0aa-a049-4f3f-a5c6-4733b34658c8 tempest-GroupSnapshotsTest-2129977062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60955000-7515-42bb-b0c2-2b7256b0e86a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:13:32 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-8eede0aa-a049-4f3f-a5c6-4733b34658c8 tempest-GroupSnapshotsTest-2129977062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60955000-7515-42bb-b0c2-2b7256b0e86a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:13:32 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-8eede0aa-a049-4f3f-a5c6-4733b34658c8 tempest-GroupSnapshotsTest-2129977062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0ae890e-f8da-4cdc-8790-27caf07eb420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:13:32 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-8eede0aa-a049-4f3f-a5c6-4733b34658c8 tempest-GroupSnapshotsTest-2129977062 None] Volume b2a4c2ae-704d-4b49-81aa-413280bfccdd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2a4c2ae-704d-4b49-81aa-413280bfccdd', 'volume_size': 1}
Apr 10 13:13:32 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-8eede0aa-a049-4f3f-a5c6-4733b34658c8 tempest-GroupSnapshotsTest-2129977062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:13:32 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-8eede0aa-a049-4f3f-a5c6-4733b34658c8 tempest-GroupSnapshotsTest-2129977062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:13:32 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-8eede0aa-a049-4f3f-a5c6-4733b34658c8 tempest-GroupSnapshotsTest-2129977062 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f252bf08b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=f3d7fc2c-cb39-491a-b195-891d28b9b8bf,created_at=2026-04-10T11:13:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1581421138',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=f3d7fc2c-cb39-491a-b195-891d28b9b8bf,host='devstack@QuobyteHD#QuobyteHD',id=b2a4c2ae-704d-4b49-81aa-413280bfccdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83b6561967ad4eb28500542ade97ab3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:13:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:13:33Z,use_quota=True,user_id='83cee95bb380438c8ca284260999dfd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9f151421-404a-494e-b6c9-2a46eae1f44b),volume_type_id=9f151421-404a-494e-b6c9-2a46eae1f44b)}" {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 13:13:32 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-8eede0aa-a049-4f3f-a5c6-4733b34658c8 tempest-GroupSnapshotsTest-2129977062 None] Creating volume b2a4c2ae-704d-4b49-81aa-413280bfccdd {{(pid=83345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 13:13:32 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-8eede0aa-a049-4f3f-a5c6-4733b34658c8 tempest-GroupSnapshotsTest-2129977062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:13:32 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-8eede0aa-a049-4f3f-a5c6-4733b34658c8 tempest-GroupSnapshotsTest-2129977062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:13:32 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-8eede0aa-a049-4f3f-a5c6-4733b34658c8 tempest-GroupSnapshotsTest-2129977062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:13:32 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-8eede0aa-a049-4f3f-a5c6-4733b34658c8 tempest-GroupSnapshotsTest-2129977062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:13:32 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-8eede0aa-a049-4f3f-a5c6-4733b34658c8 tempest-GroupSnapshotsTest-2129977062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:13:32 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-8eede0aa-a049-4f3f-a5c6-4733b34658c8 tempest-GroupSnapshotsTest-2129977062 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:13:32 devstack cinder-volume[83345]: INFO cinder.volume.drivers.remotefs [None req-8eede0aa-a049-4f3f-a5c6-4733b34658c8 tempest-GroupSnapshotsTest-2129977062 None] casted to osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331
Apr 10 13:13:32 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-8eede0aa-a049-4f3f-a5c6-4733b34658c8 tempest-GroupSnapshotsTest-2129977062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b2a4c2ae-704d-4b49-81aa-413280bfccdd 1073741824 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:32 devstack sudo[86558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b2a4c2ae-704d-4b49-81aa-413280bfccdd 1073741824
Apr 10 13:13:32 devstack sudo[86558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:33 devstack sudo[86558]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:33 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-8eede0aa-a049-4f3f-a5c6-4733b34658c8 tempest-GroupSnapshotsTest-2129977062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b2a4c2ae-704d-4b49-81aa-413280bfccdd 1073741824" returned: 0 in 0.593s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:33 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-8eede0aa-a049-4f3f-a5c6-4733b34658c8 tempest-GroupSnapshotsTest-2129977062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b2a4c2ae-704d-4b49-81aa-413280bfccdd {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:33 devstack sudo[86565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b2a4c2ae-704d-4b49-81aa-413280bfccdd
Apr 10 13:13:33 devstack sudo[86565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:34 devstack sudo[86565]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:34 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-8eede0aa-a049-4f3f-a5c6-4733b34658c8 tempest-GroupSnapshotsTest-2129977062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b2a4c2ae-704d-4b49-81aa-413280bfccdd" returned: 0 in 0.503s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:34 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-8eede0aa-a049-4f3f-a5c6-4733b34658c8 tempest-GroupSnapshotsTest-2129977062 None] <== create_volume: return (1132ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'} {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 13:13:34 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-8eede0aa-a049-4f3f-a5c6-4733b34658c8 tempest-GroupSnapshotsTest-2129977062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.136s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:13:34 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-8eede0aa-a049-4f3f-a5c6-4733b34658c8 tempest-GroupSnapshotsTest-2129977062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0ae890e-f8da-4cdc-8790-27caf07eb420) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2a4c2ae-704d-4b49-81aa-413280bfccdd', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:13:34 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-8eede0aa-a049-4f3f-a5c6-4733b34658c8 tempest-GroupSnapshotsTest-2129977062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a17120e9-6a3f-49ae-8385-20c01e798336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:13:34 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-8eede0aa-a049-4f3f-a5c6-4733b34658c8 tempest-GroupSnapshotsTest-2129977062 None] Volume volume-b2a4c2ae-704d-4b49-81aa-413280bfccdd (b2a4c2ae-704d-4b49-81aa-413280bfccdd): created successfully
Apr 10 13:13:34 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-8eede0aa-a049-4f3f-a5c6-4733b34658c8 tempest-GroupSnapshotsTest-2129977062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a17120e9-6a3f-49ae-8385-20c01e798336) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:13:34 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-8eede0aa-a049-4f3f-a5c6-4733b34658c8 tempest-GroupSnapshotsTest-2129977062 None] Flow 'volume_create_manager' (313e15cc-9c43-41fc-8607-a6b7f50e25c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:13:34 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-8eede0aa-a049-4f3f-a5c6-4733b34658c8 tempest-GroupSnapshotsTest-2129977062 None] Created volume successfully.
Apr 10 13:13:35 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-b98b4af9-546b-4e00-a229-8e3a9434e8db tempest-GroupSnapshotsTest-2129977062 None] Update group completed successfully.
Apr 10 13:13:36 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-4012352b-b7fa-44db-b86e-867cca482bd6 tempest-GroupSnapshotsTest-2129977062 None] Update group completed successfully.
Apr 10 13:13:37 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-4368ddca-c667-42de-9d27-da35c0c2e8f3 tempest-GroupSnapshotsTest-2129977062 None] Update group completed successfully.
Apr 10 13:13:38 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-89be17b6-efd4-4889-9333-0e2a0fabe530 tempest-GroupSnapshotsTest-2129977062 None] Update group completed successfully.
Apr 10 13:13:39 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-474d33ce-7a09-45fc-af68-1e5450eeb998 tempest-GroupSnapshotsTest-2129977062 None] GroupSnapshot afeb2fa2-ea6f-4e02-8890-c9ab50c62009: creating.
Apr 10 13:13:39 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-474d33ce-7a09-45fc-af68-1e5450eeb998 tempest-GroupSnapshotsTest-2129977062 None] Group snapshot afeb2fa2-ea6f-4e02-8890-c9ab50c62009: creating. {{(pid=83345) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 10 13:13:39 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-474d33ce-7a09-45fc-af68-1e5450eeb998 tempest-GroupSnapshotsTest-2129977062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:13:39 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-474d33ce-7a09-45fc-af68-1e5450eeb998 tempest-GroupSnapshotsTest-2129977062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:13:39 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-474d33ce-7a09-45fc-af68-1e5450eeb998 tempest-GroupSnapshotsTest-2129977062 None] Creating offline snapshot 01662fe9-aa6f-45ea-ba66-682f0764a599 of volume cca8c9b4-7289-47df-8435-3c5fa2fdf75a {{(pid=83345) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 10 13:13:39 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b33b963-3f5a-409d-a15c-19c0568839c0]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:13:39 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-474d33ce-7a09-45fc-af68-1e5450eeb998 tempest-GroupSnapshotsTest-2129977062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-cca8c9b4-7289-47df-8435-3c5fa2fdf75a {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:40 devstack sudo[86570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-cca8c9b4-7289-47df-8435-3c5fa2fdf75a
Apr 10 13:13:40 devstack sudo[86570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:40 devstack sudo[86570]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:40 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-0afa5745-ede6-4e3c-83cc-ce49373b6d7d tempest-VolumesImageMetadata-1935899781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:13:40 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-0afa5745-ede6-4e3c-83cc-ce49373b6d7d tempest-VolumesImageMetadata-1935899781 None] Flow 'volume_create_manager' (1039fd9e-5e67-4ef3-b17e-b342313f96b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:13:40 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-0afa5745-ede6-4e3c-83cc-ce49373b6d7d tempest-VolumesImageMetadata-1935899781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f98e9017-b184-451e-a240-1d3c399f1548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:13:40 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-474d33ce-7a09-45fc-af68-1e5450eeb998 tempest-GroupSnapshotsTest-2129977062 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-cca8c9b4-7289-47df-8435-3c5fa2fdf75a" returned: 0 in 0.772s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:40 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-474d33ce-7a09-45fc-af68-1e5450eeb998 tempest-GroupSnapshotsTest-2129977062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-cca8c9b4-7289-47df-8435-3c5fa2fdf75a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-cca8c9b4-7289-47df-8435-3c5fa2fdf75a.01662fe9-aa6f-45ea-ba66-682f0764a599 1G {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:40 devstack sudo[86575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-cca8c9b4-7289-47df-8435-3c5fa2fdf75a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-cca8c9b4-7289-47df-8435-3c5fa2fdf75a.01662fe9-aa6f-45ea-ba66-682f0764a599 1G
Apr 10 13:13:40 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-0afa5745-ede6-4e3c-83cc-ce49373b6d7d tempest-VolumesImageMetadata-1935899781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f98e9017-b184-451e-a240-1d3c399f1548) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:13:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-123063468',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee72b61a-a13f-4979-8ecb-245617004a20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e325166f9254c85b1745991693f93c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:13:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:13:41Z,use_quota=True,user_id='f7c86270f34640ad8d1b995d5a28496c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:13:40 devstack sudo[86575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:40 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-0afa5745-ede6-4e3c-83cc-ce49373b6d7d tempest-VolumesImageMetadata-1935899781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd2fa1c3-dd79-41ec-bb81-c67ed9644ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:13:40 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-0afa5745-ede6-4e3c-83cc-ce49373b6d7d tempest-VolumesImageMetadata-1935899781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd2fa1c3-dd79-41ec-bb81-c67ed9644ef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:13:40 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-0afa5745-ede6-4e3c-83cc-ce49373b6d7d tempest-VolumesImageMetadata-1935899781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85492099-b15c-403e-b788-c3acddc3b6b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:13:40 devstack cinder-volume[83345]: DEBUG cinder.image.glance [None req-0afa5745-ede6-4e3c-83cc-ce49373b6d7d tempest-VolumesImageMetadata-1935899781 None] Creating Keystone auth plugin from conf {{(pid=83345) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 10 13:13:41 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-0afa5745-ede6-4e3c-83cc-ce49373b6d7d tempest-VolumesImageMetadata-1935899781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85492099-b15c-403e-b788-c3acddc3b6b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ee72b61a-a13f-4979-8ecb-245617004a20', 'volume_name': 'volume-ee72b61a-a13f-4979-8ecb-245617004a20', 'volume_size': 1, 'image_id': 'dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8c498714b5e64042a43894acdb754f15', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5', 'created_at': datetime.datetime(2026, 4, 10, 11, 6, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 10, 11, 6, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f25211cffd0>}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:13:41 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-0afa5745-ede6-4e3c-83cc-ce49373b6d7d tempest-VolumesImageMetadata-1935899781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b20cbcd-89ab-47c8-8d98-67edc7599020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:13:41 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-0afa5745-ede6-4e3c-83cc-ce49373b6d7d tempest-VolumesImageMetadata-1935899781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b20cbcd-89ab-47c8-8d98-67edc7599020) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:13:41 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-0afa5745-ede6-4e3c-83cc-ce49373b6d7d tempest-VolumesImageMetadata-1935899781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1223132-e1ff-46ae-9c3e-7925f521af3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:13:41 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-0afa5745-ede6-4e3c-83cc-ce49373b6d7d tempest-VolumesImageMetadata-1935899781 None] Volume ee72b61a-a13f-4979-8ecb-245617004a20: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ee72b61a-a13f-4979-8ecb-245617004a20', 'volume_size': 1, 'image_id': 'dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8c498714b5e64042a43894acdb754f15', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5', 'created_at': datetime.datetime(2026, 4, 10, 11, 6, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 10, 11, 6, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f25211cffd0>}
Apr 10 13:13:41 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-0afa5745-ede6-4e3c-83cc-ce49373b6d7d tempest-VolumesImageMetadata-1935899781 None] Trying to clone ee72b61a-a13f-4979-8ecb-245617004a20 from image dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5 at location (None, [{'url': 'file:///opt/stack/data/glance/images/dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5', 'metadata': {}}]). {{(pid=83345) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 10 13:13:41 devstack cinder-volume[83345]: DEBUG cinder.image.image_utils [None req-0afa5745-ede6-4e3c-83cc-ce49373b6d7d tempest-VolumesImageMetadata-1935899781 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5_0lw9vlgudevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83345) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 10 13:13:41 devstack cinder-volume[83345]: INFO cinder.image.image_utils [None req-0afa5745-ede6-4e3c-83cc-ce49373b6d7d tempest-VolumesImageMetadata-1935899781 None] Image download 20.69 MB at 20.69 MB/s
Apr 10 13:13:41 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[7661b7f4-b48f-4e85-8d85-6a237a4dd93a]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:13:41 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-0afa5745-ede6-4e3c-83cc-ce49373b6d7d tempest-VolumesImageMetadata-1935899781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5_0lw9vlgudevstack@QuobyteHD {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:41 devstack sudo[86575]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:41 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-474d33ce-7a09-45fc-af68-1e5450eeb998 tempest-GroupSnapshotsTest-2129977062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-cca8c9b4-7289-47df-8435-3c5fa2fdf75a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-cca8c9b4-7289-47df-8435-3c5fa2fdf75a.01662fe9-aa6f-45ea-ba66-682f0764a599 1G" returned: 0 in 0.752s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:41 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-474d33ce-7a09-45fc-af68-1e5450eeb998 tempest-GroupSnapshotsTest-2129977062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cca8c9b4-7289-47df-8435-3c5fa2fdf75a -F qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-cca8c9b4-7289-47df-8435-3c5fa2fdf75a.01662fe9-aa6f-45ea-ba66-682f0764a599 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:41 devstack sudo[86583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cca8c9b4-7289-47df-8435-3c5fa2fdf75a -F qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-cca8c9b4-7289-47df-8435-3c5fa2fdf75a.01662fe9-aa6f-45ea-ba66-682f0764a599
Apr 10 13:13:41 devstack sudo[86583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:41 devstack sudo[86582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5_0lw9vlgudevstack@QuobyteHD
Apr 10 13:13:41 devstack sudo[86582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:41 devstack sudo[86582]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:41 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-0afa5745-ede6-4e3c-83cc-ce49373b6d7d tempest-VolumesImageMetadata-1935899781 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5_0lw9vlgudevstack@QuobyteHD" returned: 0 in 0.552s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:41 devstack cinder-volume[83345]: DEBUG cinder.image.image_utils [None req-0afa5745-ede6-4e3c-83cc-ce49373b6d7d tempest-VolumesImageMetadata-1935899781 None] Temporary image dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5 is fetched for user f7c86270f34640ad8d1b995d5a28496c. {{(pid=83345) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 10 13:13:42 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[472333d1-9279-4842-a7cd-f97fde96791c]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:13:42 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-0afa5745-ede6-4e3c-83cc-ce49373b6d7d tempest-VolumesImageMetadata-1935899781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5_0lw9vlgudevstack@QuobyteHD {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:42 devstack sudo[86583]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:42 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-474d33ce-7a09-45fc-af68-1e5450eeb998 tempest-GroupSnapshotsTest-2129977062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cca8c9b4-7289-47df-8435-3c5fa2fdf75a -F qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-cca8c9b4-7289-47df-8435-3c5fa2fdf75a.01662fe9-aa6f-45ea-ba66-682f0764a599" returned: 0 in 0.635s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:42 devstack cinder-volume[83345]: WARNING cinder.volume.drivers.remotefs [None req-474d33ce-7a09-45fc-af68-1e5450eeb998 tempest-GroupSnapshotsTest-2129977062 None] /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-cca8c9b4-7289-47df-8435-3c5fa2fdf75a.01662fe9-aa6f-45ea-ba66-682f0764a599 is being set with open permissions: ugo+rw: NotImplementedError
Apr 10 13:13:42 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-474d33ce-7a09-45fc-af68-1e5450eeb998 tempest-GroupSnapshotsTest-2129977062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-cca8c9b4-7289-47df-8435-3c5fa2fdf75a.01662fe9-aa6f-45ea-ba66-682f0764a599 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:42 devstack sudo[86593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-cca8c9b4-7289-47df-8435-3c5fa2fdf75a.01662fe9-aa6f-45ea-ba66-682f0764a599
Apr 10 13:13:42 devstack sudo[86593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:42 devstack sudo[86592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5_0lw9vlgudevstack@QuobyteHD
Apr 10 13:13:42 devstack sudo[86592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:42 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-03111884-1932-4aed-9f04-b6d09023681b tempest-VolumesListAdminTestJSON-1892539430 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:13:42 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-03111884-1932-4aed-9f04-b6d09023681b tempest-VolumesListAdminTestJSON-1892539430 None] Flow 'volume_create_manager' (1af231e1-ae8f-4528-9ab9-918a6ef8bc7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:13:42 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-03111884-1932-4aed-9f04-b6d09023681b tempest-VolumesListAdminTestJSON-1892539430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdd7b111-4e19-49ab-afa3-0939febfefe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:13:42 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-03111884-1932-4aed-9f04-b6d09023681b tempest-VolumesListAdminTestJSON-1892539430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdd7b111-4e19-49ab-afa3-0939febfefe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:13:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1195779327',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db0816ed-1457-4bc3-b8bf-5d7ae15836b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa9223f985014b97a7407a2b8f3f5568',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:13:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:13:42Z,use_quota=True,user_id='78ec1ed84a964c3d895a894a392dd8fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:13:42 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-03111884-1932-4aed-9f04-b6d09023681b tempest-VolumesListAdminTestJSON-1892539430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35afe458-6530-4fad-95d2-e2fa68ec4769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:13:42 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-03111884-1932-4aed-9f04-b6d09023681b tempest-VolumesListAdminTestJSON-1892539430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35afe458-6530-4fad-95d2-e2fa68ec4769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:13:42 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-03111884-1932-4aed-9f04-b6d09023681b tempest-VolumesListAdminTestJSON-1892539430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (306db28c-871c-4dc0-a414-a2e15d77fa1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:13:42 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-03111884-1932-4aed-9f04-b6d09023681b tempest-VolumesListAdminTestJSON-1892539430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (306db28c-871c-4dc0-a414-a2e15d77fa1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db0816ed-1457-4bc3-b8bf-5d7ae15836b7', 'volume_name': 'volume-db0816ed-1457-4bc3-b8bf-5d7ae15836b7', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:13:42 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-03111884-1932-4aed-9f04-b6d09023681b tempest-VolumesListAdminTestJSON-1892539430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8b81727-19b1-4450-b916-fe46e5cf0ca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:13:42 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-03111884-1932-4aed-9f04-b6d09023681b tempest-VolumesListAdminTestJSON-1892539430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8b81727-19b1-4450-b916-fe46e5cf0ca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:13:42 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-03111884-1932-4aed-9f04-b6d09023681b tempest-VolumesListAdminTestJSON-1892539430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81b3467f-3b71-4eb2-b0b7-db4600f2ca8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:13:42 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-03111884-1932-4aed-9f04-b6d09023681b tempest-VolumesListAdminTestJSON-1892539430 None] Volume db0816ed-1457-4bc3-b8bf-5d7ae15836b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db0816ed-1457-4bc3-b8bf-5d7ae15836b7', 'volume_size': 1}
Apr 10 13:13:42 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-03111884-1932-4aed-9f04-b6d09023681b tempest-VolumesListAdminTestJSON-1892539430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:13:42 devstack sudo[86593]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:42 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-474d33ce-7a09-45fc-af68-1e5450eeb998 tempest-GroupSnapshotsTest-2129977062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-cca8c9b4-7289-47df-8435-3c5fa2fdf75a.01662fe9-aa6f-45ea-ba66-682f0764a599" returned: 0 in 0.513s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:42 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-474d33ce-7a09-45fc-af68-1e5450eeb998 tempest-GroupSnapshotsTest-2129977062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-cca8c9b4-7289-47df-8435-3c5fa2fdf75a.info {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:42 devstack sudo[86600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-cca8c9b4-7289-47df-8435-3c5fa2fdf75a.info
Apr 10 13:13:42 devstack sudo[86600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:42 devstack sudo[86592]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:42 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-0afa5745-ede6-4e3c-83cc-ce49373b6d7d tempest-VolumesImageMetadata-1935899781 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5_0lw9vlgudevstack@QuobyteHD" returned: 0 in 0.664s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:42 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-0afa5745-ede6-4e3c-83cc-ce49373b6d7d tempest-VolumesImageMetadata-1935899781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:13:43 devstack sudo[86600]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:43 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-474d33ce-7a09-45fc-af68-1e5450eeb998 tempest-GroupSnapshotsTest-2129977062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-cca8c9b4-7289-47df-8435-3c5fa2fdf75a.info" returned: 0 in 0.526s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:43 devstack cinder-volume[83345]: WARNING cinder.volume.drivers.remotefs [None req-474d33ce-7a09-45fc-af68-1e5450eeb998 tempest-GroupSnapshotsTest-2129977062 None] /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-cca8c9b4-7289-47df-8435-3c5fa2fdf75a.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 10 13:13:43 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-474d33ce-7a09-45fc-af68-1e5450eeb998 tempest-GroupSnapshotsTest-2129977062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-cca8c9b4-7289-47df-8435-3c5fa2fdf75a.info {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:43 devstack sudo[86603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-cca8c9b4-7289-47df-8435-3c5fa2fdf75a.info
Apr 10 13:13:43 devstack sudo[86603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:43 devstack sudo[86603]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:43 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-474d33ce-7a09-45fc-af68-1e5450eeb998 tempest-GroupSnapshotsTest-2129977062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-cca8c9b4-7289-47df-8435-3c5fa2fdf75a.info" returned: 0 in 0.466s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:43 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-474d33ce-7a09-45fc-af68-1e5450eeb998 tempest-GroupSnapshotsTest-2129977062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.722s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:13:43 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-474d33ce-7a09-45fc-af68-1e5450eeb998 tempest-GroupSnapshotsTest-2129977062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:13:43 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-474d33ce-7a09-45fc-af68-1e5450eeb998 tempest-GroupSnapshotsTest-2129977062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:13:43 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-474d33ce-7a09-45fc-af68-1e5450eeb998 tempest-GroupSnapshotsTest-2129977062 None] Creating offline snapshot ebd517d6-b342-40e9-9b32-5722ab55180b of volume b2a4c2ae-704d-4b49-81aa-413280bfccdd {{(pid=83345) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 10 13:13:43 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9d3b6f9-98ec-4ab4-90c9-90c17c69ef71]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:13:43 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-474d33ce-7a09-45fc-af68-1e5450eeb998 tempest-GroupSnapshotsTest-2129977062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b2a4c2ae-704d-4b49-81aa-413280bfccdd {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:43 devstack sudo[86606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b2a4c2ae-704d-4b49-81aa-413280bfccdd
Apr 10 13:13:43 devstack sudo[86606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:44 devstack sudo[86606]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:44 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-474d33ce-7a09-45fc-af68-1e5450eeb998 tempest-GroupSnapshotsTest-2129977062 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b2a4c2ae-704d-4b49-81aa-413280bfccdd" returned: 0 in 0.538s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:44 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-474d33ce-7a09-45fc-af68-1e5450eeb998 tempest-GroupSnapshotsTest-2129977062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b2a4c2ae-704d-4b49-81aa-413280bfccdd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b2a4c2ae-704d-4b49-81aa-413280bfccdd.ebd517d6-b342-40e9-9b32-5722ab55180b 1G {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:44 devstack sudo[86611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b2a4c2ae-704d-4b49-81aa-413280bfccdd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b2a4c2ae-704d-4b49-81aa-413280bfccdd.ebd517d6-b342-40e9-9b32-5722ab55180b 1G
Apr 10 13:13:44 devstack sudo[86611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:44 devstack sudo[86611]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:44 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-474d33ce-7a09-45fc-af68-1e5450eeb998 tempest-GroupSnapshotsTest-2129977062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b2a4c2ae-704d-4b49-81aa-413280bfccdd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b2a4c2ae-704d-4b49-81aa-413280bfccdd.ebd517d6-b342-40e9-9b32-5722ab55180b 1G" returned: 0 in 0.503s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:44 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-474d33ce-7a09-45fc-af68-1e5450eeb998 tempest-GroupSnapshotsTest-2129977062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2a4c2ae-704d-4b49-81aa-413280bfccdd -F qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b2a4c2ae-704d-4b49-81aa-413280bfccdd.ebd517d6-b342-40e9-9b32-5722ab55180b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:44 devstack sudo[86616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2a4c2ae-704d-4b49-81aa-413280bfccdd -F qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b2a4c2ae-704d-4b49-81aa-413280bfccdd.ebd517d6-b342-40e9-9b32-5722ab55180b
Apr 10 13:13:44 devstack sudo[86616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:45 devstack sudo[86616]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:45 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-474d33ce-7a09-45fc-af68-1e5450eeb998 tempest-GroupSnapshotsTest-2129977062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2a4c2ae-704d-4b49-81aa-413280bfccdd -F qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b2a4c2ae-704d-4b49-81aa-413280bfccdd.ebd517d6-b342-40e9-9b32-5722ab55180b" returned: 0 in 0.461s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:45 devstack cinder-volume[83345]: WARNING cinder.volume.drivers.remotefs [None req-474d33ce-7a09-45fc-af68-1e5450eeb998 tempest-GroupSnapshotsTest-2129977062 None] /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b2a4c2ae-704d-4b49-81aa-413280bfccdd.ebd517d6-b342-40e9-9b32-5722ab55180b is being set with open permissions: ugo+rw: NotImplementedError
Apr 10 13:13:45 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-474d33ce-7a09-45fc-af68-1e5450eeb998 tempest-GroupSnapshotsTest-2129977062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b2a4c2ae-704d-4b49-81aa-413280bfccdd.ebd517d6-b342-40e9-9b32-5722ab55180b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:45 devstack sudo[86621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b2a4c2ae-704d-4b49-81aa-413280bfccdd.ebd517d6-b342-40e9-9b32-5722ab55180b
Apr 10 13:13:45 devstack sudo[86621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:45 devstack sudo[86621]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:45 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-474d33ce-7a09-45fc-af68-1e5450eeb998 tempest-GroupSnapshotsTest-2129977062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b2a4c2ae-704d-4b49-81aa-413280bfccdd.ebd517d6-b342-40e9-9b32-5722ab55180b" returned: 0 in 0.478s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:45 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-474d33ce-7a09-45fc-af68-1e5450eeb998 tempest-GroupSnapshotsTest-2129977062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b2a4c2ae-704d-4b49-81aa-413280bfccdd.info {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:45 devstack sudo[86624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b2a4c2ae-704d-4b49-81aa-413280bfccdd.info
Apr 10 13:13:45 devstack sudo[86624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:46 devstack sudo[86624]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:46 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-474d33ce-7a09-45fc-af68-1e5450eeb998 tempest-GroupSnapshotsTest-2129977062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b2a4c2ae-704d-4b49-81aa-413280bfccdd.info" returned: 0 in 0.431s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:46 devstack cinder-volume[83345]: WARNING cinder.volume.drivers.remotefs [None req-474d33ce-7a09-45fc-af68-1e5450eeb998 tempest-GroupSnapshotsTest-2129977062 None] /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b2a4c2ae-704d-4b49-81aa-413280bfccdd.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 10 13:13:46 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-474d33ce-7a09-45fc-af68-1e5450eeb998 tempest-GroupSnapshotsTest-2129977062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b2a4c2ae-704d-4b49-81aa-413280bfccdd.info {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:46 devstack sudo[86627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b2a4c2ae-704d-4b49-81aa-413280bfccdd.info
Apr 10 13:13:46 devstack sudo[86627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:46 devstack sudo[86627]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:46 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-474d33ce-7a09-45fc-af68-1e5450eeb998 tempest-GroupSnapshotsTest-2129977062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b2a4c2ae-704d-4b49-81aa-413280bfccdd.info" returned: 0 in 0.494s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:46 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-474d33ce-7a09-45fc-af68-1e5450eeb998 tempest-GroupSnapshotsTest-2129977062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.962s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:13:46 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-0afa5745-ede6-4e3c-83cc-ce49373b6d7d tempest-VolumesImageMetadata-1935899781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.879s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:13:46 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-0afa5745-ede6-4e3c-83cc-ce49373b6d7d tempest-VolumesImageMetadata-1935899781 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f252bf08b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:13:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-123063468',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee72b61a-a13f-4979-8ecb-245617004a20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e325166f9254c85b1745991693f93c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:13:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:13:41Z,use_quota=True,user_id='f7c86270f34640ad8d1b995d5a28496c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)}" {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 13:13:46 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-0afa5745-ede6-4e3c-83cc-ce49373b6d7d tempest-VolumesImageMetadata-1935899781 None] Creating volume ee72b61a-a13f-4979-8ecb-245617004a20 {{(pid=83345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 13:13:46 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-0afa5745-ede6-4e3c-83cc-ce49373b6d7d tempest-VolumesImageMetadata-1935899781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:13:46 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-0afa5745-ede6-4e3c-83cc-ce49373b6d7d tempest-VolumesImageMetadata-1935899781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:13:46 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-0afa5745-ede6-4e3c-83cc-ce49373b6d7d tempest-VolumesImageMetadata-1935899781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:13:46 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-0afa5745-ede6-4e3c-83cc-ce49373b6d7d tempest-VolumesImageMetadata-1935899781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:13:46 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-0afa5745-ede6-4e3c-83cc-ce49373b6d7d tempest-VolumesImageMetadata-1935899781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:13:46 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-0afa5745-ede6-4e3c-83cc-ce49373b6d7d tempest-VolumesImageMetadata-1935899781 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:13:46 devstack cinder-volume[83345]: INFO cinder.volume.drivers.remotefs [None req-0afa5745-ede6-4e3c-83cc-ce49373b6d7d tempest-VolumesImageMetadata-1935899781 None] casted to osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331
Apr 10 13:13:46 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-0afa5745-ede6-4e3c-83cc-ce49373b6d7d tempest-VolumesImageMetadata-1935899781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-ee72b61a-a13f-4979-8ecb-245617004a20 1073741824 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:46 devstack sudo[86632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-ee72b61a-a13f-4979-8ecb-245617004a20 1073741824
Apr 10 13:13:46 devstack sudo[86632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:46 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-474d33ce-7a09-45fc-af68-1e5450eeb998 tempest-GroupSnapshotsTest-2129977062 None] group_snapshot afeb2fa2-ea6f-4e02-8890-c9ab50c62009: created successfully
Apr 10 13:13:47 devstack sudo[86632]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:47 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-0afa5745-ede6-4e3c-83cc-ce49373b6d7d tempest-VolumesImageMetadata-1935899781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-ee72b61a-a13f-4979-8ecb-245617004a20 1073741824" returned: 0 in 0.594s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:47 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-0afa5745-ede6-4e3c-83cc-ce49373b6d7d tempest-VolumesImageMetadata-1935899781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-ee72b61a-a13f-4979-8ecb-245617004a20 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:47 devstack sudo[86640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-ee72b61a-a13f-4979-8ecb-245617004a20
Apr 10 13:13:47 devstack sudo[86640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:47 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-5beee2b1-4a91-426f-a9e2-3ad2ead46c6e tempest-GroupSnapshotsTest-2129977062 None] group_snapshot afeb2fa2-ea6f-4e02-8890-c9ab50c62009: deleting
Apr 10 13:13:47 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-5beee2b1-4a91-426f-a9e2-3ad2ead46c6e tempest-GroupSnapshotsTest-2129977062 None] group_snapshot afeb2fa2-ea6f-4e02-8890-c9ab50c62009: deleting {{(pid=83345) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 10 13:13:47 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-5beee2b1-4a91-426f-a9e2-3ad2ead46c6e tempest-GroupSnapshotsTest-2129977062 None] Acquiring lock "cinder-quobyte-cca8c9b4-7289-47df-8435-3c5fa2fdf75a" by "delete_snapshot" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:13:47 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-5beee2b1-4a91-426f-a9e2-3ad2ead46c6e tempest-GroupSnapshotsTest-2129977062 None] Lock "cinder-quobyte-cca8c9b4-7289-47df-8435-3c5fa2fdf75a" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:13:47 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-5beee2b1-4a91-426f-a9e2-3ad2ead46c6e tempest-GroupSnapshotsTest-2129977062 None] Acquiring lock "cinder-quobyte-01662fe9-aa6f-45ea-ba66-682f0764a599" by "_delete_snapshot" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:13:47 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-5beee2b1-4a91-426f-a9e2-3ad2ead46c6e tempest-GroupSnapshotsTest-2129977062 None] Lock "cinder-quobyte-01662fe9-aa6f-45ea-ba66-682f0764a599" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:13:47 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-5beee2b1-4a91-426f-a9e2-3ad2ead46c6e tempest-GroupSnapshotsTest-2129977062 None] Deleting offline snapshot 01662fe9-aa6f-45ea-ba66-682f0764a599 of volume cca8c9b4-7289-47df-8435-3c5fa2fdf75a {{(pid=83345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 10 13:13:47 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-5beee2b1-4a91-426f-a9e2-3ad2ead46c6e tempest-GroupSnapshotsTest-2129977062 None] snapshot_file for this snap is: volume-cca8c9b4-7289-47df-8435-3c5fa2fdf75a.01662fe9-aa6f-45ea-ba66-682f0764a599 {{(pid=83345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 10 13:13:47 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b73d2e6-c53a-4866-94e2-a84aa5a3aa96]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:13:47 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-5beee2b1-4a91-426f-a9e2-3ad2ead46c6e tempest-GroupSnapshotsTest-2129977062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-cca8c9b4-7289-47df-8435-3c5fa2fdf75a.01662fe9-aa6f-45ea-ba66-682f0764a599 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:47 devstack sudo[86643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-cca8c9b4-7289-47df-8435-3c5fa2fdf75a.01662fe9-aa6f-45ea-ba66-682f0764a599
Apr 10 13:13:47 devstack sudo[86643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:47 devstack sudo[86640]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:47 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-0afa5745-ede6-4e3c-83cc-ce49373b6d7d tempest-VolumesImageMetadata-1935899781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-ee72b61a-a13f-4979-8ecb-245617004a20" returned: 0 in 0.530s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:47 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-0afa5745-ede6-4e3c-83cc-ce49373b6d7d tempest-VolumesImageMetadata-1935899781 None] <== create_volume: return (1150ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'} {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 13:13:47 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-0afa5745-ede6-4e3c-83cc-ce49373b6d7d tempest-VolumesImageMetadata-1935899781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.153s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:13:47 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-03111884-1932-4aed-9f04-b6d09023681b tempest-VolumesListAdminTestJSON-1892539430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.324s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:13:47 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-03111884-1932-4aed-9f04-b6d09023681b tempest-VolumesListAdminTestJSON-1892539430 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f252bf08b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:13:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1195779327',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db0816ed-1457-4bc3-b8bf-5d7ae15836b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa9223f985014b97a7407a2b8f3f5568',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:13:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:13:42Z,use_quota=True,user_id='78ec1ed84a964c3d895a894a392dd8fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)}" {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 13:13:47 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-03111884-1932-4aed-9f04-b6d09023681b tempest-VolumesListAdminTestJSON-1892539430 None] Creating volume db0816ed-1457-4bc3-b8bf-5d7ae15836b7 {{(pid=83345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 13:13:47 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-03111884-1932-4aed-9f04-b6d09023681b tempest-VolumesListAdminTestJSON-1892539430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:13:47 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-03111884-1932-4aed-9f04-b6d09023681b tempest-VolumesListAdminTestJSON-1892539430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:13:47 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-03111884-1932-4aed-9f04-b6d09023681b tempest-VolumesListAdminTestJSON-1892539430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:13:47 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-03111884-1932-4aed-9f04-b6d09023681b tempest-VolumesListAdminTestJSON-1892539430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:13:47 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-03111884-1932-4aed-9f04-b6d09023681b tempest-VolumesListAdminTestJSON-1892539430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:13:47 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-03111884-1932-4aed-9f04-b6d09023681b tempest-VolumesListAdminTestJSON-1892539430 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:13:47 devstack cinder-volume[83345]: INFO cinder.volume.drivers.remotefs [None req-03111884-1932-4aed-9f04-b6d09023681b tempest-VolumesListAdminTestJSON-1892539430 None] casted to osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331
Apr 10 13:13:47 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-03111884-1932-4aed-9f04-b6d09023681b tempest-VolumesListAdminTestJSON-1892539430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-db0816ed-1457-4bc3-b8bf-5d7ae15836b7 1073741824 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:47 devstack cinder-volume[83345]: DEBUG cinder.volume.volume_utils [None req-0afa5745-ede6-4e3c-83cc-ce49373b6d7d tempest-VolumesImageMetadata-1935899781 None] Attempting download of dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5 ((None, [{'url': 'file:///opt/stack/data/glance/images/dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5', 'metadata': {}}])) to volume ee72b61a-a13f-4979-8ecb-245617004a20. {{(pid=83345) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 10 13:13:47 devstack sudo[86647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-db0816ed-1457-4bc3-b8bf-5d7ae15836b7 1073741824
Apr 10 13:13:47 devstack sudo[86647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:47 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[680fdbc7-a3b4-40bc-b872-6a02a055d4a8]: (4, 'raw') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:13:47 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-0afa5745-ede6-4e3c-83cc-ce49373b6d7d tempest-VolumesImageMetadata-1935899781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5_1k6umt7q {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:47 devstack sudo[86652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5_1k6umt7q
Apr 10 13:13:47 devstack sudo[86652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:48 devstack sudo[86643]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:48 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-5beee2b1-4a91-426f-a9e2-3ad2ead46c6e tempest-GroupSnapshotsTest-2129977062 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-cca8c9b4-7289-47df-8435-3c5fa2fdf75a.01662fe9-aa6f-45ea-ba66-682f0764a599" returned: 0 in 0.696s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:48 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-5beee2b1-4a91-426f-a9e2-3ad2ead46c6e tempest-GroupSnapshotsTest-2129977062 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cca8c9b4-7289-47df-8435-3c5fa2fdf75a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 13:13:48 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[4184c899-700c-4f7d-af0c-b06cf7283696]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:13:48 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-5beee2b1-4a91-426f-a9e2-3ad2ead46c6e tempest-GroupSnapshotsTest-2129977062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-cca8c9b4-7289-47df-8435-3c5fa2fdf75a {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:48 devstack sudo[86657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-cca8c9b4-7289-47df-8435-3c5fa2fdf75a
Apr 10 13:13:48 devstack sudo[86657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:48 devstack sudo[86647]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:48 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-03111884-1932-4aed-9f04-b6d09023681b tempest-VolumesListAdminTestJSON-1892539430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-db0816ed-1457-4bc3-b8bf-5d7ae15836b7 1073741824" returned: 0 in 0.606s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:48 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-03111884-1932-4aed-9f04-b6d09023681b tempest-VolumesListAdminTestJSON-1892539430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-db0816ed-1457-4bc3-b8bf-5d7ae15836b7 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:48 devstack sudo[86663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-db0816ed-1457-4bc3-b8bf-5d7ae15836b7
Apr 10 13:13:48 devstack sudo[86663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:48 devstack sudo[86652]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:48 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-0afa5745-ede6-4e3c-83cc-ce49373b6d7d tempest-VolumesImageMetadata-1935899781 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5_1k6umt7q" returned: 0 in 0.651s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:48 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-0afa5745-ede6-4e3c-83cc-ce49373b6d7d tempest-VolumesImageMetadata-1935899781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5_1k6umt7q {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:48 devstack sudo[86667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5_1k6umt7q
Apr 10 13:13:48 devstack sudo[86667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:48 devstack sudo[86657]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:48 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-5beee2b1-4a91-426f-a9e2-3ad2ead46c6e tempest-GroupSnapshotsTest-2129977062 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-cca8c9b4-7289-47df-8435-3c5fa2fdf75a" returned: 0 in 0.518s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:48 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-5beee2b1-4a91-426f-a9e2-3ad2ead46c6e tempest-GroupSnapshotsTest-2129977062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-cca8c9b4-7289-47df-8435-3c5fa2fdf75a.01662fe9-aa6f-45ea-ba66-682f0764a599 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:48 devstack sudo[86672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-cca8c9b4-7289-47df-8435-3c5fa2fdf75a.01662fe9-aa6f-45ea-ba66-682f0764a599
Apr 10 13:13:48 devstack sudo[86672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:48 devstack sudo[86663]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:48 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-03111884-1932-4aed-9f04-b6d09023681b tempest-VolumesListAdminTestJSON-1892539430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-db0816ed-1457-4bc3-b8bf-5d7ae15836b7" returned: 0 in 0.482s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:48 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-03111884-1932-4aed-9f04-b6d09023681b tempest-VolumesListAdminTestJSON-1892539430 None] <== create_volume: return (1114ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'} {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 13:13:48 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-03111884-1932-4aed-9f04-b6d09023681b tempest-VolumesListAdminTestJSON-1892539430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.118s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:13:48 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-03111884-1932-4aed-9f04-b6d09023681b tempest-VolumesListAdminTestJSON-1892539430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81b3467f-3b71-4eb2-b0b7-db4600f2ca8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db0816ed-1457-4bc3-b8bf-5d7ae15836b7', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:13:48 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-03111884-1932-4aed-9f04-b6d09023681b tempest-VolumesListAdminTestJSON-1892539430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ce4705e-8af3-44a0-85e1-c2e05ae0146d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:13:48 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-03111884-1932-4aed-9f04-b6d09023681b tempest-VolumesListAdminTestJSON-1892539430 None] Volume volume-db0816ed-1457-4bc3-b8bf-5d7ae15836b7 (db0816ed-1457-4bc3-b8bf-5d7ae15836b7): created successfully
Apr 10 13:13:48 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-03111884-1932-4aed-9f04-b6d09023681b tempest-VolumesListAdminTestJSON-1892539430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ce4705e-8af3-44a0-85e1-c2e05ae0146d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:13:48 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-03111884-1932-4aed-9f04-b6d09023681b tempest-VolumesListAdminTestJSON-1892539430 None] Flow 'volume_create_manager' (1af231e1-ae8f-4528-9ab9-918a6ef8bc7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:13:48 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-03111884-1932-4aed-9f04-b6d09023681b tempest-VolumesListAdminTestJSON-1892539430 None] Created volume successfully.
Apr 10 13:13:49 devstack sudo[86667]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:49 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-0afa5745-ede6-4e3c-83cc-ce49373b6d7d tempest-VolumesImageMetadata-1935899781 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5_1k6umt7q" returned: 1 in 0.538s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:49 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-0afa5745-ede6-4e3c-83cc-ce49373b6d7d tempest-VolumesImageMetadata-1935899781 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5_1k6umt7q' failed. Not Retrying. {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 10 13:13:49 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bc56e7e-4469-4bbb-bbda-bcbdea050078]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:13:49 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-0afa5745-ede6-4e3c-83cc-ce49373b6d7d tempest-VolumesImageMetadata-1935899781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5_0lw9vlgudevstack@QuobyteHD {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:49 devstack sudo[86679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5_0lw9vlgudevstack@QuobyteHD
Apr 10 13:13:49 devstack sudo[86679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:49 devstack sudo[86672]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:49 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-5beee2b1-4a91-426f-a9e2-3ad2ead46c6e tempest-GroupSnapshotsTest-2129977062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-cca8c9b4-7289-47df-8435-3c5fa2fdf75a.01662fe9-aa6f-45ea-ba66-682f0764a599" returned: 0 in 0.571s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:49 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-5beee2b1-4a91-426f-a9e2-3ad2ead46c6e tempest-GroupSnapshotsTest-2129977062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-cca8c9b4-7289-47df-8435-3c5fa2fdf75a.01662fe9-aa6f-45ea-ba66-682f0764a599 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:49 devstack sudo[86682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-cca8c9b4-7289-47df-8435-3c5fa2fdf75a.01662fe9-aa6f-45ea-ba66-682f0764a599
Apr 10 13:13:49 devstack sudo[86682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:49 devstack sudo[86679]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:49 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-0afa5745-ede6-4e3c-83cc-ce49373b6d7d tempest-VolumesImageMetadata-1935899781 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5_0lw9vlgudevstack@QuobyteHD" returned: 0 in 0.489s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:49 devstack cinder-volume[83345]: DEBUG cinder.image.image_utils [None req-0afa5745-ede6-4e3c-83cc-ce49373b6d7d tempest-VolumesImageMetadata-1935899781 None] dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5 was qcow2, converting to raw {{(pid=83345) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 10 13:13:49 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-0afa5745-ede6-4e3c-83cc-ce49373b6d7d tempest-VolumesImageMetadata-1935899781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5_0lw9vlgudevstack@QuobyteHD /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-ee72b61a-a13f-4979-8ecb-245617004a20 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:49 devstack sudo[86688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5_0lw9vlgudevstack@QuobyteHD /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-ee72b61a-a13f-4979-8ecb-245617004a20
Apr 10 13:13:49 devstack sudo[86688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:49 devstack sudo[86682]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:49 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-5beee2b1-4a91-426f-a9e2-3ad2ead46c6e tempest-GroupSnapshotsTest-2129977062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-cca8c9b4-7289-47df-8435-3c5fa2fdf75a.01662fe9-aa6f-45ea-ba66-682f0764a599" returned: 0 in 0.415s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:49 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-5beee2b1-4a91-426f-a9e2-3ad2ead46c6e tempest-GroupSnapshotsTest-2129977062 None] Lock "cinder-quobyte-01662fe9-aa6f-45ea-ba66-682f0764a599" released by "_delete_snapshot" :: held 2.253s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:13:49 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-5beee2b1-4a91-426f-a9e2-3ad2ead46c6e tempest-GroupSnapshotsTest-2129977062 None] Lock "cinder-quobyte-cca8c9b4-7289-47df-8435-3c5fa2fdf75a" released by "delete_snapshot" :: held 2.270s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:13:49 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-5beee2b1-4a91-426f-a9e2-3ad2ead46c6e tempest-GroupSnapshotsTest-2129977062 None] Acquiring lock "cinder-quobyte-b2a4c2ae-704d-4b49-81aa-413280bfccdd" by "delete_snapshot" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:13:49 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-5beee2b1-4a91-426f-a9e2-3ad2ead46c6e tempest-GroupSnapshotsTest-2129977062 None] Lock "cinder-quobyte-b2a4c2ae-704d-4b49-81aa-413280bfccdd" acquired by "delete_snapshot" :: waited 0.006s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:13:49 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-5beee2b1-4a91-426f-a9e2-3ad2ead46c6e tempest-GroupSnapshotsTest-2129977062 None] Acquiring lock "cinder-quobyte-ebd517d6-b342-40e9-9b32-5722ab55180b" by "_delete_snapshot" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:13:49 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-5beee2b1-4a91-426f-a9e2-3ad2ead46c6e tempest-GroupSnapshotsTest-2129977062 None] Lock "cinder-quobyte-ebd517d6-b342-40e9-9b32-5722ab55180b" acquired by "_delete_snapshot" :: waited 0.005s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:13:49 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-5beee2b1-4a91-426f-a9e2-3ad2ead46c6e tempest-GroupSnapshotsTest-2129977062 None] Deleting offline snapshot ebd517d6-b342-40e9-9b32-5722ab55180b of volume b2a4c2ae-704d-4b49-81aa-413280bfccdd {{(pid=83345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 10 13:13:49 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-5beee2b1-4a91-426f-a9e2-3ad2ead46c6e tempest-GroupSnapshotsTest-2129977062 None] snapshot_file for this snap is: volume-b2a4c2ae-704d-4b49-81aa-413280bfccdd.ebd517d6-b342-40e9-9b32-5722ab55180b {{(pid=83345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 10 13:13:49 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[1054fb37-b795-47a0-a180-7c31e65a91e2]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:13:49 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-5beee2b1-4a91-426f-a9e2-3ad2ead46c6e tempest-GroupSnapshotsTest-2129977062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b2a4c2ae-704d-4b49-81aa-413280bfccdd.ebd517d6-b342-40e9-9b32-5722ab55180b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:49 devstack sudo[86690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b2a4c2ae-704d-4b49-81aa-413280bfccdd.ebd517d6-b342-40e9-9b32-5722ab55180b
Apr 10 13:13:49 devstack sudo[86690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:50 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-422e738f-9e1c-4257-8ede-9d7257e154a8 tempest-VolumesListAdminTestJSON-1892539430 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:13:50 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-422e738f-9e1c-4257-8ede-9d7257e154a8 tempest-VolumesListAdminTestJSON-1892539430 None] Flow 'volume_create_manager' (c6d6c097-0124-4710-bb0d-295775ac7f75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:13:50 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-422e738f-9e1c-4257-8ede-9d7257e154a8 tempest-VolumesListAdminTestJSON-1892539430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e649e558-f366-47f5-aa21-f476450befc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:13:50 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-422e738f-9e1c-4257-8ede-9d7257e154a8 tempest-VolumesListAdminTestJSON-1892539430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e649e558-f366-47f5-aa21-f476450befc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:13:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-256595006',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b18312d3-67b5-4e69-899a-6b80644373fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa9223f985014b97a7407a2b8f3f5568',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:13:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:13:50Z,use_quota=True,user_id='78ec1ed84a964c3d895a894a392dd8fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:13:50 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-422e738f-9e1c-4257-8ede-9d7257e154a8 tempest-VolumesListAdminTestJSON-1892539430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5938939c-6a6b-401e-9ec5-abf3d2c2b5ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:13:50 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-422e738f-9e1c-4257-8ede-9d7257e154a8 tempest-VolumesListAdminTestJSON-1892539430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5938939c-6a6b-401e-9ec5-abf3d2c2b5ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:13:50 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-422e738f-9e1c-4257-8ede-9d7257e154a8 tempest-VolumesListAdminTestJSON-1892539430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a661bc7a-9b63-4e75-b695-b2517c23e7e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:13:50 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-422e738f-9e1c-4257-8ede-9d7257e154a8 tempest-VolumesListAdminTestJSON-1892539430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a661bc7a-9b63-4e75-b695-b2517c23e7e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b18312d3-67b5-4e69-899a-6b80644373fa', 'volume_name': 'volume-b18312d3-67b5-4e69-899a-6b80644373fa', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:13:50 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-422e738f-9e1c-4257-8ede-9d7257e154a8 tempest-VolumesListAdminTestJSON-1892539430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05d6266b-eaa9-4cd9-91eb-b988b77017a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:13:50 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-422e738f-9e1c-4257-8ede-9d7257e154a8 tempest-VolumesListAdminTestJSON-1892539430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05d6266b-eaa9-4cd9-91eb-b988b77017a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:13:50 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-422e738f-9e1c-4257-8ede-9d7257e154a8 tempest-VolumesListAdminTestJSON-1892539430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (332ed5e9-3fa1-4dce-91c0-b14b1d3e544b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:13:50 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-422e738f-9e1c-4257-8ede-9d7257e154a8 tempest-VolumesListAdminTestJSON-1892539430 None] Volume b18312d3-67b5-4e69-899a-6b80644373fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b18312d3-67b5-4e69-899a-6b80644373fa', 'volume_size': 1}
Apr 10 13:13:50 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-422e738f-9e1c-4257-8ede-9d7257e154a8 tempest-VolumesListAdminTestJSON-1892539430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:13:50 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-422e738f-9e1c-4257-8ede-9d7257e154a8 tempest-VolumesListAdminTestJSON-1892539430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:13:50 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-422e738f-9e1c-4257-8ede-9d7257e154a8 tempest-VolumesListAdminTestJSON-1892539430 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f252bf08b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:13:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-256595006',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b18312d3-67b5-4e69-899a-6b80644373fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa9223f985014b97a7407a2b8f3f5568',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:13:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:13:50Z,use_quota=True,user_id='78ec1ed84a964c3d895a894a392dd8fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)}" {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 13:13:50 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-422e738f-9e1c-4257-8ede-9d7257e154a8 tempest-VolumesListAdminTestJSON-1892539430 None] Creating volume b18312d3-67b5-4e69-899a-6b80644373fa {{(pid=83345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 13:13:50 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-422e738f-9e1c-4257-8ede-9d7257e154a8 tempest-VolumesListAdminTestJSON-1892539430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:13:50 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-422e738f-9e1c-4257-8ede-9d7257e154a8 tempest-VolumesListAdminTestJSON-1892539430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:13:50 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-422e738f-9e1c-4257-8ede-9d7257e154a8 tempest-VolumesListAdminTestJSON-1892539430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:13:50 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-422e738f-9e1c-4257-8ede-9d7257e154a8 tempest-VolumesListAdminTestJSON-1892539430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:13:50 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-422e738f-9e1c-4257-8ede-9d7257e154a8 tempest-VolumesListAdminTestJSON-1892539430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:13:50 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-422e738f-9e1c-4257-8ede-9d7257e154a8 tempest-VolumesListAdminTestJSON-1892539430 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:13:50 devstack cinder-volume[83345]: INFO cinder.volume.drivers.remotefs [None req-422e738f-9e1c-4257-8ede-9d7257e154a8 tempest-VolumesListAdminTestJSON-1892539430 None] casted to osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331
Apr 10 13:13:50 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-422e738f-9e1c-4257-8ede-9d7257e154a8 tempest-VolumesListAdminTestJSON-1892539430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b18312d3-67b5-4e69-899a-6b80644373fa 1073741824 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:50 devstack sudo[86708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b18312d3-67b5-4e69-899a-6b80644373fa 1073741824
Apr 10 13:13:50 devstack sudo[86708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:50 devstack sudo[86690]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:50 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-5beee2b1-4a91-426f-a9e2-3ad2ead46c6e tempest-GroupSnapshotsTest-2129977062 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b2a4c2ae-704d-4b49-81aa-413280bfccdd.ebd517d6-b342-40e9-9b32-5722ab55180b" returned: 0 in 0.643s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:50 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-5beee2b1-4a91-426f-a9e2-3ad2ead46c6e tempest-GroupSnapshotsTest-2129977062 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b2a4c2ae-704d-4b49-81aa-413280bfccdd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 13:13:50 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[62ffd6b1-3ebd-4627-b9f1-9639091736f5]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:13:50 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-5beee2b1-4a91-426f-a9e2-3ad2ead46c6e tempest-GroupSnapshotsTest-2129977062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b2a4c2ae-704d-4b49-81aa-413280bfccdd {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:50 devstack sudo[86713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b2a4c2ae-704d-4b49-81aa-413280bfccdd
Apr 10 13:13:50 devstack sudo[86713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:50 devstack sudo[86688]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:50 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-0afa5745-ede6-4e3c-83cc-ce49373b6d7d tempest-VolumesImageMetadata-1935899781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5_0lw9vlgudevstack@QuobyteHD /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-ee72b61a-a13f-4979-8ecb-245617004a20" returned: 0 in 1.104s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:50 devstack cinder-volume[83345]: DEBUG cinder.image.image_utils [None req-0afa5745-ede6-4e3c-83cc-ce49373b6d7d tempest-VolumesImageMetadata-1935899781 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5_0lw9vlgudevstack@QuobyteHD, size 112.00 MB, duration 1.11 sec, destination /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-ee72b61a-a13f-4979-8ecb-245617004a20 {{(pid=83345) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 10 13:13:50 devstack cinder-volume[83345]: INFO cinder.image.image_utils [None req-0afa5745-ede6-4e3c-83cc-ce49373b6d7d tempest-VolumesImageMetadata-1935899781 None] Converted 112.00 MB image at 101.33 MB/s
Apr 10 13:13:50 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-0afa5745-ede6-4e3c-83cc-ce49373b6d7d tempest-VolumesImageMetadata-1935899781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-ee72b61a-a13f-4979-8ecb-245617004a20 1G {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:50 devstack sudo[86718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-ee72b61a-a13f-4979-8ecb-245617004a20 1G
Apr 10 13:13:50 devstack sudo[86718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:50 devstack sudo[86708]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:50 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-422e738f-9e1c-4257-8ede-9d7257e154a8 tempest-VolumesListAdminTestJSON-1892539430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b18312d3-67b5-4e69-899a-6b80644373fa 1073741824" returned: 0 in 0.650s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:50 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-422e738f-9e1c-4257-8ede-9d7257e154a8 tempest-VolumesListAdminTestJSON-1892539430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b18312d3-67b5-4e69-899a-6b80644373fa {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:50 devstack sudo[86720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b18312d3-67b5-4e69-899a-6b80644373fa
Apr 10 13:13:50 devstack sudo[86720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:50 devstack sudo[86713]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:50 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-5beee2b1-4a91-426f-a9e2-3ad2ead46c6e tempest-GroupSnapshotsTest-2129977062 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b2a4c2ae-704d-4b49-81aa-413280bfccdd" returned: 0 in 0.546s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:50 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-5beee2b1-4a91-426f-a9e2-3ad2ead46c6e tempest-GroupSnapshotsTest-2129977062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b2a4c2ae-704d-4b49-81aa-413280bfccdd.ebd517d6-b342-40e9-9b32-5722ab55180b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:50 devstack sudo[86725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b2a4c2ae-704d-4b49-81aa-413280bfccdd.ebd517d6-b342-40e9-9b32-5722ab55180b
Apr 10 13:13:50 devstack sudo[86725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:51 devstack sudo[86718]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:51 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-0afa5745-ede6-4e3c-83cc-ce49373b6d7d tempest-VolumesImageMetadata-1935899781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-ee72b61a-a13f-4979-8ecb-245617004a20 1G" returned: 0 in 0.548s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:51 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[a294258c-b486-4981-bfe8-7d82a95a8a29]: (4, 'raw') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:13:51 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-0afa5745-ede6-4e3c-83cc-ce49373b6d7d tempest-VolumesImageMetadata-1935899781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-ee72b61a-a13f-4979-8ecb-245617004a20 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:51 devstack sudo[86731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-ee72b61a-a13f-4979-8ecb-245617004a20
Apr 10 13:13:51 devstack sudo[86731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:51 devstack sudo[86720]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:51 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-422e738f-9e1c-4257-8ede-9d7257e154a8 tempest-VolumesListAdminTestJSON-1892539430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b18312d3-67b5-4e69-899a-6b80644373fa" returned: 0 in 0.592s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:51 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-422e738f-9e1c-4257-8ede-9d7257e154a8 tempest-VolumesListAdminTestJSON-1892539430 None] <== create_volume: return (1267ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'} {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 13:13:51 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-422e738f-9e1c-4257-8ede-9d7257e154a8 tempest-VolumesListAdminTestJSON-1892539430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.269s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:13:51 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-422e738f-9e1c-4257-8ede-9d7257e154a8 tempest-VolumesListAdminTestJSON-1892539430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (332ed5e9-3fa1-4dce-91c0-b14b1d3e544b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b18312d3-67b5-4e69-899a-6b80644373fa', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:13:51 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-422e738f-9e1c-4257-8ede-9d7257e154a8 tempest-VolumesListAdminTestJSON-1892539430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46fc3174-9f25-4553-9f16-75c86e34b7ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:13:51 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-422e738f-9e1c-4257-8ede-9d7257e154a8 tempest-VolumesListAdminTestJSON-1892539430 None] Volume volume-b18312d3-67b5-4e69-899a-6b80644373fa (b18312d3-67b5-4e69-899a-6b80644373fa): created successfully
Apr 10 13:13:51 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-422e738f-9e1c-4257-8ede-9d7257e154a8 tempest-VolumesListAdminTestJSON-1892539430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46fc3174-9f25-4553-9f16-75c86e34b7ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:13:51 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-422e738f-9e1c-4257-8ede-9d7257e154a8 tempest-VolumesListAdminTestJSON-1892539430 None] Flow 'volume_create_manager' (c6d6c097-0124-4710-bb0d-295775ac7f75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:13:51 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-422e738f-9e1c-4257-8ede-9d7257e154a8 tempest-VolumesListAdminTestJSON-1892539430 None] Created volume successfully.
Apr 10 13:13:51 devstack sudo[86725]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:51 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-5beee2b1-4a91-426f-a9e2-3ad2ead46c6e tempest-GroupSnapshotsTest-2129977062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b2a4c2ae-704d-4b49-81aa-413280bfccdd.ebd517d6-b342-40e9-9b32-5722ab55180b" returned: 0 in 0.570s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:51 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-5beee2b1-4a91-426f-a9e2-3ad2ead46c6e tempest-GroupSnapshotsTest-2129977062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b2a4c2ae-704d-4b49-81aa-413280bfccdd.ebd517d6-b342-40e9-9b32-5722ab55180b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:51 devstack sudo[86738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b2a4c2ae-704d-4b49-81aa-413280bfccdd.ebd517d6-b342-40e9-9b32-5722ab55180b
Apr 10 13:13:51 devstack sudo[86738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:51 devstack sudo[86731]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:51 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-0afa5745-ede6-4e3c-83cc-ce49373b6d7d tempest-VolumesImageMetadata-1935899781 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-ee72b61a-a13f-4979-8ecb-245617004a20" returned: 0 in 0.522s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:51 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-0afa5745-ede6-4e3c-83cc-ce49373b6d7d tempest-VolumesImageMetadata-1935899781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-ee72b61a-a13f-4979-8ecb-245617004a20 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:51 devstack sudo[86742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-ee72b61a-a13f-4979-8ecb-245617004a20
Apr 10 13:13:51 devstack sudo[86742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:51 devstack sudo[86738]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:51 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-5beee2b1-4a91-426f-a9e2-3ad2ead46c6e tempest-GroupSnapshotsTest-2129977062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b2a4c2ae-704d-4b49-81aa-413280bfccdd.ebd517d6-b342-40e9-9b32-5722ab55180b" returned: 0 in 0.465s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:51 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-5beee2b1-4a91-426f-a9e2-3ad2ead46c6e tempest-GroupSnapshotsTest-2129977062 None] Lock "cinder-quobyte-ebd517d6-b342-40e9-9b32-5722ab55180b" released by "_delete_snapshot" :: held 2.284s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:13:51 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-5beee2b1-4a91-426f-a9e2-3ad2ead46c6e tempest-GroupSnapshotsTest-2129977062 None] Lock "cinder-quobyte-b2a4c2ae-704d-4b49-81aa-413280bfccdd" released by "delete_snapshot" :: held 2.294s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:13:52 devstack cinder-volume[83345]: WARNING cinder.quota [None req-5beee2b1-4a91-426f-a9e2-3ad2ead46c6e tempest-GroupSnapshotsTest-2129977062 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-758559047 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-758559047, it is now deprecated. Please use the default quota class for default quota.
Apr 10 13:13:52 devstack cinder-volume[83345]: WARNING cinder.quota [None req-5beee2b1-4a91-426f-a9e2-3ad2ead46c6e tempest-GroupSnapshotsTest-2129977062 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-758559047 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-758559047, it is now deprecated. Please use the default quota class for default quota.
Apr 10 13:13:52 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-5beee2b1-4a91-426f-a9e2-3ad2ead46c6e tempest-GroupSnapshotsTest-2129977062 None] Created reservations ['6f8b7dd4-1634-405a-94bb-d2dd64e2e05d', 'c7df7ef4-9cae-4c72-9227-caefafc38ab0', 'ae91e8c0-7ef3-4375-a556-47d2715df77f', '074e6abb-968b-448f-a219-4413bb19ac5e'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:13:52 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-5beee2b1-4a91-426f-a9e2-3ad2ead46c6e tempest-GroupSnapshotsTest-2129977062 None] Created reservations ['255d8c5e-51fe-44cf-b631-78a3383b18cf', '6bc6e648-0798-4e29-9aa6-3b5f8480253b', 'ebc1e179-8a42-4eed-99be-1f9f1ce9b8c2', 'b7167179-f2f5-4702-8045-cc29c20d442a'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:13:52 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-5beee2b1-4a91-426f-a9e2-3ad2ead46c6e tempest-GroupSnapshotsTest-2129977062 None] group_snapshot afeb2fa2-ea6f-4e02-8890-c9ab50c62009: deleted successfully
Apr 10 13:13:52 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-0afa5745-ede6-4e3c-83cc-ce49373b6d7d tempest-VolumesImageMetadata-1935899781 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-ee72b61a-a13f-4979-8ecb-245617004a20" returned: 1 in 0.601s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:52 devstack sudo[86742]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:52 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-0afa5745-ede6-4e3c-83cc-ce49373b6d7d tempest-VolumesImageMetadata-1935899781 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-ee72b61a-a13f-4979-8ecb-245617004a20' failed. Not Retrying. {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 10 13:13:52 devstack cinder-volume[83345]: DEBUG cinder.volume.volume_utils [None req-0afa5745-ede6-4e3c-83cc-ce49373b6d7d tempest-VolumesImageMetadata-1935899781 None] Downloaded image dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5 ((None, [{'url': 'file:///opt/stack/data/glance/images/dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5', 'metadata': {}}])) to volume ee72b61a-a13f-4979-8ecb-245617004a20 successfully. {{(pid=83345) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 10 13:13:52 devstack cinder-volume[83345]: DEBUG cinder.image.image_utils [None req-0afa5745-ede6-4e3c-83cc-ce49373b6d7d tempest-VolumesImageMetadata-1935899781 None] Temporary image dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5 for user f7c86270f34640ad8d1b995d5a28496c is deleted. {{(pid=83345) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 10 13:13:52 devstack cinder-volume[83345]: DEBUG cinder.volume.volume_utils [None req-0afa5745-ede6-4e3c-83cc-ce49373b6d7d tempest-VolumesImageMetadata-1935899781 None] Marking volume ee72b61a-a13f-4979-8ecb-245617004a20 as bootable. {{(pid=83345) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 10 13:13:52 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-0afa5745-ede6-4e3c-83cc-ce49373b6d7d tempest-VolumesImageMetadata-1935899781 None] Copying metadata from image dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5 to ee72b61a-a13f-4979-8ecb-245617004a20. {{(pid=83345) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 10 13:13:52 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-0afa5745-ede6-4e3c-83cc-ce49373b6d7d tempest-VolumesImageMetadata-1935899781 None] Creating volume glance metadata for volume ee72b61a-a13f-4979-8ecb-245617004a20 backed by image dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83345) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 10 13:13:52 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-0afa5745-ede6-4e3c-83cc-ce49373b6d7d tempest-VolumesImageMetadata-1935899781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1223132-e1ff-46ae-9c3e-7925f521af3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee72b61a-a13f-4979-8ecb-245617004a20', 'volume_size': 1, 'image_id': 'dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8c498714b5e64042a43894acdb754f15', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5', 'created_at': datetime.datetime(2026, 4, 10, 11, 6, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 10, 11, 6, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f25211cffd0>}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:13:52 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-0afa5745-ede6-4e3c-83cc-ce49373b6d7d tempest-VolumesImageMetadata-1935899781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffde2fd0-1fb6-4a17-8f8e-d4611d2c126c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:13:52 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-0afa5745-ede6-4e3c-83cc-ce49373b6d7d tempest-VolumesImageMetadata-1935899781 None] Volume volume-ee72b61a-a13f-4979-8ecb-245617004a20 (ee72b61a-a13f-4979-8ecb-245617004a20): created successfully
Apr 10 13:13:52 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-0afa5745-ede6-4e3c-83cc-ce49373b6d7d tempest-VolumesImageMetadata-1935899781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffde2fd0-1fb6-4a17-8f8e-d4611d2c126c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:13:52 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-0afa5745-ede6-4e3c-83cc-ce49373b6d7d tempest-VolumesImageMetadata-1935899781 None] Flow 'volume_create_manager' (1039fd9e-5e67-4ef3-b17e-b342313f96b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:13:52 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-0afa5745-ede6-4e3c-83cc-ce49373b6d7d tempest-VolumesImageMetadata-1935899781 None] Created volume successfully.
Apr 10 13:13:52 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-49aae64a-89c1-4e2d-9d43-c77328ebc489 tempest-VolumesListAdminTestJSON-1892539430 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:13:52 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-49aae64a-89c1-4e2d-9d43-c77328ebc489 tempest-VolumesListAdminTestJSON-1892539430 None] Flow 'volume_create_manager' (9ffbaa19-88aa-4d4c-850d-8b96df7a1be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:13:52 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-49aae64a-89c1-4e2d-9d43-c77328ebc489 tempest-VolumesListAdminTestJSON-1892539430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (113e2acb-18d7-463f-8ee1-8e01eaca2456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:13:52 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-49aae64a-89c1-4e2d-9d43-c77328ebc489 tempest-VolumesListAdminTestJSON-1892539430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (113e2acb-18d7-463f-8ee1-8e01eaca2456) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:13:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1024158922',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a651b2a-caee-411b-a546-0c02b4e1986d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa9223f985014b97a7407a2b8f3f5568',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:13:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:13:53Z,use_quota=True,user_id='78ec1ed84a964c3d895a894a392dd8fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:13:52 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-49aae64a-89c1-4e2d-9d43-c77328ebc489 tempest-VolumesListAdminTestJSON-1892539430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fcd8592-d247-43d1-9bda-8c280b2bd3aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:13:52 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-49aae64a-89c1-4e2d-9d43-c77328ebc489 tempest-VolumesListAdminTestJSON-1892539430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fcd8592-d247-43d1-9bda-8c280b2bd3aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:13:52 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-49aae64a-89c1-4e2d-9d43-c77328ebc489 tempest-VolumesListAdminTestJSON-1892539430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2690db4d-d401-4067-abdc-dc959611d6d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:13:52 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-49aae64a-89c1-4e2d-9d43-c77328ebc489 tempest-VolumesListAdminTestJSON-1892539430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2690db4d-d401-4067-abdc-dc959611d6d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a651b2a-caee-411b-a546-0c02b4e1986d', 'volume_name': 'volume-8a651b2a-caee-411b-a546-0c02b4e1986d', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:13:52 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-49aae64a-89c1-4e2d-9d43-c77328ebc489 tempest-VolumesListAdminTestJSON-1892539430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2b8a714-9bb9-4938-ab71-52d7f52f91c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:13:52 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-49aae64a-89c1-4e2d-9d43-c77328ebc489 tempest-VolumesListAdminTestJSON-1892539430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2b8a714-9bb9-4938-ab71-52d7f52f91c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:13:52 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-49aae64a-89c1-4e2d-9d43-c77328ebc489 tempest-VolumesListAdminTestJSON-1892539430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d0a1f51-f75e-4b54-8468-ceeb36083567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:13:52 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-49aae64a-89c1-4e2d-9d43-c77328ebc489 tempest-VolumesListAdminTestJSON-1892539430 None] Volume 8a651b2a-caee-411b-a546-0c02b4e1986d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a651b2a-caee-411b-a546-0c02b4e1986d', 'volume_size': 1}
Apr 10 13:13:52 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-49aae64a-89c1-4e2d-9d43-c77328ebc489 tempest-VolumesListAdminTestJSON-1892539430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:13:52 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-49aae64a-89c1-4e2d-9d43-c77328ebc489 tempest-VolumesListAdminTestJSON-1892539430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:13:52 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-49aae64a-89c1-4e2d-9d43-c77328ebc489 tempest-VolumesListAdminTestJSON-1892539430 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f252bf08b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:13:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1024158922',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a651b2a-caee-411b-a546-0c02b4e1986d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa9223f985014b97a7407a2b8f3f5568',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:13:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:13:53Z,use_quota=True,user_id='78ec1ed84a964c3d895a894a392dd8fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)}" {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 13:13:52 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-49aae64a-89c1-4e2d-9d43-c77328ebc489 tempest-VolumesListAdminTestJSON-1892539430 None] Creating volume 8a651b2a-caee-411b-a546-0c02b4e1986d {{(pid=83345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 13:13:52 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-49aae64a-89c1-4e2d-9d43-c77328ebc489 tempest-VolumesListAdminTestJSON-1892539430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:13:52 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-49aae64a-89c1-4e2d-9d43-c77328ebc489 tempest-VolumesListAdminTestJSON-1892539430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:13:52 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-49aae64a-89c1-4e2d-9d43-c77328ebc489 tempest-VolumesListAdminTestJSON-1892539430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:13:52 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-49aae64a-89c1-4e2d-9d43-c77328ebc489 tempest-VolumesListAdminTestJSON-1892539430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:13:52 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-49aae64a-89c1-4e2d-9d43-c77328ebc489 tempest-VolumesListAdminTestJSON-1892539430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:13:52 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-49aae64a-89c1-4e2d-9d43-c77328ebc489 tempest-VolumesListAdminTestJSON-1892539430 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:13:52 devstack cinder-volume[83345]: INFO cinder.volume.drivers.remotefs [None req-49aae64a-89c1-4e2d-9d43-c77328ebc489 tempest-VolumesListAdminTestJSON-1892539430 None] casted to osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331
Apr 10 13:13:52 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-49aae64a-89c1-4e2d-9d43-c77328ebc489 tempest-VolumesListAdminTestJSON-1892539430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-8a651b2a-caee-411b-a546-0c02b4e1986d 1073741824 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:52 devstack sudo[86748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-8a651b2a-caee-411b-a546-0c02b4e1986d 1073741824
Apr 10 13:13:52 devstack sudo[86748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:52 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-2a166186-2586-4d37-b980-35d8095db667 tempest-GroupSnapshotsTest-2129977062 None] Acquiring lock "cinder-quobyte-b2a4c2ae-704d-4b49-81aa-413280bfccdd" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:13:52 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-2a166186-2586-4d37-b980-35d8095db667 tempest-GroupSnapshotsTest-2129977062 None] Lock "cinder-quobyte-b2a4c2ae-704d-4b49-81aa-413280bfccdd" acquired by "delete_volume" :: waited 0.011s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:13:52 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf6fb38d-204d-4fca-b607-9f39088ffdde]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:13:52 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-2a166186-2586-4d37-b980-35d8095db667 tempest-GroupSnapshotsTest-2129977062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b2a4c2ae-704d-4b49-81aa-413280bfccdd {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:53 devstack sudo[86750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b2a4c2ae-704d-4b49-81aa-413280bfccdd
Apr 10 13:13:53 devstack sudo[86750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:53 devstack sudo[86748]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:53 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-49aae64a-89c1-4e2d-9d43-c77328ebc489 tempest-VolumesListAdminTestJSON-1892539430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-8a651b2a-caee-411b-a546-0c02b4e1986d 1073741824" returned: 0 in 0.631s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:53 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-49aae64a-89c1-4e2d-9d43-c77328ebc489 tempest-VolumesListAdminTestJSON-1892539430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-8a651b2a-caee-411b-a546-0c02b4e1986d {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:53 devstack sudo[86757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-8a651b2a-caee-411b-a546-0c02b4e1986d
Apr 10 13:13:53 devstack sudo[86757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:53 devstack sudo[86750]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:53 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-2a166186-2586-4d37-b980-35d8095db667 tempest-GroupSnapshotsTest-2129977062 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b2a4c2ae-704d-4b49-81aa-413280bfccdd" returned: 0 in 0.565s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:53 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-2a166186-2586-4d37-b980-35d8095db667 tempest-GroupSnapshotsTest-2129977062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b2a4c2ae-704d-4b49-81aa-413280bfccdd {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:53 devstack cinder-volume[83345]: DEBUG oslo_service.periodic_task [None req-c3f44832-ad7f-424b-a850-32c7352a19c5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83345) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 10 13:13:53 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-c3f44832-ad7f-424b-a850-32c7352a19c5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:13:53 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-c3f44832-ad7f-424b-a850-32c7352a19c5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:13:53 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-c3f44832-ad7f-424b-a850-32c7352a19c5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:13:53 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-c3f44832-ad7f-424b-a850-32c7352a19c5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:13:53 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-c3f44832-ad7f-424b-a850-32c7352a19c5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:13:53 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-c3f44832-ad7f-424b-a850-32c7352a19c5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:53 devstack sudo[86763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b2a4c2ae-704d-4b49-81aa-413280bfccdd
Apr 10 13:13:53 devstack sudo[86763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:53 devstack sudo[86765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:13:53 devstack sudo[86765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:53 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-df88ef4a-0128-473a-b53b-8b28064a6ea4 tempest-VolumesImageMetadata-1935899781 None] Acquiring lock "cinder-ee72b61a-a13f-4979-8ecb-245617004a20-delete_volume" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:13:53 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-df88ef4a-0128-473a-b53b-8b28064a6ea4 tempest-VolumesImageMetadata-1935899781 None] Lock "cinder-ee72b61a-a13f-4979-8ecb-245617004a20-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:13:53 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-df88ef4a-0128-473a-b53b-8b28064a6ea4 tempest-VolumesImageMetadata-1935899781 None] Acquiring lock "cinder-quobyte-ee72b61a-a13f-4979-8ecb-245617004a20" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:13:53 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-df88ef4a-0128-473a-b53b-8b28064a6ea4 tempest-VolumesImageMetadata-1935899781 None] Lock "cinder-quobyte-ee72b61a-a13f-4979-8ecb-245617004a20" acquired by "delete_volume" :: waited 0.010s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:13:53 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7d18b58-e198-47ee-ab59-af30348f9c93]: (4, 'raw') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:13:53 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-df88ef4a-0128-473a-b53b-8b28064a6ea4 tempest-VolumesImageMetadata-1935899781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-ee72b61a-a13f-4979-8ecb-245617004a20 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:53 devstack sudo[86757]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:53 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-49aae64a-89c1-4e2d-9d43-c77328ebc489 tempest-VolumesListAdminTestJSON-1892539430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-8a651b2a-caee-411b-a546-0c02b4e1986d" returned: 0 in 0.694s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:53 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-49aae64a-89c1-4e2d-9d43-c77328ebc489 tempest-VolumesListAdminTestJSON-1892539430 None] <== create_volume: return (1360ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'} {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 13:13:53 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-49aae64a-89c1-4e2d-9d43-c77328ebc489 tempest-VolumesListAdminTestJSON-1892539430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.363s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:13:53 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-49aae64a-89c1-4e2d-9d43-c77328ebc489 tempest-VolumesListAdminTestJSON-1892539430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d0a1f51-f75e-4b54-8468-ceeb36083567) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a651b2a-caee-411b-a546-0c02b4e1986d', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:13:54 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-49aae64a-89c1-4e2d-9d43-c77328ebc489 tempest-VolumesListAdminTestJSON-1892539430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49f756e6-60bd-4c5c-93da-a7e3848c8106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:13:54 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-49aae64a-89c1-4e2d-9d43-c77328ebc489 tempest-VolumesListAdminTestJSON-1892539430 None] Volume volume-8a651b2a-caee-411b-a546-0c02b4e1986d (8a651b2a-caee-411b-a546-0c02b4e1986d): created successfully
Apr 10 13:13:54 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-49aae64a-89c1-4e2d-9d43-c77328ebc489 tempest-VolumesListAdminTestJSON-1892539430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49f756e6-60bd-4c5c-93da-a7e3848c8106) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:13:54 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-49aae64a-89c1-4e2d-9d43-c77328ebc489 tempest-VolumesListAdminTestJSON-1892539430 None] Flow 'volume_create_manager' (9ffbaa19-88aa-4d4c-850d-8b96df7a1be8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:13:54 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-49aae64a-89c1-4e2d-9d43-c77328ebc489 tempest-VolumesListAdminTestJSON-1892539430 None] Created volume successfully.
Apr 10 13:13:54 devstack sudo[86774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-ee72b61a-a13f-4979-8ecb-245617004a20
Apr 10 13:13:54 devstack sudo[86774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:54 devstack sudo[86763]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:54 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-2a166186-2586-4d37-b980-35d8095db667 tempest-GroupSnapshotsTest-2129977062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b2a4c2ae-704d-4b49-81aa-413280bfccdd" returned: 0 in 0.608s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:54 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-2a166186-2586-4d37-b980-35d8095db667 tempest-GroupSnapshotsTest-2129977062 None] Lock "cinder-quobyte-b2a4c2ae-704d-4b49-81aa-413280bfccdd" released by "delete_volume" :: held 1.207s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:13:54 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-2a166186-2586-4d37-b980-35d8095db667 tempest-GroupSnapshotsTest-2129977062 None] Acquiring lock "cinder-quobyte-cca8c9b4-7289-47df-8435-3c5fa2fdf75a" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:13:54 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-2a166186-2586-4d37-b980-35d8095db667 tempest-GroupSnapshotsTest-2129977062 None] Lock "cinder-quobyte-cca8c9b4-7289-47df-8435-3c5fa2fdf75a" acquired by "delete_volume" :: waited 0.007s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:13:54 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a19f9da-7dea-4671-ac46-b9b7a6bec73b]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:13:54 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-2a166186-2586-4d37-b980-35d8095db667 tempest-GroupSnapshotsTest-2129977062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-cca8c9b4-7289-47df-8435-3c5fa2fdf75a {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:54 devstack sudo[86784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-cca8c9b4-7289-47df-8435-3c5fa2fdf75a
Apr 10 13:13:54 devstack sudo[86784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:54 devstack sudo[86765]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:54 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-c3f44832-ad7f-424b-a850-32c7352a19c5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.825s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:54 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-c3f44832-ad7f-424b-a850-32c7352a19c5 None None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:13:54 devstack sudo[86774]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:54 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-df88ef4a-0128-473a-b53b-8b28064a6ea4 tempest-VolumesImageMetadata-1935899781 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-ee72b61a-a13f-4979-8ecb-245617004a20" returned: 0 in 0.709s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:54 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-df88ef4a-0128-473a-b53b-8b28064a6ea4 tempest-VolumesImageMetadata-1935899781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-ee72b61a-a13f-4979-8ecb-245617004a20 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:54 devstack sudo[86791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-ee72b61a-a13f-4979-8ecb-245617004a20
Apr 10 13:13:54 devstack sudo[86791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:54 devstack sudo[86784]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:54 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-2a166186-2586-4d37-b980-35d8095db667 tempest-GroupSnapshotsTest-2129977062 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-cca8c9b4-7289-47df-8435-3c5fa2fdf75a" returned: 0 in 0.712s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:54 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-2a166186-2586-4d37-b980-35d8095db667 tempest-GroupSnapshotsTest-2129977062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-cca8c9b4-7289-47df-8435-3c5fa2fdf75a {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:54 devstack sudo[86796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-cca8c9b4-7289-47df-8435-3c5fa2fdf75a
Apr 10 13:13:54 devstack sudo[86796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:55 devstack sudo[86791]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:55 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-df88ef4a-0128-473a-b53b-8b28064a6ea4 tempest-VolumesImageMetadata-1935899781 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-ee72b61a-a13f-4979-8ecb-245617004a20" returned: 1 in 0.741s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:55 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-df88ef4a-0128-473a-b53b-8b28064a6ea4 tempest-VolumesImageMetadata-1935899781 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-ee72b61a-a13f-4979-8ecb-245617004a20' failed. Not Retrying. {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 10 13:13:55 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-df88ef4a-0128-473a-b53b-8b28064a6ea4 tempest-VolumesImageMetadata-1935899781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-ee72b61a-a13f-4979-8ecb-245617004a20 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:55 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1e4a5a4-1a4a-4230-a3fe-7b2b77fec145 tempest-VolumesListAdminTestJSON-1225053259 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:13:55 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-b1e4a5a4-1a4a-4230-a3fe-7b2b77fec145 tempest-VolumesListAdminTestJSON-1225053259 None] Flow 'volume_create_manager' (086a88bb-9424-41e5-a4fb-7090feba5211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:13:55 devstack sudo[86801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-ee72b61a-a13f-4979-8ecb-245617004a20
Apr 10 13:13:55 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-b1e4a5a4-1a4a-4230-a3fe-7b2b77fec145 tempest-VolumesListAdminTestJSON-1225053259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5874d605-88e9-424e-8ac3-0c0cfaff9584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:13:55 devstack sudo[86801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:55 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-b1e4a5a4-1a4a-4230-a3fe-7b2b77fec145 tempest-VolumesListAdminTestJSON-1225053259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5874d605-88e9-424e-8ac3-0c0cfaff9584) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:13:55Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d277e805-9379-488f-bb46-a0f25d04a516,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af8adaee00184ff589863adabedbfe41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:13:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:13:55Z,use_quota=True,user_id='d8ea2618e3734b30a3dc1a0801e8d078',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:13:55 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-b1e4a5a4-1a4a-4230-a3fe-7b2b77fec145 tempest-VolumesListAdminTestJSON-1225053259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb926a0e-af53-48da-9a5d-79bce2d3c67b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:13:55 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-b1e4a5a4-1a4a-4230-a3fe-7b2b77fec145 tempest-VolumesListAdminTestJSON-1225053259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb926a0e-af53-48da-9a5d-79bce2d3c67b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:13:55 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-b1e4a5a4-1a4a-4230-a3fe-7b2b77fec145 tempest-VolumesListAdminTestJSON-1225053259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07f5e34a-8436-4d6e-8828-b0460e8f8b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:13:55 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-b1e4a5a4-1a4a-4230-a3fe-7b2b77fec145 tempest-VolumesListAdminTestJSON-1225053259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07f5e34a-8436-4d6e-8828-b0460e8f8b02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd277e805-9379-488f-bb46-a0f25d04a516', 'volume_name': 'volume-d277e805-9379-488f-bb46-a0f25d04a516', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:13:55 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-b1e4a5a4-1a4a-4230-a3fe-7b2b77fec145 tempest-VolumesListAdminTestJSON-1225053259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33b28445-f9c1-4702-a30e-e95b482e96b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:13:55 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-b1e4a5a4-1a4a-4230-a3fe-7b2b77fec145 tempest-VolumesListAdminTestJSON-1225053259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33b28445-f9c1-4702-a30e-e95b482e96b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:13:55 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-b1e4a5a4-1a4a-4230-a3fe-7b2b77fec145 tempest-VolumesListAdminTestJSON-1225053259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dabd75ef-b4d4-4582-93ee-97b23334298b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:13:55 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-b1e4a5a4-1a4a-4230-a3fe-7b2b77fec145 tempest-VolumesListAdminTestJSON-1225053259 None] Volume d277e805-9379-488f-bb46-a0f25d04a516: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d277e805-9379-488f-bb46-a0f25d04a516', 'volume_size': 1}
Apr 10 13:13:55 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-b1e4a5a4-1a4a-4230-a3fe-7b2b77fec145 tempest-VolumesListAdminTestJSON-1225053259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:13:55 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-b1e4a5a4-1a4a-4230-a3fe-7b2b77fec145 tempest-VolumesListAdminTestJSON-1225053259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:13:55 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-b1e4a5a4-1a4a-4230-a3fe-7b2b77fec145 tempest-VolumesListAdminTestJSON-1225053259 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f252bf08b50>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:13:55Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d277e805-9379-488f-bb46-a0f25d04a516,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af8adaee00184ff589863adabedbfe41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:13:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:13:55Z,use_quota=True,user_id='d8ea2618e3734b30a3dc1a0801e8d078',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)}" {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 13:13:55 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-b1e4a5a4-1a4a-4230-a3fe-7b2b77fec145 tempest-VolumesListAdminTestJSON-1225053259 None] Creating volume d277e805-9379-488f-bb46-a0f25d04a516 {{(pid=83345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 13:13:55 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-b1e4a5a4-1a4a-4230-a3fe-7b2b77fec145 tempest-VolumesListAdminTestJSON-1225053259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:13:55 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-b1e4a5a4-1a4a-4230-a3fe-7b2b77fec145 tempest-VolumesListAdminTestJSON-1225053259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:13:55 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-b1e4a5a4-1a4a-4230-a3fe-7b2b77fec145 tempest-VolumesListAdminTestJSON-1225053259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:13:55 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-b1e4a5a4-1a4a-4230-a3fe-7b2b77fec145 tempest-VolumesListAdminTestJSON-1225053259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:13:55 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-b1e4a5a4-1a4a-4230-a3fe-7b2b77fec145 tempest-VolumesListAdminTestJSON-1225053259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:13:55 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-b1e4a5a4-1a4a-4230-a3fe-7b2b77fec145 tempest-VolumesListAdminTestJSON-1225053259 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:13:55 devstack cinder-volume[83345]: INFO cinder.volume.drivers.remotefs [None req-b1e4a5a4-1a4a-4230-a3fe-7b2b77fec145 tempest-VolumesListAdminTestJSON-1225053259 None] casted to osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331
Apr 10 13:13:55 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-b1e4a5a4-1a4a-4230-a3fe-7b2b77fec145 tempest-VolumesListAdminTestJSON-1225053259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-d277e805-9379-488f-bb46-a0f25d04a516 1073741824 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:55 devstack sudo[86803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-d277e805-9379-488f-bb46-a0f25d04a516 1073741824
Apr 10 13:13:55 devstack sudo[86803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:55 devstack sudo[86796]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:55 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-2a166186-2586-4d37-b980-35d8095db667 tempest-GroupSnapshotsTest-2129977062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-cca8c9b4-7289-47df-8435-3c5fa2fdf75a" returned: 0 in 0.713s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:55 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-2a166186-2586-4d37-b980-35d8095db667 tempest-GroupSnapshotsTest-2129977062 None] Lock "cinder-quobyte-cca8c9b4-7289-47df-8435-3c5fa2fdf75a" released by "delete_volume" :: held 1.458s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:13:55 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-2a166186-2586-4d37-b980-35d8095db667 tempest-GroupSnapshotsTest-2129977062 None] Created reservations ['d5f182f4-2084-41e5-93ef-b159b782d1f5'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:13:55 devstack cinder-volume[83345]: WARNING cinder.quota [None req-2a166186-2586-4d37-b980-35d8095db667 tempest-GroupSnapshotsTest-2129977062 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-758559047 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-758559047, it is now deprecated. Please use the default quota class for default quota.
Apr 10 13:13:55 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-2a166186-2586-4d37-b980-35d8095db667 tempest-GroupSnapshotsTest-2129977062 None] Created reservations ['c7ee448e-e4d5-4a42-9fa3-2dc05381fc7b', '91f51a00-f23b-4ecd-a02b-125bb4d9e470', '3fef3a83-f78b-4d70-aad7-4d1f40c8c9fa', 'cc606dde-7bbc-4cfe-80ce-4fe298d2fc28'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:13:55 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-2a166186-2586-4d37-b980-35d8095db667 tempest-GroupSnapshotsTest-2129977062 None] Created reservations ['2cc12c5f-beb1-4cd1-ae33-cd8a4c065294', '29e84e80-7772-4452-9992-e0339d5abdb5', '70eb7a0c-a20a-416e-8209-359491596e72', '5184b9a5-14ff-4d83-8336-b15b72b955f3'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:13:55 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-2a166186-2586-4d37-b980-35d8095db667 tempest-GroupSnapshotsTest-2129977062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:13:55 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-2a166186-2586-4d37-b980-35d8095db667 tempest-GroupSnapshotsTest-2129977062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:13:55 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-2a166186-2586-4d37-b980-35d8095db667 tempest-GroupSnapshotsTest-2129977062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:13:55 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-2a166186-2586-4d37-b980-35d8095db667 tempest-GroupSnapshotsTest-2129977062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:13:55 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-2a166186-2586-4d37-b980-35d8095db667 tempest-GroupSnapshotsTest-2129977062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:13:55 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-2a166186-2586-4d37-b980-35d8095db667 tempest-GroupSnapshotsTest-2129977062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:55 devstack sudo[86809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:13:55 devstack sudo[86809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:55 devstack sudo[86801]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:56 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-df88ef4a-0128-473a-b53b-8b28064a6ea4 tempest-VolumesImageMetadata-1935899781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-ee72b61a-a13f-4979-8ecb-245617004a20" returned: 0 in 0.621s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:56 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-df88ef4a-0128-473a-b53b-8b28064a6ea4 tempest-VolumesImageMetadata-1935899781 None] Lock "cinder-quobyte-ee72b61a-a13f-4979-8ecb-245617004a20" released by "delete_volume" :: held 2.130s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:13:56 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-df88ef4a-0128-473a-b53b-8b28064a6ea4 tempest-VolumesImageMetadata-1935899781 None] Created reservations ['2d21131f-fe5e-408f-8caf-37f53ab80874', 'd1c5d7ad-0075-46dd-a985-cdff2981de39', 'e964dccb-a769-4256-8cf9-86abca4bbacc', 'fa9b0fd3-b75c-4548-ba65-754a04d3c016'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:13:56 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-df88ef4a-0128-473a-b53b-8b28064a6ea4 tempest-VolumesImageMetadata-1935899781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:13:56 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-df88ef4a-0128-473a-b53b-8b28064a6ea4 tempest-VolumesImageMetadata-1935899781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:13:56 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-df88ef4a-0128-473a-b53b-8b28064a6ea4 tempest-VolumesImageMetadata-1935899781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:13:56 devstack sudo[86803]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:56 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-df88ef4a-0128-473a-b53b-8b28064a6ea4 tempest-VolumesImageMetadata-1935899781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:13:56 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-df88ef4a-0128-473a-b53b-8b28064a6ea4 tempest-VolumesImageMetadata-1935899781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:13:56 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-df88ef4a-0128-473a-b53b-8b28064a6ea4 tempest-VolumesImageMetadata-1935899781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:56 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-b1e4a5a4-1a4a-4230-a3fe-7b2b77fec145 tempest-VolumesListAdminTestJSON-1225053259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-d277e805-9379-488f-bb46-a0f25d04a516 1073741824" returned: 0 in 0.625s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:56 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-b1e4a5a4-1a4a-4230-a3fe-7b2b77fec145 tempest-VolumesListAdminTestJSON-1225053259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-d277e805-9379-488f-bb46-a0f25d04a516 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:56 devstack sudo[86821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:13:56 devstack sudo[86821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:56 devstack sudo[86824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-d277e805-9379-488f-bb46-a0f25d04a516
Apr 10 13:13:56 devstack sudo[86824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:56 devstack sudo[86809]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:56 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-2a166186-2586-4d37-b980-35d8095db667 tempest-GroupSnapshotsTest-2129977062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.579s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:56 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-2a166186-2586-4d37-b980-35d8095db667 tempest-GroupSnapshotsTest-2129977062 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:13:56 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-2a166186-2586-4d37-b980-35d8095db667 tempest-GroupSnapshotsTest-2129977062 None] Delete group completed successfully.
Apr 10 13:13:56 devstack sudo[86821]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:56 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-df88ef4a-0128-473a-b53b-8b28064a6ea4 tempest-VolumesImageMetadata-1935899781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.567s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:56 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-df88ef4a-0128-473a-b53b-8b28064a6ea4 tempest-VolumesImageMetadata-1935899781 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:13:56 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-df88ef4a-0128-473a-b53b-8b28064a6ea4 tempest-VolumesImageMetadata-1935899781 None] Deleted volume successfully.
Apr 10 13:13:56 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-bf8a5d34-c9a4-40c3-95ca-03ef4417588c tempest-GroupSnapshotsTest-2129977062 None] Group tempest-GroupSnapshotsTest-Group-528173086: creating
Apr 10 13:13:56 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-df88ef4a-0128-473a-b53b-8b28064a6ea4 tempest-VolumesImageMetadata-1935899781 None] Lock "cinder-ee72b61a-a13f-4979-8ecb-245617004a20-delete_volume" released by "delete_volume" :: held 2.890s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:13:56 devstack sudo[86824]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:56 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-b1e4a5a4-1a4a-4230-a3fe-7b2b77fec145 tempest-VolumesListAdminTestJSON-1225053259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-d277e805-9379-488f-bb46-a0f25d04a516" returned: 0 in 0.567s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:56 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-b1e4a5a4-1a4a-4230-a3fe-7b2b77fec145 tempest-VolumesListAdminTestJSON-1225053259 None] <== create_volume: return (1229ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'} {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 13:13:56 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-b1e4a5a4-1a4a-4230-a3fe-7b2b77fec145 tempest-VolumesListAdminTestJSON-1225053259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.231s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:13:56 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-bf8a5d34-c9a4-40c3-95ca-03ef4417588c tempest-GroupSnapshotsTest-2129977062 None] Group tempest-GroupSnapshotsTest-Group-528173086: created successfully
Apr 10 13:13:56 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-b1e4a5a4-1a4a-4230-a3fe-7b2b77fec145 tempest-VolumesListAdminTestJSON-1225053259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dabd75ef-b4d4-4582-93ee-97b23334298b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d277e805-9379-488f-bb46-a0f25d04a516', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:13:56 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-b1e4a5a4-1a4a-4230-a3fe-7b2b77fec145 tempest-VolumesListAdminTestJSON-1225053259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c78ee6d-f4ce-466c-bf77-67be0e0146f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:13:56 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-b1e4a5a4-1a4a-4230-a3fe-7b2b77fec145 tempest-VolumesListAdminTestJSON-1225053259 None] Volume volume-d277e805-9379-488f-bb46-a0f25d04a516 (d277e805-9379-488f-bb46-a0f25d04a516): created successfully
Apr 10 13:13:56 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-b1e4a5a4-1a4a-4230-a3fe-7b2b77fec145 tempest-VolumesListAdminTestJSON-1225053259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c78ee6d-f4ce-466c-bf77-67be0e0146f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:13:56 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-b1e4a5a4-1a4a-4230-a3fe-7b2b77fec145 tempest-VolumesListAdminTestJSON-1225053259 None] Flow 'volume_create_manager' (086a88bb-9424-41e5-a4fb-7090feba5211) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:13:56 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-bf8a5d34-c9a4-40c3-95ca-03ef4417588c tempest-GroupSnapshotsTest-2129977062 None] Create group completed successfully.
Apr 10 13:13:56 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-b1e4a5a4-1a4a-4230-a3fe-7b2b77fec145 tempest-VolumesListAdminTestJSON-1225053259 None] Created volume successfully.
Apr 10 13:13:57 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-79ae8a70-4d0a-4327-9cfb-2a135607451d tempest-VolumesListAdminTestJSON-1225053259 None] Acquiring lock "cinder-d277e805-9379-488f-bb46-a0f25d04a516-delete_volume" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:13:57 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-79ae8a70-4d0a-4327-9cfb-2a135607451d tempest-VolumesListAdminTestJSON-1225053259 None] Lock "cinder-d277e805-9379-488f-bb46-a0f25d04a516-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:13:57 devstack cinder-volume[83345]: DEBUG dbcounter [-] [83345] Writing DB stats cinder:SELECT=194,cinder:INSERT=51,cinder:UPDATE=220,cinder:DELETE=10 {{(pid=83345) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 10 13:13:57 devstack cinder-volume[83345]: DEBUG dbcounter [-] [83345] Writing DB stats cinder:INSERT=60,cinder:SELECT=181,cinder:UPDATE=219,cinder:DELETE=14 {{(pid=83345) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 10 13:13:57 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-79ae8a70-4d0a-4327-9cfb-2a135607451d tempest-VolumesListAdminTestJSON-1225053259 None] Acquiring lock "cinder-quobyte-d277e805-9379-488f-bb46-a0f25d04a516" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:13:57 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-79ae8a70-4d0a-4327-9cfb-2a135607451d tempest-VolumesListAdminTestJSON-1225053259 None] Lock "cinder-quobyte-d277e805-9379-488f-bb46-a0f25d04a516" acquired by "delete_volume" :: waited 0.013s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:13:57 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9493c61-3f65-439c-89a6-1388e8e2ae2a]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:13:57 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-79ae8a70-4d0a-4327-9cfb-2a135607451d tempest-VolumesListAdminTestJSON-1225053259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-d277e805-9379-488f-bb46-a0f25d04a516 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:57 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-58dd4518-866d-4406-93ae-b374510d4fad tempest-VolumesListAdminTestJSON-1892539430 None] Acquiring lock "cinder-8a651b2a-caee-411b-a546-0c02b4e1986d-delete_volume" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:13:57 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-58dd4518-866d-4406-93ae-b374510d4fad tempest-VolumesListAdminTestJSON-1892539430 None] Lock "cinder-8a651b2a-caee-411b-a546-0c02b4e1986d-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:13:57 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-58dd4518-866d-4406-93ae-b374510d4fad tempest-VolumesListAdminTestJSON-1892539430 None] Acquiring lock "cinder-quobyte-8a651b2a-caee-411b-a546-0c02b4e1986d" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:13:57 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-58dd4518-866d-4406-93ae-b374510d4fad tempest-VolumesListAdminTestJSON-1892539430 None] Lock "cinder-quobyte-8a651b2a-caee-411b-a546-0c02b4e1986d" acquired by "delete_volume" :: waited 0.009s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:13:57 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[4680f76b-6834-4290-9fd3-e86e1bfe590e]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:13:57 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-58dd4518-866d-4406-93ae-b374510d4fad tempest-VolumesListAdminTestJSON-1892539430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-8a651b2a-caee-411b-a546-0c02b4e1986d {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:57 devstack sudo[86839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-d277e805-9379-488f-bb46-a0f25d04a516
Apr 10 13:13:57 devstack sudo[86839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:57 devstack sudo[86840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-8a651b2a-caee-411b-a546-0c02b4e1986d
Apr 10 13:13:57 devstack sudo[86840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:58 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-fad6b394-666a-4f1b-87e8-fea294b61759 tempest-GroupSnapshotsTest-2129977062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:13:58 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-fad6b394-666a-4f1b-87e8-fea294b61759 tempest-GroupSnapshotsTest-2129977062 None] Flow 'volume_create_manager' (9f3bd9ca-88cc-43d2-93a1-0c3278357bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:13:58 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-fad6b394-666a-4f1b-87e8-fea294b61759 tempest-GroupSnapshotsTest-2129977062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (123d4e1f-f328-40ef-ba2c-3f46801648cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:13:58 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-fad6b394-666a-4f1b-87e8-fea294b61759 tempest-GroupSnapshotsTest-2129977062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (123d4e1f-f328-40ef-ba2c-3f46801648cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:13:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1954204295',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=e29f4cc0-bc1d-47a7-bf96-659f1ed4b7a5,host='devstack@QuobyteHD#QuobyteHD',id=b61b7e77-0fac-46d3-a54b-57764b369571,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83b6561967ad4eb28500542ade97ab3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:13:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:13:58Z,use_quota=True,user_id='83cee95bb380438c8ca284260999dfd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06562138-e9af-47c8-bc66-6eb1a751f1fa),volume_type_id=06562138-e9af-47c8-bc66-6eb1a751f1fa)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:13:58 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-fad6b394-666a-4f1b-87e8-fea294b61759 tempest-GroupSnapshotsTest-2129977062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55de809e-1482-4616-8b1b-381d0103126e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:13:58 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-fad6b394-666a-4f1b-87e8-fea294b61759 tempest-GroupSnapshotsTest-2129977062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55de809e-1482-4616-8b1b-381d0103126e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:13:58 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-fad6b394-666a-4f1b-87e8-fea294b61759 tempest-GroupSnapshotsTest-2129977062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4a0bf6d-0774-4910-85c6-c7e7f11adedb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:13:58 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-fad6b394-666a-4f1b-87e8-fea294b61759 tempest-GroupSnapshotsTest-2129977062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4a0bf6d-0774-4910-85c6-c7e7f11adedb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b61b7e77-0fac-46d3-a54b-57764b369571', 'volume_name': 'volume-b61b7e77-0fac-46d3-a54b-57764b369571', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:13:58 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-fad6b394-666a-4f1b-87e8-fea294b61759 tempest-GroupSnapshotsTest-2129977062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d524a7a5-42d3-4f80-8cd5-d81d14c43938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:13:58 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-fad6b394-666a-4f1b-87e8-fea294b61759 tempest-GroupSnapshotsTest-2129977062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d524a7a5-42d3-4f80-8cd5-d81d14c43938) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:13:58 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-fad6b394-666a-4f1b-87e8-fea294b61759 tempest-GroupSnapshotsTest-2129977062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (296e4d2b-fa72-40ee-857c-cfa94d2241e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:13:58 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-fad6b394-666a-4f1b-87e8-fea294b61759 tempest-GroupSnapshotsTest-2129977062 None] Volume b61b7e77-0fac-46d3-a54b-57764b369571: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b61b7e77-0fac-46d3-a54b-57764b369571', 'volume_size': 1}
Apr 10 13:13:58 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-fad6b394-666a-4f1b-87e8-fea294b61759 tempest-GroupSnapshotsTest-2129977062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:13:58 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-fad6b394-666a-4f1b-87e8-fea294b61759 tempest-GroupSnapshotsTest-2129977062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:13:58 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-fad6b394-666a-4f1b-87e8-fea294b61759 tempest-GroupSnapshotsTest-2129977062 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f252bf08b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=e29f4cc0-bc1d-47a7-bf96-659f1ed4b7a5,created_at=2026-04-10T11:13:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1954204295',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=e29f4cc0-bc1d-47a7-bf96-659f1ed4b7a5,host='devstack@QuobyteHD#QuobyteHD',id=b61b7e77-0fac-46d3-a54b-57764b369571,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83b6561967ad4eb28500542ade97ab3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:13:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:13:58Z,use_quota=True,user_id='83cee95bb380438c8ca284260999dfd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06562138-e9af-47c8-bc66-6eb1a751f1fa),volume_type_id=06562138-e9af-47c8-bc66-6eb1a751f1fa)}" {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 13:13:58 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-fad6b394-666a-4f1b-87e8-fea294b61759 tempest-GroupSnapshotsTest-2129977062 None] Creating volume b61b7e77-0fac-46d3-a54b-57764b369571 {{(pid=83345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 13:13:58 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-fad6b394-666a-4f1b-87e8-fea294b61759 tempest-GroupSnapshotsTest-2129977062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:13:58 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-fad6b394-666a-4f1b-87e8-fea294b61759 tempest-GroupSnapshotsTest-2129977062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:13:58 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-fad6b394-666a-4f1b-87e8-fea294b61759 tempest-GroupSnapshotsTest-2129977062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:13:58 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-fad6b394-666a-4f1b-87e8-fea294b61759 tempest-GroupSnapshotsTest-2129977062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:13:58 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-fad6b394-666a-4f1b-87e8-fea294b61759 tempest-GroupSnapshotsTest-2129977062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:13:58 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-fad6b394-666a-4f1b-87e8-fea294b61759 tempest-GroupSnapshotsTest-2129977062 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:13:58 devstack cinder-volume[83345]: INFO cinder.volume.drivers.remotefs [None req-fad6b394-666a-4f1b-87e8-fea294b61759 tempest-GroupSnapshotsTest-2129977062 None] casted to osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331
Apr 10 13:13:58 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-fad6b394-666a-4f1b-87e8-fea294b61759 tempest-GroupSnapshotsTest-2129977062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b61b7e77-0fac-46d3-a54b-57764b369571 1073741824 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:58 devstack sudo[86874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b61b7e77-0fac-46d3-a54b-57764b369571 1073741824
Apr 10 13:13:58 devstack sudo[86874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:58 devstack sudo[86839]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:58 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-79ae8a70-4d0a-4327-9cfb-2a135607451d tempest-VolumesListAdminTestJSON-1225053259 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-d277e805-9379-488f-bb46-a0f25d04a516" returned: 0 in 0.937s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:58 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-79ae8a70-4d0a-4327-9cfb-2a135607451d tempest-VolumesListAdminTestJSON-1225053259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-d277e805-9379-488f-bb46-a0f25d04a516 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:58 devstack sudo[86878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-d277e805-9379-488f-bb46-a0f25d04a516
Apr 10 13:13:58 devstack sudo[86878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:58 devstack sudo[86840]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:58 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-58dd4518-866d-4406-93ae-b374510d4fad tempest-VolumesListAdminTestJSON-1892539430 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-8a651b2a-caee-411b-a546-0c02b4e1986d" returned: 0 in 1.048s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:58 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-58dd4518-866d-4406-93ae-b374510d4fad tempest-VolumesListAdminTestJSON-1892539430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-8a651b2a-caee-411b-a546-0c02b4e1986d {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:58 devstack sudo[86881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-8a651b2a-caee-411b-a546-0c02b4e1986d
Apr 10 13:13:58 devstack sudo[86881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:59 devstack sudo[86878]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:59 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-79ae8a70-4d0a-4327-9cfb-2a135607451d tempest-VolumesListAdminTestJSON-1225053259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-d277e805-9379-488f-bb46-a0f25d04a516" returned: 0 in 0.943s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:59 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-79ae8a70-4d0a-4327-9cfb-2a135607451d tempest-VolumesListAdminTestJSON-1225053259 None] Lock "cinder-quobyte-d277e805-9379-488f-bb46-a0f25d04a516" released by "delete_volume" :: held 1.911s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:13:59 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-79ae8a70-4d0a-4327-9cfb-2a135607451d tempest-VolumesListAdminTestJSON-1225053259 None] Created reservations ['3caee500-53ff-4486-805c-78444e6a15bd', '9669bda1-138d-4d34-878f-357a82517825', '171377b6-a79d-43f4-a214-3f6a19d9703e', '97cce203-3a00-4a7a-9ccd-6d90fd061721'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:13:59 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-79ae8a70-4d0a-4327-9cfb-2a135607451d tempest-VolumesListAdminTestJSON-1225053259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:13:59 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-79ae8a70-4d0a-4327-9cfb-2a135607451d tempest-VolumesListAdminTestJSON-1225053259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:13:59 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-79ae8a70-4d0a-4327-9cfb-2a135607451d tempest-VolumesListAdminTestJSON-1225053259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:13:59 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-79ae8a70-4d0a-4327-9cfb-2a135607451d tempest-VolumesListAdminTestJSON-1225053259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:13:59 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-79ae8a70-4d0a-4327-9cfb-2a135607451d tempest-VolumesListAdminTestJSON-1225053259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:13:59 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-79ae8a70-4d0a-4327-9cfb-2a135607451d tempest-VolumesListAdminTestJSON-1225053259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:59 devstack sudo[86881]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:59 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-58dd4518-866d-4406-93ae-b374510d4fad tempest-VolumesListAdminTestJSON-1892539430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-8a651b2a-caee-411b-a546-0c02b4e1986d" returned: 0 in 0.856s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:59 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-58dd4518-866d-4406-93ae-b374510d4fad tempest-VolumesListAdminTestJSON-1892539430 None] Lock "cinder-quobyte-8a651b2a-caee-411b-a546-0c02b4e1986d" released by "delete_volume" :: held 1.954s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:13:59 devstack sudo[86891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:13:59 devstack sudo[86891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:59 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-58dd4518-866d-4406-93ae-b374510d4fad tempest-VolumesListAdminTestJSON-1892539430 None] Created reservations ['105920d1-b1fa-48ed-86f7-9b8592793879', '6dc854fd-d331-4c6e-8d0e-f589df88c7de', 'd9ffe163-bd89-43d6-b0ba-447b7760cbf2', '2c81f9c3-fd61-4759-ba7a-9cc6de50220a'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:13:59 devstack sudo[86874]: pam_unix(sudo:session): session closed for user root
Apr 10 13:13:59 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-fad6b394-666a-4f1b-87e8-fea294b61759 tempest-GroupSnapshotsTest-2129977062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b61b7e77-0fac-46d3-a54b-57764b369571 1073741824" returned: 0 in 1.225s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:13:59 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-58dd4518-866d-4406-93ae-b374510d4fad tempest-VolumesListAdminTestJSON-1892539430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:13:59 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-58dd4518-866d-4406-93ae-b374510d4fad tempest-VolumesListAdminTestJSON-1892539430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:13:59 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-58dd4518-866d-4406-93ae-b374510d4fad tempest-VolumesListAdminTestJSON-1892539430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:13:59 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-58dd4518-866d-4406-93ae-b374510d4fad tempest-VolumesListAdminTestJSON-1892539430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:13:59 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-58dd4518-866d-4406-93ae-b374510d4fad tempest-VolumesListAdminTestJSON-1892539430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:13:59 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-58dd4518-866d-4406-93ae-b374510d4fad tempest-VolumesListAdminTestJSON-1892539430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:59 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-fad6b394-666a-4f1b-87e8-fea294b61759 tempest-GroupSnapshotsTest-2129977062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b61b7e77-0fac-46d3-a54b-57764b369571 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:13:59 devstack sudo[86893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:13:59 devstack sudo[86893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:13:59 devstack sudo[86894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b61b7e77-0fac-46d3-a54b-57764b369571
Apr 10 13:13:59 devstack sudo[86894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:14:00 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-f27c3ccf-996b-4f7d-9c8c-605ae1ad7ee2 tempest-VolumesListAdminTestJSON-1892539430 None] Acquiring lock "cinder-b18312d3-67b5-4e69-899a-6b80644373fa-delete_volume" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:14:00 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-f27c3ccf-996b-4f7d-9c8c-605ae1ad7ee2 tempest-VolumesListAdminTestJSON-1892539430 None] Lock "cinder-b18312d3-67b5-4e69-899a-6b80644373fa-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:14:00 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-f27c3ccf-996b-4f7d-9c8c-605ae1ad7ee2 tempest-VolumesListAdminTestJSON-1892539430 None] Acquiring lock "cinder-quobyte-b18312d3-67b5-4e69-899a-6b80644373fa" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:14:00 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-f27c3ccf-996b-4f7d-9c8c-605ae1ad7ee2 tempest-VolumesListAdminTestJSON-1892539430 None] Lock "cinder-quobyte-b18312d3-67b5-4e69-899a-6b80644373fa" acquired by "delete_volume" :: waited 0.020s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:14:00 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b3858cd-cc17-4445-a9f6-c1a6a76664b0]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:14:00 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-f27c3ccf-996b-4f7d-9c8c-605ae1ad7ee2 tempest-VolumesListAdminTestJSON-1892539430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b18312d3-67b5-4e69-899a-6b80644373fa {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:14:00 devstack sudo[86894]: pam_unix(sudo:session): session closed for user root
Apr 10 13:14:00 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-fad6b394-666a-4f1b-87e8-fea294b61759 tempest-GroupSnapshotsTest-2129977062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b61b7e77-0fac-46d3-a54b-57764b369571" returned: 0 in 0.780s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:14:00 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-fad6b394-666a-4f1b-87e8-fea294b61759 tempest-GroupSnapshotsTest-2129977062 None] <== create_volume: return (2081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'} {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 13:14:00 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-fad6b394-666a-4f1b-87e8-fea294b61759 tempest-GroupSnapshotsTest-2129977062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.087s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:14:00 devstack sudo[86899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b18312d3-67b5-4e69-899a-6b80644373fa
Apr 10 13:14:00 devstack sudo[86899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:14:00 devstack sudo[86893]: pam_unix(sudo:session): session closed for user root
Apr 10 13:14:00 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-fad6b394-666a-4f1b-87e8-fea294b61759 tempest-GroupSnapshotsTest-2129977062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (296e4d2b-fa72-40ee-857c-cfa94d2241e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b61b7e77-0fac-46d3-a54b-57764b369571', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:14:00 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-fad6b394-666a-4f1b-87e8-fea294b61759 tempest-GroupSnapshotsTest-2129977062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (847e8dee-7c8e-4342-a794-a6fd51db2db5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:14:00 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-58dd4518-866d-4406-93ae-b374510d4fad tempest-VolumesListAdminTestJSON-1892539430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.925s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:14:00 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-58dd4518-866d-4406-93ae-b374510d4fad tempest-VolumesListAdminTestJSON-1892539430 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:14:00 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-58dd4518-866d-4406-93ae-b374510d4fad tempest-VolumesListAdminTestJSON-1892539430 None] Deleted volume successfully.
Apr 10 13:14:00 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-58dd4518-866d-4406-93ae-b374510d4fad tempest-VolumesListAdminTestJSON-1892539430 None] Lock "cinder-8a651b2a-caee-411b-a546-0c02b4e1986d-delete_volume" released by "delete_volume" :: held 3.056s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:14:00 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-fad6b394-666a-4f1b-87e8-fea294b61759 tempest-GroupSnapshotsTest-2129977062 None] Volume volume-b61b7e77-0fac-46d3-a54b-57764b369571 (b61b7e77-0fac-46d3-a54b-57764b369571): created successfully
Apr 10 13:14:00 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-fad6b394-666a-4f1b-87e8-fea294b61759 tempest-GroupSnapshotsTest-2129977062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (847e8dee-7c8e-4342-a794-a6fd51db2db5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:14:00 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-fad6b394-666a-4f1b-87e8-fea294b61759 tempest-GroupSnapshotsTest-2129977062 None] Flow 'volume_create_manager' (9f3bd9ca-88cc-43d2-93a1-0c3278357bf4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:14:00 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-fad6b394-666a-4f1b-87e8-fea294b61759 tempest-GroupSnapshotsTest-2129977062 None] Created volume successfully.
Apr 10 13:14:00 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-56ad82ff-f12d-4638-bb1b-baafda1f5b81 tempest-AbsoluteLimitsTests-785284212 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:14:00 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-56ad82ff-f12d-4638-bb1b-baafda1f5b81 tempest-AbsoluteLimitsTests-785284212 None] Flow 'volume_create_manager' (7a374728-f381-4fbf-ae27-b2ba143941bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:14:01 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-56ad82ff-f12d-4638-bb1b-baafda1f5b81 tempest-AbsoluteLimitsTests-785284212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb5648d4-0cd1-45e3-bedc-83ce6cba331d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:14:01 devstack sudo[86891]: pam_unix(sudo:session): session closed for user root
Apr 10 13:14:01 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-56ad82ff-f12d-4638-bb1b-baafda1f5b81 tempest-AbsoluteLimitsTests-785284212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb5648d4-0cd1-45e3-bedc-83ce6cba331d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:14:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1789981635',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=782ad8f9-9e02-40eb-b909-912abbe6fe52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cba654b5c1c743b8bec898f2bb2a931f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:14:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:14:01Z,use_quota=True,user_id='743c700fcf0b460b8e8fe2c227f0641d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:14:01 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-56ad82ff-f12d-4638-bb1b-baafda1f5b81 tempest-AbsoluteLimitsTests-785284212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bc349c2-848d-448d-8e1f-94c8a775815f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:14:01 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-56ad82ff-f12d-4638-bb1b-baafda1f5b81 tempest-AbsoluteLimitsTests-785284212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bc349c2-848d-448d-8e1f-94c8a775815f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:14:01 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-56ad82ff-f12d-4638-bb1b-baafda1f5b81 tempest-AbsoluteLimitsTests-785284212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (030da164-ef2e-4efc-a8b3-298b35a0381c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:14:01 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-56ad82ff-f12d-4638-bb1b-baafda1f5b81 tempest-AbsoluteLimitsTests-785284212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (030da164-ef2e-4efc-a8b3-298b35a0381c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '782ad8f9-9e02-40eb-b909-912abbe6fe52', 'volume_name': 'volume-782ad8f9-9e02-40eb-b909-912abbe6fe52', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:14:01 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-56ad82ff-f12d-4638-bb1b-baafda1f5b81 tempest-AbsoluteLimitsTests-785284212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (decd0eee-6f30-463f-99fa-b5ae1ba49edf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:14:01 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-56ad82ff-f12d-4638-bb1b-baafda1f5b81 tempest-AbsoluteLimitsTests-785284212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (decd0eee-6f30-463f-99fa-b5ae1ba49edf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:14:01 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-56ad82ff-f12d-4638-bb1b-baafda1f5b81 tempest-AbsoluteLimitsTests-785284212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1220dab3-ba42-4e82-af63-ab215ad3ef68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:14:01 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-56ad82ff-f12d-4638-bb1b-baafda1f5b81 tempest-AbsoluteLimitsTests-785284212 None] Volume 782ad8f9-9e02-40eb-b909-912abbe6fe52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-782ad8f9-9e02-40eb-b909-912abbe6fe52', 'volume_size': 1}
Apr 10 13:14:01 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-56ad82ff-f12d-4638-bb1b-baafda1f5b81 tempest-AbsoluteLimitsTests-785284212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:14:01 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-56ad82ff-f12d-4638-bb1b-baafda1f5b81 tempest-AbsoluteLimitsTests-785284212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:14:01 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-56ad82ff-f12d-4638-bb1b-baafda1f5b81 tempest-AbsoluteLimitsTests-785284212 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f252bf08b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:14:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1789981635',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=782ad8f9-9e02-40eb-b909-912abbe6fe52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cba654b5c1c743b8bec898f2bb2a931f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:14:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:14:01Z,use_quota=True,user_id='743c700fcf0b460b8e8fe2c227f0641d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)}" {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 13:14:01 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-56ad82ff-f12d-4638-bb1b-baafda1f5b81 tempest-AbsoluteLimitsTests-785284212 None] Creating volume 782ad8f9-9e02-40eb-b909-912abbe6fe52 {{(pid=83345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 13:14:01 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-56ad82ff-f12d-4638-bb1b-baafda1f5b81 tempest-AbsoluteLimitsTests-785284212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:14:01 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-56ad82ff-f12d-4638-bb1b-baafda1f5b81 tempest-AbsoluteLimitsTests-785284212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:14:01 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-56ad82ff-f12d-4638-bb1b-baafda1f5b81 tempest-AbsoluteLimitsTests-785284212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:14:01 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-56ad82ff-f12d-4638-bb1b-baafda1f5b81 tempest-AbsoluteLimitsTests-785284212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:14:01 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-56ad82ff-f12d-4638-bb1b-baafda1f5b81 tempest-AbsoluteLimitsTests-785284212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:14:01 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-56ad82ff-f12d-4638-bb1b-baafda1f5b81 tempest-AbsoluteLimitsTests-785284212 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:14:01 devstack cinder-volume[83345]: INFO cinder.volume.drivers.remotefs [None req-56ad82ff-f12d-4638-bb1b-baafda1f5b81 tempest-AbsoluteLimitsTests-785284212 None] casted to osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331
Apr 10 13:14:01 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-56ad82ff-f12d-4638-bb1b-baafda1f5b81 tempest-AbsoluteLimitsTests-785284212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-782ad8f9-9e02-40eb-b909-912abbe6fe52 1073741824 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:14:01 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-79ae8a70-4d0a-4327-9cfb-2a135607451d tempest-VolumesListAdminTestJSON-1225053259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 1.511s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:14:01 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-79ae8a70-4d0a-4327-9cfb-2a135607451d tempest-VolumesListAdminTestJSON-1225053259 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:14:01 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-79ae8a70-4d0a-4327-9cfb-2a135607451d tempest-VolumesListAdminTestJSON-1225053259 None] Deleted volume successfully.
Apr 10 13:14:01 devstack sudo[86927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-782ad8f9-9e02-40eb-b909-912abbe6fe52 1073741824
Apr 10 13:14:01 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-79ae8a70-4d0a-4327-9cfb-2a135607451d tempest-VolumesListAdminTestJSON-1225053259 None] Lock "cinder-d277e805-9379-488f-bb46-a0f25d04a516-delete_volume" released by "delete_volume" :: held 3.643s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:14:01 devstack sudo[86927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:14:01 devstack sudo[86899]: pam_unix(sudo:session): session closed for user root
Apr 10 13:14:01 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-f27c3ccf-996b-4f7d-9c8c-605ae1ad7ee2 tempest-VolumesListAdminTestJSON-1892539430 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b18312d3-67b5-4e69-899a-6b80644373fa" returned: 0 in 1.135s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:14:01 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-f27c3ccf-996b-4f7d-9c8c-605ae1ad7ee2 tempest-VolumesListAdminTestJSON-1892539430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b18312d3-67b5-4e69-899a-6b80644373fa {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:14:01 devstack sudo[86934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b18312d3-67b5-4e69-899a-6b80644373fa
Apr 10 13:14:01 devstack sudo[86934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:14:01 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-c8a505cd-b6f2-4000-9520-7b1de3324efc tempest-GroupSnapshotsTest-2129977062 None] GroupSnapshot e1804800-8690-42cc-87f5-7f09238cfb70: creating.
Apr 10 13:14:01 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-c8a505cd-b6f2-4000-9520-7b1de3324efc tempest-GroupSnapshotsTest-2129977062 None] Group snapshot e1804800-8690-42cc-87f5-7f09238cfb70: creating. {{(pid=83345) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 10 13:14:01 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-c8a505cd-b6f2-4000-9520-7b1de3324efc tempest-GroupSnapshotsTest-2129977062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:14:01 devstack sudo[86927]: pam_unix(sudo:session): session closed for user root
Apr 10 13:14:01 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-56ad82ff-f12d-4638-bb1b-baafda1f5b81 tempest-AbsoluteLimitsTests-785284212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-782ad8f9-9e02-40eb-b909-912abbe6fe52 1073741824" returned: 0 in 0.804s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:14:01 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-56ad82ff-f12d-4638-bb1b-baafda1f5b81 tempest-AbsoluteLimitsTests-785284212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-782ad8f9-9e02-40eb-b909-912abbe6fe52 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:14:01 devstack sudo[86934]: pam_unix(sudo:session): session closed for user root
Apr 10 13:14:01 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-f27c3ccf-996b-4f7d-9c8c-605ae1ad7ee2 tempest-VolumesListAdminTestJSON-1892539430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b18312d3-67b5-4e69-899a-6b80644373fa" returned: 0 in 0.444s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:14:01 devstack sudo[86940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-782ad8f9-9e02-40eb-b909-912abbe6fe52
Apr 10 13:14:01 devstack sudo[86940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:14:01 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-f27c3ccf-996b-4f7d-9c8c-605ae1ad7ee2 tempest-VolumesListAdminTestJSON-1892539430 None] Lock "cinder-quobyte-b18312d3-67b5-4e69-899a-6b80644373fa" released by "delete_volume" :: held 1.717s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:14:01 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-f27c3ccf-996b-4f7d-9c8c-605ae1ad7ee2 tempest-VolumesListAdminTestJSON-1892539430 None] Created reservations ['f74273b0-f9ff-42a5-9fcd-2ad32c2eae6e', '77c380da-aa9b-47ca-bc8e-621106196e60', '7deb5793-4861-476c-bca1-531af49bf29f', 'e2a44ea1-3814-4ede-afb1-c7c172d6d81d'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:14:02 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-f27c3ccf-996b-4f7d-9c8c-605ae1ad7ee2 tempest-VolumesListAdminTestJSON-1892539430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:14:02 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-f27c3ccf-996b-4f7d-9c8c-605ae1ad7ee2 tempest-VolumesListAdminTestJSON-1892539430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:14:02 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-f27c3ccf-996b-4f7d-9c8c-605ae1ad7ee2 tempest-VolumesListAdminTestJSON-1892539430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:14:02 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-f27c3ccf-996b-4f7d-9c8c-605ae1ad7ee2 tempest-VolumesListAdminTestJSON-1892539430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:14:02 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-f27c3ccf-996b-4f7d-9c8c-605ae1ad7ee2 tempest-VolumesListAdminTestJSON-1892539430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:14:02 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-f27c3ccf-996b-4f7d-9c8c-605ae1ad7ee2 tempest-VolumesListAdminTestJSON-1892539430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:14:02 devstack sudo[86942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:14:02 devstack sudo[86942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:14:02 devstack sudo[86940]: pam_unix(sudo:session): session closed for user root
Apr 10 13:14:02 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-56ad82ff-f12d-4638-bb1b-baafda1f5b81 tempest-AbsoluteLimitsTests-785284212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-782ad8f9-9e02-40eb-b909-912abbe6fe52" returned: 0 in 0.483s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:14:02 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-56ad82ff-f12d-4638-bb1b-baafda1f5b81 tempest-AbsoluteLimitsTests-785284212 None] <== create_volume: return (1317ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'} {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 13:14:02 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-56ad82ff-f12d-4638-bb1b-baafda1f5b81 tempest-AbsoluteLimitsTests-785284212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.321s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:14:02 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-c8a505cd-b6f2-4000-9520-7b1de3324efc tempest-GroupSnapshotsTest-2129977062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.610s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:14:02 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-56ad82ff-f12d-4638-bb1b-baafda1f5b81 tempest-AbsoluteLimitsTests-785284212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1220dab3-ba42-4e82-af63-ab215ad3ef68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-782ad8f9-9e02-40eb-b909-912abbe6fe52', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:14:02 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-56ad82ff-f12d-4638-bb1b-baafda1f5b81 tempest-AbsoluteLimitsTests-785284212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb4337a5-846b-4361-9c1c-eb69a57b7b88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:14:02 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-2f93bafe-6f37-4415-a634-7205bddbb3b5 tempest-VolumesListAdminTestJSON-1892539430 None] Acquiring lock "cinder-db0816ed-1457-4bc3-b8bf-5d7ae15836b7-delete_volume" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:14:02 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-c8a505cd-b6f2-4000-9520-7b1de3324efc tempest-GroupSnapshotsTest-2129977062 None] Creating offline snapshot 1c1313b4-477d-4c68-a404-bcff7b536a73 of volume b61b7e77-0fac-46d3-a54b-57764b369571 {{(pid=83345) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 10 13:14:02 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-56ad82ff-f12d-4638-bb1b-baafda1f5b81 tempest-AbsoluteLimitsTests-785284212 None] Volume volume-782ad8f9-9e02-40eb-b909-912abbe6fe52 (782ad8f9-9e02-40eb-b909-912abbe6fe52): created successfully
Apr 10 13:14:02 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-56ad82ff-f12d-4638-bb1b-baafda1f5b81 tempest-AbsoluteLimitsTests-785284212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb4337a5-846b-4361-9c1c-eb69a57b7b88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:14:02 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-56ad82ff-f12d-4638-bb1b-baafda1f5b81 tempest-AbsoluteLimitsTests-785284212 None] Flow 'volume_create_manager' (7a374728-f381-4fbf-ae27-b2ba143941bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:14:02 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-2f93bafe-6f37-4415-a634-7205bddbb3b5 tempest-VolumesListAdminTestJSON-1892539430 None] Lock "cinder-db0816ed-1457-4bc3-b8bf-5d7ae15836b7-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:14:02 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb7a689e-b071-4015-ae4f-86a4a326d5d4]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:14:02 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-c8a505cd-b6f2-4000-9520-7b1de3324efc tempest-GroupSnapshotsTest-2129977062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b61b7e77-0fac-46d3-a54b-57764b369571 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:14:02 devstack sudo[86942]: pam_unix(sudo:session): session closed for user root
Apr 10 13:14:02 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-56ad82ff-f12d-4638-bb1b-baafda1f5b81 tempest-AbsoluteLimitsTests-785284212 None] Created volume successfully.
Apr 10 13:14:02 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-f27c3ccf-996b-4f7d-9c8c-605ae1ad7ee2 tempest-VolumesListAdminTestJSON-1892539430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.481s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:14:02 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-f27c3ccf-996b-4f7d-9c8c-605ae1ad7ee2 tempest-VolumesListAdminTestJSON-1892539430 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:14:02 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-2f93bafe-6f37-4415-a634-7205bddbb3b5 tempest-VolumesListAdminTestJSON-1892539430 None] Acquiring lock "cinder-quobyte-db0816ed-1457-4bc3-b8bf-5d7ae15836b7" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:14:02 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-2f93bafe-6f37-4415-a634-7205bddbb3b5 tempest-VolumesListAdminTestJSON-1892539430 None] Lock "cinder-quobyte-db0816ed-1457-4bc3-b8bf-5d7ae15836b7" acquired by "delete_volume" :: waited 0.008s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:14:02 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-f27c3ccf-996b-4f7d-9c8c-605ae1ad7ee2 tempest-VolumesListAdminTestJSON-1892539430 None] Deleted volume successfully.
Apr 10 13:14:02 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-f27c3ccf-996b-4f7d-9c8c-605ae1ad7ee2 tempest-VolumesListAdminTestJSON-1892539430 None] Lock "cinder-b18312d3-67b5-4e69-899a-6b80644373fa-delete_volume" released by "delete_volume" :: held 2.424s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:14:02 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8543cf3-6681-4dda-949d-ecc6804bf615]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:14:02 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-2f93bafe-6f37-4415-a634-7205bddbb3b5 tempest-VolumesListAdminTestJSON-1892539430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-db0816ed-1457-4bc3-b8bf-5d7ae15836b7 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:14:02 devstack sudo[86946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b61b7e77-0fac-46d3-a54b-57764b369571
Apr 10 13:14:02 devstack sudo[86946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:14:02 devstack sudo[86949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-db0816ed-1457-4bc3-b8bf-5d7ae15836b7
Apr 10 13:14:02 devstack sudo[86949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:14:03 devstack sudo[86946]: pam_unix(sudo:session): session closed for user root
Apr 10 13:14:03 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-c8a505cd-b6f2-4000-9520-7b1de3324efc tempest-GroupSnapshotsTest-2129977062 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b61b7e77-0fac-46d3-a54b-57764b369571" returned: 0 in 0.624s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:14:03 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-c8a505cd-b6f2-4000-9520-7b1de3324efc tempest-GroupSnapshotsTest-2129977062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b61b7e77-0fac-46d3-a54b-57764b369571,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b61b7e77-0fac-46d3-a54b-57764b369571.1c1313b4-477d-4c68-a404-bcff7b536a73 1G {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:14:03 devstack sudo[86955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b61b7e77-0fac-46d3-a54b-57764b369571,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b61b7e77-0fac-46d3-a54b-57764b369571.1c1313b4-477d-4c68-a404-bcff7b536a73 1G
Apr 10 13:14:03 devstack sudo[86955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:14:03 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-a536d60d-9704-4040-b28a-89057fee332f tempest-AbsoluteLimitsTests-785284212 None] Acquiring lock "cinder-782ad8f9-9e02-40eb-b909-912abbe6fe52-delete_volume" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:14:03 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-a536d60d-9704-4040-b28a-89057fee332f tempest-AbsoluteLimitsTests-785284212 None] Lock "cinder-782ad8f9-9e02-40eb-b909-912abbe6fe52-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:14:03 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-a536d60d-9704-4040-b28a-89057fee332f tempest-AbsoluteLimitsTests-785284212 None] Acquiring lock "cinder-quobyte-782ad8f9-9e02-40eb-b909-912abbe6fe52" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:14:03 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-a536d60d-9704-4040-b28a-89057fee332f tempest-AbsoluteLimitsTests-785284212 None] Lock "cinder-quobyte-782ad8f9-9e02-40eb-b909-912abbe6fe52" acquired by "delete_volume" :: waited 0.009s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:14:03 devstack sudo[86949]: pam_unix(sudo:session): session closed for user root
Apr 10 13:14:03 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-2f93bafe-6f37-4415-a634-7205bddbb3b5 tempest-VolumesListAdminTestJSON-1892539430 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-db0816ed-1457-4bc3-b8bf-5d7ae15836b7" returned: 0 in 0.826s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:14:03 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-2f93bafe-6f37-4415-a634-7205bddbb3b5 tempest-VolumesListAdminTestJSON-1892539430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-db0816ed-1457-4bc3-b8bf-5d7ae15836b7 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:14:03 devstack sudo[86960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-db0816ed-1457-4bc3-b8bf-5d7ae15836b7
Apr 10 13:14:03 devstack sudo[86960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:14:03 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4109dae-654a-4b33-b628-fe54e7e1c6cf]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:14:03 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-a536d60d-9704-4040-b28a-89057fee332f tempest-AbsoluteLimitsTests-785284212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-782ad8f9-9e02-40eb-b909-912abbe6fe52 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:14:03 devstack sudo[86962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-782ad8f9-9e02-40eb-b909-912abbe6fe52
Apr 10 13:14:03 devstack sudo[86962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:14:04 devstack sudo[86960]: pam_unix(sudo:session): session closed for user root
Apr 10 13:14:04 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-2f93bafe-6f37-4415-a634-7205bddbb3b5 tempest-VolumesListAdminTestJSON-1892539430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-db0816ed-1457-4bc3-b8bf-5d7ae15836b7" returned: 0 in 0.689s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:14:04 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-2f93bafe-6f37-4415-a634-7205bddbb3b5 tempest-VolumesListAdminTestJSON-1892539430 None] Lock "cinder-quobyte-db0816ed-1457-4bc3-b8bf-5d7ae15836b7" released by "delete_volume" :: held 1.576s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:14:04 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-2f93bafe-6f37-4415-a634-7205bddbb3b5 tempest-VolumesListAdminTestJSON-1892539430 None] Created reservations ['cd35d33a-e78e-44d3-bc03-9249c545b0c7', '61ad43b4-1518-4505-bb99-dcb8c80a0379', '6fa3ff76-22cf-4cca-80a0-27ce7e12fbd3', '273eef47-aaef-40e8-99f0-17558ac0efce'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:14:04 devstack sudo[86955]: pam_unix(sudo:session): session closed for user root
Apr 10 13:14:04 devstack sudo[86962]: pam_unix(sudo:session): session closed for user root
Apr 10 13:14:04 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-2f93bafe-6f37-4415-a634-7205bddbb3b5 tempest-VolumesListAdminTestJSON-1892539430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:14:04 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-2f93bafe-6f37-4415-a634-7205bddbb3b5 tempest-VolumesListAdminTestJSON-1892539430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:14:04 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-2f93bafe-6f37-4415-a634-7205bddbb3b5 tempest-VolumesListAdminTestJSON-1892539430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:14:04 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-2f93bafe-6f37-4415-a634-7205bddbb3b5 tempest-VolumesListAdminTestJSON-1892539430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:14:04 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-2f93bafe-6f37-4415-a634-7205bddbb3b5 tempest-VolumesListAdminTestJSON-1892539430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:14:04 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-2f93bafe-6f37-4415-a634-7205bddbb3b5 tempest-VolumesListAdminTestJSON-1892539430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:14:04 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-c8a505cd-b6f2-4000-9520-7b1de3324efc tempest-GroupSnapshotsTest-2129977062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b61b7e77-0fac-46d3-a54b-57764b369571,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b61b7e77-0fac-46d3-a54b-57764b369571.1c1313b4-477d-4c68-a404-bcff7b536a73 1G" returned: 0 in 1.256s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:14:04 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-a536d60d-9704-4040-b28a-89057fee332f tempest-AbsoluteLimitsTests-785284212 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-782ad8f9-9e02-40eb-b909-912abbe6fe52" returned: 0 in 0.897s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:14:04 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-c8a505cd-b6f2-4000-9520-7b1de3324efc tempest-GroupSnapshotsTest-2129977062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b61b7e77-0fac-46d3-a54b-57764b369571 -F qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b61b7e77-0fac-46d3-a54b-57764b369571.1c1313b4-477d-4c68-a404-bcff7b536a73 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:14:04 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-a536d60d-9704-4040-b28a-89057fee332f tempest-AbsoluteLimitsTests-785284212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-782ad8f9-9e02-40eb-b909-912abbe6fe52 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:14:04 devstack sudo[86971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:14:04 devstack sudo[86971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:14:04 devstack sudo[86972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b61b7e77-0fac-46d3-a54b-57764b369571 -F qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b61b7e77-0fac-46d3-a54b-57764b369571.1c1313b4-477d-4c68-a404-bcff7b536a73
Apr 10 13:14:04 devstack sudo[86972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:14:04 devstack sudo[86973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-782ad8f9-9e02-40eb-b909-912abbe6fe52
Apr 10 13:14:04 devstack sudo[86973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:14:05 devstack sudo[86973]: pam_unix(sudo:session): session closed for user root
Apr 10 13:14:05 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-a536d60d-9704-4040-b28a-89057fee332f tempest-AbsoluteLimitsTests-785284212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-782ad8f9-9e02-40eb-b909-912abbe6fe52" returned: 0 in 0.780s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:14:05 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-a536d60d-9704-4040-b28a-89057fee332f tempest-AbsoluteLimitsTests-785284212 None] Lock "cinder-quobyte-782ad8f9-9e02-40eb-b909-912abbe6fe52" released by "delete_volume" :: held 1.776s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:14:05 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-a536d60d-9704-4040-b28a-89057fee332f tempest-AbsoluteLimitsTests-785284212 None] Created reservations ['8ae7f4ed-dffd-4e4a-a15e-1335e6b20599', '7f14c2c7-fdc0-4746-88d9-717392fa01c5', '1d5dc403-dba3-43ac-8109-85e68e34fb15', '6e43958e-c3bf-422a-b8a0-ac211ac83671'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:14:05 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-a536d60d-9704-4040-b28a-89057fee332f tempest-AbsoluteLimitsTests-785284212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:14:05 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-a536d60d-9704-4040-b28a-89057fee332f tempest-AbsoluteLimitsTests-785284212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:14:05 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-a536d60d-9704-4040-b28a-89057fee332f tempest-AbsoluteLimitsTests-785284212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:14:05 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-a536d60d-9704-4040-b28a-89057fee332f tempest-AbsoluteLimitsTests-785284212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:14:05 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-a536d60d-9704-4040-b28a-89057fee332f tempest-AbsoluteLimitsTests-785284212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:14:05 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-a536d60d-9704-4040-b28a-89057fee332f tempest-AbsoluteLimitsTests-785284212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:14:05 devstack sudo[86983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:14:05 devstack sudo[86983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:14:05 devstack sudo[86972]: pam_unix(sudo:session): session closed for user root
Apr 10 13:14:05 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-c8a505cd-b6f2-4000-9520-7b1de3324efc tempest-GroupSnapshotsTest-2129977062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b61b7e77-0fac-46d3-a54b-57764b369571 -F qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b61b7e77-0fac-46d3-a54b-57764b369571.1c1313b4-477d-4c68-a404-bcff7b536a73" returned: 0 in 1.078s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:14:05 devstack cinder-volume[83345]: WARNING cinder.volume.drivers.remotefs [None req-c8a505cd-b6f2-4000-9520-7b1de3324efc tempest-GroupSnapshotsTest-2129977062 None] /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b61b7e77-0fac-46d3-a54b-57764b369571.1c1313b4-477d-4c68-a404-bcff7b536a73 is being set with open permissions: ugo+rw: NotImplementedError
Apr 10 13:14:05 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-c8a505cd-b6f2-4000-9520-7b1de3324efc tempest-GroupSnapshotsTest-2129977062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b61b7e77-0fac-46d3-a54b-57764b369571.1c1313b4-477d-4c68-a404-bcff7b536a73 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:14:05 devstack sudo[86971]: pam_unix(sudo:session): session closed for user root
Apr 10 13:14:05 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-2f93bafe-6f37-4415-a634-7205bddbb3b5 tempest-VolumesListAdminTestJSON-1892539430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 1.106s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:14:05 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-2f93bafe-6f37-4415-a634-7205bddbb3b5 tempest-VolumesListAdminTestJSON-1892539430 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:14:05 devstack sudo[86985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b61b7e77-0fac-46d3-a54b-57764b369571.1c1313b4-477d-4c68-a404-bcff7b536a73
Apr 10 13:14:05 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-2f93bafe-6f37-4415-a634-7205bddbb3b5 tempest-VolumesListAdminTestJSON-1892539430 None] Deleted volume successfully.
Apr 10 13:14:05 devstack sudo[86985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:14:05 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-2f93bafe-6f37-4415-a634-7205bddbb3b5 tempest-VolumesListAdminTestJSON-1892539430 None] Lock "cinder-db0816ed-1457-4bc3-b8bf-5d7ae15836b7-delete_volume" released by "delete_volume" :: held 3.011s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:14:06 devstack sudo[86985]: pam_unix(sudo:session): session closed for user root
Apr 10 13:14:06 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-c8a505cd-b6f2-4000-9520-7b1de3324efc tempest-GroupSnapshotsTest-2129977062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b61b7e77-0fac-46d3-a54b-57764b369571.1c1313b4-477d-4c68-a404-bcff7b536a73" returned: 0 in 0.826s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:14:06 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-c8a505cd-b6f2-4000-9520-7b1de3324efc tempest-GroupSnapshotsTest-2129977062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b61b7e77-0fac-46d3-a54b-57764b369571.info {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:14:06 devstack sudo[86988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b61b7e77-0fac-46d3-a54b-57764b369571.info
Apr 10 13:14:06 devstack sudo[86988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:14:06 devstack sudo[86983]: pam_unix(sudo:session): session closed for user root
Apr 10 13:14:06 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-a536d60d-9704-4040-b28a-89057fee332f tempest-AbsoluteLimitsTests-785284212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 1.282s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:14:06 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-a536d60d-9704-4040-b28a-89057fee332f tempest-AbsoluteLimitsTests-785284212 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:14:06 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-a536d60d-9704-4040-b28a-89057fee332f tempest-AbsoluteLimitsTests-785284212 None] Deleted volume successfully.
Apr 10 13:14:06 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-a536d60d-9704-4040-b28a-89057fee332f tempest-AbsoluteLimitsTests-785284212 None] Lock "cinder-782ad8f9-9e02-40eb-b909-912abbe6fe52-delete_volume" released by "delete_volume" :: held 3.313s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:14:07 devstack sudo[86988]: pam_unix(sudo:session): session closed for user root
Apr 10 13:14:07 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-c8a505cd-b6f2-4000-9520-7b1de3324efc tempest-GroupSnapshotsTest-2129977062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b61b7e77-0fac-46d3-a54b-57764b369571.info" returned: 0 in 0.984s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:14:07 devstack cinder-volume[83345]: WARNING cinder.volume.drivers.remotefs [None req-c8a505cd-b6f2-4000-9520-7b1de3324efc tempest-GroupSnapshotsTest-2129977062 None] /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b61b7e77-0fac-46d3-a54b-57764b369571.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 10 13:14:07 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-c8a505cd-b6f2-4000-9520-7b1de3324efc tempest-GroupSnapshotsTest-2129977062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b61b7e77-0fac-46d3-a54b-57764b369571.info {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:14:07 devstack sudo[86992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b61b7e77-0fac-46d3-a54b-57764b369571.info
Apr 10 13:14:07 devstack sudo[86992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:14:07 devstack sudo[86992]: pam_unix(sudo:session): session closed for user root
Apr 10 13:14:07 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-c8a505cd-b6f2-4000-9520-7b1de3324efc tempest-GroupSnapshotsTest-2129977062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b61b7e77-0fac-46d3-a54b-57764b369571.info" returned: 0 in 0.710s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:14:08 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-c8a505cd-b6f2-4000-9520-7b1de3324efc tempest-GroupSnapshotsTest-2129977062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.631s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:14:08 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-c8a505cd-b6f2-4000-9520-7b1de3324efc tempest-GroupSnapshotsTest-2129977062 None] group_snapshot e1804800-8690-42cc-87f5-7f09238cfb70: created successfully
Apr 10 13:14:09 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-3d60eb7d-f091-4308-b918-20c56af58244 tempest-GroupSnapshotsTest-2129977062 None] group_snapshot e1804800-8690-42cc-87f5-7f09238cfb70: deleting
Apr 10 13:14:09 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-3d60eb7d-f091-4308-b918-20c56af58244 tempest-GroupSnapshotsTest-2129977062 None] group_snapshot e1804800-8690-42cc-87f5-7f09238cfb70: deleting {{(pid=83345) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 10 13:14:09 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-3d60eb7d-f091-4308-b918-20c56af58244 tempest-GroupSnapshotsTest-2129977062 None] Acquiring lock "cinder-quobyte-b61b7e77-0fac-46d3-a54b-57764b369571" by "delete_snapshot" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:14:09 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-3d60eb7d-f091-4308-b918-20c56af58244 tempest-GroupSnapshotsTest-2129977062 None] Lock "cinder-quobyte-b61b7e77-0fac-46d3-a54b-57764b369571" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:14:09 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-3d60eb7d-f091-4308-b918-20c56af58244 tempest-GroupSnapshotsTest-2129977062 None] Acquiring lock "cinder-quobyte-1c1313b4-477d-4c68-a404-bcff7b536a73" by "_delete_snapshot" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:14:09 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-3d60eb7d-f091-4308-b918-20c56af58244 tempest-GroupSnapshotsTest-2129977062 None] Lock "cinder-quobyte-1c1313b4-477d-4c68-a404-bcff7b536a73" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:14:09 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-3d60eb7d-f091-4308-b918-20c56af58244 tempest-GroupSnapshotsTest-2129977062 None] Deleting offline snapshot 1c1313b4-477d-4c68-a404-bcff7b536a73 of volume b61b7e77-0fac-46d3-a54b-57764b369571 {{(pid=83345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 10 13:14:09 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-3d60eb7d-f091-4308-b918-20c56af58244 tempest-GroupSnapshotsTest-2129977062 None] snapshot_file for this snap is: volume-b61b7e77-0fac-46d3-a54b-57764b369571.1c1313b4-477d-4c68-a404-bcff7b536a73 {{(pid=83345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 10 13:14:09 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5244005-9e6f-4bba-b39c-5705494a3043]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:14:09 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-3d60eb7d-f091-4308-b918-20c56af58244 tempest-GroupSnapshotsTest-2129977062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b61b7e77-0fac-46d3-a54b-57764b369571.1c1313b4-477d-4c68-a404-bcff7b536a73 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:14:09 devstack sudo[87022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b61b7e77-0fac-46d3-a54b-57764b369571.1c1313b4-477d-4c68-a404-bcff7b536a73
Apr 10 13:14:09 devstack sudo[87022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:14:09 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-213e4d6a-7810-46e4-bb20-6b531a0df02a tempest-SnapshotMetadataTestJSON-479550483 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:14:09 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-213e4d6a-7810-46e4-bb20-6b531a0df02a tempest-SnapshotMetadataTestJSON-479550483 None] Flow 'volume_create_manager' (cd6bcc2d-67c9-4662-a749-2cbcf846a483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:14:09 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-213e4d6a-7810-46e4-bb20-6b531a0df02a tempest-SnapshotMetadataTestJSON-479550483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f4f9d45-e4fe-48a8-80a1-ada0463ffcb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:14:09 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-213e4d6a-7810-46e4-bb20-6b531a0df02a tempest-SnapshotMetadataTestJSON-479550483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f4f9d45-e4fe-48a8-80a1-ada0463ffcb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:14:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-826100562',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a729334-95d1-4e22-991e-41a8a880864f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f444cf6041140bd9916f0ae3533b632',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:14:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:14:10Z,use_quota=True,user_id='a5531e94b21a4f80b9270c7bb4ef17d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:14:09 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-213e4d6a-7810-46e4-bb20-6b531a0df02a tempest-SnapshotMetadataTestJSON-479550483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (261b0f1d-9d21-4f55-a123-a69f034734be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:14:09 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-213e4d6a-7810-46e4-bb20-6b531a0df02a tempest-SnapshotMetadataTestJSON-479550483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (261b0f1d-9d21-4f55-a123-a69f034734be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:14:09 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-213e4d6a-7810-46e4-bb20-6b531a0df02a tempest-SnapshotMetadataTestJSON-479550483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5679bf7a-3bfb-441a-925d-14aba7612819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:14:09 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-213e4d6a-7810-46e4-bb20-6b531a0df02a tempest-SnapshotMetadataTestJSON-479550483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5679bf7a-3bfb-441a-925d-14aba7612819) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a729334-95d1-4e22-991e-41a8a880864f', 'volume_name': 'volume-0a729334-95d1-4e22-991e-41a8a880864f', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:14:09 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-213e4d6a-7810-46e4-bb20-6b531a0df02a tempest-SnapshotMetadataTestJSON-479550483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62cf31eb-f084-4101-9458-f151bc9dbb7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:14:09 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-213e4d6a-7810-46e4-bb20-6b531a0df02a tempest-SnapshotMetadataTestJSON-479550483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62cf31eb-f084-4101-9458-f151bc9dbb7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:14:09 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-213e4d6a-7810-46e4-bb20-6b531a0df02a tempest-SnapshotMetadataTestJSON-479550483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7eb9ccef-db3f-4207-ac90-e3cd98b30eb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:14:09 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-213e4d6a-7810-46e4-bb20-6b531a0df02a tempest-SnapshotMetadataTestJSON-479550483 None] Volume 0a729334-95d1-4e22-991e-41a8a880864f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a729334-95d1-4e22-991e-41a8a880864f', 'volume_size': 1}
Apr 10 13:14:09 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-213e4d6a-7810-46e4-bb20-6b531a0df02a tempest-SnapshotMetadataTestJSON-479550483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:14:09 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-213e4d6a-7810-46e4-bb20-6b531a0df02a tempest-SnapshotMetadataTestJSON-479550483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:14:09 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-213e4d6a-7810-46e4-bb20-6b531a0df02a tempest-SnapshotMetadataTestJSON-479550483 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f252bf08b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:14:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-826100562',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a729334-95d1-4e22-991e-41a8a880864f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f444cf6041140bd9916f0ae3533b632',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:14:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:14:10Z,use_quota=True,user_id='a5531e94b21a4f80b9270c7bb4ef17d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)}" {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 13:14:09 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-213e4d6a-7810-46e4-bb20-6b531a0df02a tempest-SnapshotMetadataTestJSON-479550483 None] Creating volume 0a729334-95d1-4e22-991e-41a8a880864f {{(pid=83345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 13:14:09 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-213e4d6a-7810-46e4-bb20-6b531a0df02a tempest-SnapshotMetadataTestJSON-479550483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:14:09 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-213e4d6a-7810-46e4-bb20-6b531a0df02a tempest-SnapshotMetadataTestJSON-479550483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:14:09 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-213e4d6a-7810-46e4-bb20-6b531a0df02a tempest-SnapshotMetadataTestJSON-479550483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:14:09 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-213e4d6a-7810-46e4-bb20-6b531a0df02a tempest-SnapshotMetadataTestJSON-479550483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:14:09 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-213e4d6a-7810-46e4-bb20-6b531a0df02a tempest-SnapshotMetadataTestJSON-479550483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:14:09 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-213e4d6a-7810-46e4-bb20-6b531a0df02a tempest-SnapshotMetadataTestJSON-479550483 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:14:09 devstack cinder-volume[83345]: INFO cinder.volume.drivers.remotefs [None req-213e4d6a-7810-46e4-bb20-6b531a0df02a tempest-SnapshotMetadataTestJSON-479550483 None] casted to osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331
Apr 10 13:14:09 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-213e4d6a-7810-46e4-bb20-6b531a0df02a tempest-SnapshotMetadataTestJSON-479550483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-0a729334-95d1-4e22-991e-41a8a880864f 1073741824 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:14:10 devstack sudo[87024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-0a729334-95d1-4e22-991e-41a8a880864f 1073741824
Apr 10 13:14:10 devstack sudo[87024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:14:10 devstack sudo[87022]: pam_unix(sudo:session): session closed for user root
Apr 10 13:14:10 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-3d60eb7d-f091-4308-b918-20c56af58244 tempest-GroupSnapshotsTest-2129977062 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b61b7e77-0fac-46d3-a54b-57764b369571.1c1313b4-477d-4c68-a404-bcff7b536a73" returned: 0 in 0.681s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:14:10 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-3d60eb7d-f091-4308-b918-20c56af58244 tempest-GroupSnapshotsTest-2129977062 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b61b7e77-0fac-46d3-a54b-57764b369571(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 13:14:10 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[b83f0628-6800-4ec3-a1e1-2c5880569007]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:14:10 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-3d60eb7d-f091-4308-b918-20c56af58244 tempest-GroupSnapshotsTest-2129977062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b61b7e77-0fac-46d3-a54b-57764b369571 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:14:10 devstack sudo[87035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b61b7e77-0fac-46d3-a54b-57764b369571
Apr 10 13:14:10 devstack sudo[87035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:14:11 devstack sudo[87024]: pam_unix(sudo:session): session closed for user root
Apr 10 13:14:11 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-213e4d6a-7810-46e4-bb20-6b531a0df02a tempest-SnapshotMetadataTestJSON-479550483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-0a729334-95d1-4e22-991e-41a8a880864f 1073741824" returned: 0 in 1.040s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:14:11 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-213e4d6a-7810-46e4-bb20-6b531a0df02a tempest-SnapshotMetadataTestJSON-479550483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-0a729334-95d1-4e22-991e-41a8a880864f {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:14:11 devstack sudo[87035]: pam_unix(sudo:session): session closed for user root
Apr 10 13:14:11 devstack sudo[87054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-0a729334-95d1-4e22-991e-41a8a880864f
Apr 10 13:14:11 devstack sudo[87054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:14:11 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-3d60eb7d-f091-4308-b918-20c56af58244 tempest-GroupSnapshotsTest-2129977062 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b61b7e77-0fac-46d3-a54b-57764b369571" returned: 0 in 0.846s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:14:11 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-3d60eb7d-f091-4308-b918-20c56af58244 tempest-GroupSnapshotsTest-2129977062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b61b7e77-0fac-46d3-a54b-57764b369571.1c1313b4-477d-4c68-a404-bcff7b536a73 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:14:11 devstack sudo[87058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b61b7e77-0fac-46d3-a54b-57764b369571.1c1313b4-477d-4c68-a404-bcff7b536a73
Apr 10 13:14:11 devstack sudo[87058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:14:11 devstack sudo[87054]: pam_unix(sudo:session): session closed for user root
Apr 10 13:14:11 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-213e4d6a-7810-46e4-bb20-6b531a0df02a tempest-SnapshotMetadataTestJSON-479550483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-0a729334-95d1-4e22-991e-41a8a880864f" returned: 0 in 0.616s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:14:11 devstack sudo[87058]: pam_unix(sudo:session): session closed for user root
Apr 10 13:14:11 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-213e4d6a-7810-46e4-bb20-6b531a0df02a tempest-SnapshotMetadataTestJSON-479550483 None] <== create_volume: return (1701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'} {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 13:14:11 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-213e4d6a-7810-46e4-bb20-6b531a0df02a tempest-SnapshotMetadataTestJSON-479550483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.706s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:14:11 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-3d60eb7d-f091-4308-b918-20c56af58244 tempest-GroupSnapshotsTest-2129977062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b61b7e77-0fac-46d3-a54b-57764b369571.1c1313b4-477d-4c68-a404-bcff7b536a73" returned: 0 in 0.589s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:14:11 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-3d60eb7d-f091-4308-b918-20c56af58244 tempest-GroupSnapshotsTest-2129977062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b61b7e77-0fac-46d3-a54b-57764b369571.1c1313b4-477d-4c68-a404-bcff7b536a73 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:14:11 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-213e4d6a-7810-46e4-bb20-6b531a0df02a tempest-SnapshotMetadataTestJSON-479550483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7eb9ccef-db3f-4207-ac90-e3cd98b30eb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a729334-95d1-4e22-991e-41a8a880864f', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:14:11 devstack sudo[87066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b61b7e77-0fac-46d3-a54b-57764b369571.1c1313b4-477d-4c68-a404-bcff7b536a73
Apr 10 13:14:11 devstack sudo[87066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:14:11 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-213e4d6a-7810-46e4-bb20-6b531a0df02a tempest-SnapshotMetadataTestJSON-479550483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23919b65-def0-4295-8b5b-82adb8fd4944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:14:11 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-213e4d6a-7810-46e4-bb20-6b531a0df02a tempest-SnapshotMetadataTestJSON-479550483 None] Volume volume-0a729334-95d1-4e22-991e-41a8a880864f (0a729334-95d1-4e22-991e-41a8a880864f): created successfully
Apr 10 13:14:11 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-213e4d6a-7810-46e4-bb20-6b531a0df02a tempest-SnapshotMetadataTestJSON-479550483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23919b65-def0-4295-8b5b-82adb8fd4944) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:14:11 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-213e4d6a-7810-46e4-bb20-6b531a0df02a tempest-SnapshotMetadataTestJSON-479550483 None] Flow 'volume_create_manager' (cd6bcc2d-67c9-4662-a749-2cbcf846a483) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:14:11 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-213e4d6a-7810-46e4-bb20-6b531a0df02a tempest-SnapshotMetadataTestJSON-479550483 None] Created volume successfully.
Apr 10 13:14:12 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-c257b1c2-72c5-47c3-84df-decd90e295ab tempest-SnapshotMetadataTestJSON-479550483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:14:12 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-c257b1c2-72c5-47c3-84df-decd90e295ab tempest-SnapshotMetadataTestJSON-479550483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:14:12 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-c257b1c2-72c5-47c3-84df-decd90e295ab tempest-SnapshotMetadataTestJSON-479550483 None] Creating offline snapshot 50eb4bcc-2adc-4cfe-9df4-bb5159e3b50f of volume 0a729334-95d1-4e22-991e-41a8a880864f {{(pid=83345) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 10 13:14:12 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[16a7c0da-7a38-4104-a859-770383f625ad]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:14:12 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-c257b1c2-72c5-47c3-84df-decd90e295ab tempest-SnapshotMetadataTestJSON-479550483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-0a729334-95d1-4e22-991e-41a8a880864f {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:14:12 devstack sudo[87066]: pam_unix(sudo:session): session closed for user root
Apr 10 13:14:12 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-3d60eb7d-f091-4308-b918-20c56af58244 tempest-GroupSnapshotsTest-2129977062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b61b7e77-0fac-46d3-a54b-57764b369571.1c1313b4-477d-4c68-a404-bcff7b536a73" returned: 0 in 0.640s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:14:12 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-3d60eb7d-f091-4308-b918-20c56af58244 tempest-GroupSnapshotsTest-2129977062 None] Lock "cinder-quobyte-1c1313b4-477d-4c68-a404-bcff7b536a73" released by "_delete_snapshot" :: held 2.817s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:14:12 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-3d60eb7d-f091-4308-b918-20c56af58244 tempest-GroupSnapshotsTest-2129977062 None] Lock "cinder-quobyte-b61b7e77-0fac-46d3-a54b-57764b369571" released by "delete_snapshot" :: held 2.841s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:14:12 devstack cinder-volume[83345]: WARNING cinder.quota [None req-3d60eb7d-f091-4308-b918-20c56af58244 tempest-GroupSnapshotsTest-2129977062 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2142788809 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2142788809, it is now deprecated. Please use the default quota class for default quota.
Apr 10 13:14:12 devstack cinder-volume[83345]: WARNING cinder.quota [None req-3d60eb7d-f091-4308-b918-20c56af58244 tempest-GroupSnapshotsTest-2129977062 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2142788809 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2142788809, it is now deprecated. Please use the default quota class for default quota.
Apr 10 13:14:12 devstack sudo[87070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-0a729334-95d1-4e22-991e-41a8a880864f
Apr 10 13:14:12 devstack sudo[87070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:14:12 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-3d60eb7d-f091-4308-b918-20c56af58244 tempest-GroupSnapshotsTest-2129977062 None] Created reservations ['25d13863-ae84-4de1-ad2e-b14ae3a061bd', '967913dc-94e8-4cfc-9281-c8c91ae1e54a', 'd358ac6b-12ed-459b-8e7d-51d3f70b93e8', '0f1f67cc-5fc4-4655-9cd2-fa750bb1ea25'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:14:12 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-3d60eb7d-f091-4308-b918-20c56af58244 tempest-GroupSnapshotsTest-2129977062 None] group_snapshot e1804800-8690-42cc-87f5-7f09238cfb70: deleted successfully
Apr 10 13:14:12 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-afb295d3-5ecb-4e58-a44e-434aab44306f tempest-GroupSnapshotsTest-2129977062 None] Acquiring lock "cinder-quobyte-b61b7e77-0fac-46d3-a54b-57764b369571" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:14:12 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-afb295d3-5ecb-4e58-a44e-434aab44306f tempest-GroupSnapshotsTest-2129977062 None] Lock "cinder-quobyte-b61b7e77-0fac-46d3-a54b-57764b369571" acquired by "delete_volume" :: waited 0.016s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:14:12 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ecf1ed1-5c09-4c2c-bc14-43d1ae10230b]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:14:12 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-afb295d3-5ecb-4e58-a44e-434aab44306f tempest-GroupSnapshotsTest-2129977062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b61b7e77-0fac-46d3-a54b-57764b369571 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:14:13 devstack sudo[87070]: pam_unix(sudo:session): session closed for user root
Apr 10 13:14:13 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-c257b1c2-72c5-47c3-84df-decd90e295ab tempest-SnapshotMetadataTestJSON-479550483 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-0a729334-95d1-4e22-991e-41a8a880864f" returned: 0 in 0.728s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:14:13 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-c257b1c2-72c5-47c3-84df-decd90e295ab tempest-SnapshotMetadataTestJSON-479550483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-0a729334-95d1-4e22-991e-41a8a880864f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-0a729334-95d1-4e22-991e-41a8a880864f.50eb4bcc-2adc-4cfe-9df4-bb5159e3b50f 1G {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:14:13 devstack sudo[87076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-0a729334-95d1-4e22-991e-41a8a880864f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-0a729334-95d1-4e22-991e-41a8a880864f.50eb4bcc-2adc-4cfe-9df4-bb5159e3b50f 1G
Apr 10 13:14:13 devstack sudo[87076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:14:13 devstack sudo[87075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b61b7e77-0fac-46d3-a54b-57764b369571
Apr 10 13:14:13 devstack sudo[87075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:14:13 devstack sudo[87075]: pam_unix(sudo:session): session closed for user root
Apr 10 13:14:13 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-afb295d3-5ecb-4e58-a44e-434aab44306f tempest-GroupSnapshotsTest-2129977062 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b61b7e77-0fac-46d3-a54b-57764b369571" returned: 0 in 0.612s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:14:13 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-afb295d3-5ecb-4e58-a44e-434aab44306f tempest-GroupSnapshotsTest-2129977062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b61b7e77-0fac-46d3-a54b-57764b369571 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:14:13 devstack sudo[87084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b61b7e77-0fac-46d3-a54b-57764b369571
Apr 10 13:14:13 devstack sudo[87084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:14:13 devstack sudo[87076]: pam_unix(sudo:session): session closed for user root
Apr 10 13:14:13 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-c257b1c2-72c5-47c3-84df-decd90e295ab tempest-SnapshotMetadataTestJSON-479550483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-0a729334-95d1-4e22-991e-41a8a880864f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-0a729334-95d1-4e22-991e-41a8a880864f.50eb4bcc-2adc-4cfe-9df4-bb5159e3b50f 1G" returned: 0 in 0.784s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:14:13 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-c257b1c2-72c5-47c3-84df-decd90e295ab tempest-SnapshotMetadataTestJSON-479550483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a729334-95d1-4e22-991e-41a8a880864f -F qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-0a729334-95d1-4e22-991e-41a8a880864f.50eb4bcc-2adc-4cfe-9df4-bb5159e3b50f {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:14:13 devstack sudo[87088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a729334-95d1-4e22-991e-41a8a880864f -F qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-0a729334-95d1-4e22-991e-41a8a880864f.50eb4bcc-2adc-4cfe-9df4-bb5159e3b50f
Apr 10 13:14:13 devstack sudo[87088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:14:14 devstack sudo[87084]: pam_unix(sudo:session): session closed for user root
Apr 10 13:14:14 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-afb295d3-5ecb-4e58-a44e-434aab44306f tempest-GroupSnapshotsTest-2129977062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b61b7e77-0fac-46d3-a54b-57764b369571" returned: 0 in 0.743s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:14:14 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-afb295d3-5ecb-4e58-a44e-434aab44306f tempest-GroupSnapshotsTest-2129977062 None] Lock "cinder-quobyte-b61b7e77-0fac-46d3-a54b-57764b369571" released by "delete_volume" :: held 1.422s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:14:14 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-afb295d3-5ecb-4e58-a44e-434aab44306f tempest-GroupSnapshotsTest-2129977062 None] Created reservations ['a530e84f-ce0e-471e-8a0d-70abddb14ed7'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:14:14 devstack cinder-volume[83345]: WARNING cinder.quota [None req-afb295d3-5ecb-4e58-a44e-434aab44306f tempest-GroupSnapshotsTest-2129977062 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2142788809 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2142788809, it is now deprecated. Please use the default quota class for default quota.
Apr 10 13:14:14 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-afb295d3-5ecb-4e58-a44e-434aab44306f tempest-GroupSnapshotsTest-2129977062 None] Created reservations ['f093f233-e513-4e98-bad1-71fa6152a63f', '5f5a5baf-229f-434f-9fde-8262759cab91', 'dfe27f17-7520-4f05-b987-b2b50b25c8f0', 'd40fdcf1-33b6-4c32-b72b-92982f842cce'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:14:14 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-afb295d3-5ecb-4e58-a44e-434aab44306f tempest-GroupSnapshotsTest-2129977062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:14:14 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-afb295d3-5ecb-4e58-a44e-434aab44306f tempest-GroupSnapshotsTest-2129977062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:14:14 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-afb295d3-5ecb-4e58-a44e-434aab44306f tempest-GroupSnapshotsTest-2129977062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:14:14 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-afb295d3-5ecb-4e58-a44e-434aab44306f tempest-GroupSnapshotsTest-2129977062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:14:14 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-afb295d3-5ecb-4e58-a44e-434aab44306f tempest-GroupSnapshotsTest-2129977062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:14:14 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-afb295d3-5ecb-4e58-a44e-434aab44306f tempest-GroupSnapshotsTest-2129977062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:14:14 devstack sudo[87117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:14:14 devstack sudo[87117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:14:15 devstack sudo[87088]: pam_unix(sudo:session): session closed for user root
Apr 10 13:14:15 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-c257b1c2-72c5-47c3-84df-decd90e295ab tempest-SnapshotMetadataTestJSON-479550483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a729334-95d1-4e22-991e-41a8a880864f -F qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-0a729334-95d1-4e22-991e-41a8a880864f.50eb4bcc-2adc-4cfe-9df4-bb5159e3b50f" returned: 0 in 1.268s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:14:15 devstack cinder-volume[83345]: WARNING cinder.volume.drivers.remotefs [None req-c257b1c2-72c5-47c3-84df-decd90e295ab tempest-SnapshotMetadataTestJSON-479550483 None] /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-0a729334-95d1-4e22-991e-41a8a880864f.50eb4bcc-2adc-4cfe-9df4-bb5159e3b50f is being set with open permissions: ugo+rw
Apr 10 13:14:15 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-c257b1c2-72c5-47c3-84df-decd90e295ab tempest-SnapshotMetadataTestJSON-479550483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-0a729334-95d1-4e22-991e-41a8a880864f.50eb4bcc-2adc-4cfe-9df4-bb5159e3b50f {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:14:15 devstack sudo[87122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-0a729334-95d1-4e22-991e-41a8a880864f.50eb4bcc-2adc-4cfe-9df4-bb5159e3b50f
Apr 10 13:14:15 devstack sudo[87122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:14:15 devstack sudo[87117]: pam_unix(sudo:session): session closed for user root
Apr 10 13:14:15 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-afb295d3-5ecb-4e58-a44e-434aab44306f tempest-GroupSnapshotsTest-2129977062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 1.131s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:14:15 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-afb295d3-5ecb-4e58-a44e-434aab44306f tempest-GroupSnapshotsTest-2129977062 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:14:15 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-afb295d3-5ecb-4e58-a44e-434aab44306f tempest-GroupSnapshotsTest-2129977062 None] Delete group completed successfully.
Apr 10 13:14:16 devstack sudo[87122]: pam_unix(sudo:session): session closed for user root
Apr 10 13:14:16 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-c257b1c2-72c5-47c3-84df-decd90e295ab tempest-SnapshotMetadataTestJSON-479550483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-0a729334-95d1-4e22-991e-41a8a880864f.50eb4bcc-2adc-4cfe-9df4-bb5159e3b50f" returned: 0 in 1.070s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:14:16 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-c257b1c2-72c5-47c3-84df-decd90e295ab tempest-SnapshotMetadataTestJSON-479550483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-0a729334-95d1-4e22-991e-41a8a880864f.info {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:14:16 devstack sudo[87126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-0a729334-95d1-4e22-991e-41a8a880864f.info
Apr 10 13:14:16 devstack sudo[87126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:14:17 devstack sudo[87126]: pam_unix(sudo:session): session closed for user root
Apr 10 13:14:17 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-c257b1c2-72c5-47c3-84df-decd90e295ab tempest-SnapshotMetadataTestJSON-479550483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-0a729334-95d1-4e22-991e-41a8a880864f.info" returned: 0 in 0.905s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:14:17 devstack cinder-volume[83345]: WARNING cinder.volume.drivers.remotefs [None req-c257b1c2-72c5-47c3-84df-decd90e295ab tempest-SnapshotMetadataTestJSON-479550483 None] /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-0a729334-95d1-4e22-991e-41a8a880864f.info is being set with open permissions: ugo+rw
Apr 10 13:14:17 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-c257b1c2-72c5-47c3-84df-decd90e295ab tempest-SnapshotMetadataTestJSON-479550483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-0a729334-95d1-4e22-991e-41a8a880864f.info {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:14:17 devstack sudo[87130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-0a729334-95d1-4e22-991e-41a8a880864f.info
Apr 10 13:14:17 devstack sudo[87130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:14:18 devstack sudo[87130]: pam_unix(sudo:session): session closed for user root
Apr 10 13:14:18 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-c257b1c2-72c5-47c3-84df-decd90e295ab tempest-SnapshotMetadataTestJSON-479550483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-0a729334-95d1-4e22-991e-41a8a880864f.info" returned: 0 in 1.076s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:14:18 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-c257b1c2-72c5-47c3-84df-decd90e295ab tempest-SnapshotMetadataTestJSON-479550483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.960s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:14:18 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-c257b1c2-72c5-47c3-84df-decd90e295ab tempest-SnapshotMetadataTestJSON-479550483 None] Create snapshot completed successfully
Apr 10 13:14:18 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-2121c030-3a87-4214-b77b-95be1294c19d tempest-ServerRescueNegativeTestJSON-2073982593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:14:18 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-2121c030-3a87-4214-b77b-95be1294c19d tempest-ServerRescueNegativeTestJSON-2073982593 None] Flow 'volume_create_manager' (833211c0-7d8e-4754-864c-9192433a5d49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:14:18 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-2121c030-3a87-4214-b77b-95be1294c19d tempest-ServerRescueNegativeTestJSON-2073982593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9a8258f-4ad6-4a96-8c9c-3d2027d20cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:14:18 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-2121c030-3a87-4214-b77b-95be1294c19d tempest-ServerRescueNegativeTestJSON-2073982593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9a8258f-4ad6-4a96-8c9c-3d2027d20cba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:14:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-16489897',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71a5e2b7-d1f9-4d1b-b3bb-fa148933b5c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73199536cef84dc6aa31dd14e7b6f3b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:14:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:14:18Z,use_quota=True,user_id='cda47341771447b2813bfce203f395ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:14:18 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-2121c030-3a87-4214-b77b-95be1294c19d tempest-ServerRescueNegativeTestJSON-2073982593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b95bc6e6-1cbc-49bc-956a-8cd697fc6b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:14:18 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-2121c030-3a87-4214-b77b-95be1294c19d tempest-ServerRescueNegativeTestJSON-2073982593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b95bc6e6-1cbc-49bc-956a-8cd697fc6b28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:14:18 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-2121c030-3a87-4214-b77b-95be1294c19d tempest-ServerRescueNegativeTestJSON-2073982593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46217319-19ca-4429-8463-8015d62ccd1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:14:18 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-2121c030-3a87-4214-b77b-95be1294c19d tempest-ServerRescueNegativeTestJSON-2073982593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46217319-19ca-4429-8463-8015d62ccd1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71a5e2b7-d1f9-4d1b-b3bb-fa148933b5c6', 'volume_name': 'volume-71a5e2b7-d1f9-4d1b-b3bb-fa148933b5c6', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:14:18 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-2121c030-3a87-4214-b77b-95be1294c19d tempest-ServerRescueNegativeTestJSON-2073982593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5b4c21f-3336-4ae9-96de-f46c511ec9aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:14:18 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-2121c030-3a87-4214-b77b-95be1294c19d tempest-ServerRescueNegativeTestJSON-2073982593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5b4c21f-3336-4ae9-96de-f46c511ec9aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:14:18 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-2121c030-3a87-4214-b77b-95be1294c19d tempest-ServerRescueNegativeTestJSON-2073982593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be29ce5e-4535-4c0f-b027-8416771f4994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:14:18 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-2121c030-3a87-4214-b77b-95be1294c19d tempest-ServerRescueNegativeTestJSON-2073982593 None] Volume 71a5e2b7-d1f9-4d1b-b3bb-fa148933b5c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71a5e2b7-d1f9-4d1b-b3bb-fa148933b5c6', 'volume_size': 1}
Apr 10 13:14:18 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-2121c030-3a87-4214-b77b-95be1294c19d tempest-ServerRescueNegativeTestJSON-2073982593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:14:18 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-2121c030-3a87-4214-b77b-95be1294c19d tempest-ServerRescueNegativeTestJSON-2073982593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:14:18 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-2121c030-3a87-4214-b77b-95be1294c19d tempest-ServerRescueNegativeTestJSON-2073982593 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f252bf08b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:14:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-16489897',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71a5e2b7-d1f9-4d1b-b3bb-fa148933b5c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73199536cef84dc6aa31dd14e7b6f3b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:14:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:14:18Z,use_quota=True,user_id='cda47341771447b2813bfce203f395ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)}" {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 13:14:18 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-2121c030-3a87-4214-b77b-95be1294c19d tempest-ServerRescueNegativeTestJSON-2073982593 None] Creating volume 71a5e2b7-d1f9-4d1b-b3bb-fa148933b5c6 {{(pid=83345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 13:14:18 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-2121c030-3a87-4214-b77b-95be1294c19d tempest-ServerRescueNegativeTestJSON-2073982593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:14:18 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-2121c030-3a87-4214-b77b-95be1294c19d tempest-ServerRescueNegativeTestJSON-2073982593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:14:18 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-2121c030-3a87-4214-b77b-95be1294c19d tempest-ServerRescueNegativeTestJSON-2073982593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:14:18 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-2121c030-3a87-4214-b77b-95be1294c19d tempest-ServerRescueNegativeTestJSON-2073982593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:14:18 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-2121c030-3a87-4214-b77b-95be1294c19d tempest-ServerRescueNegativeTestJSON-2073982593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:14:18 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-2121c030-3a87-4214-b77b-95be1294c19d tempest-ServerRescueNegativeTestJSON-2073982593 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:14:18 devstack cinder-volume[83345]: INFO cinder.volume.drivers.remotefs [None req-2121c030-3a87-4214-b77b-95be1294c19d tempest-ServerRescueNegativeTestJSON-2073982593 None] casted to osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331
Apr 10 13:14:18 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-2121c030-3a87-4214-b77b-95be1294c19d tempest-ServerRescueNegativeTestJSON-2073982593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-71a5e2b7-d1f9-4d1b-b3bb-fa148933b5c6 1073741824 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:14:18 devstack sudo[87136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-71a5e2b7-d1f9-4d1b-b3bb-fa148933b5c6 1073741824
Apr 10 13:14:18 devstack sudo[87136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:14:19 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-e6320a86-dac0-492b-b9db-ab0b0e55bd11 tempest-SnapshotMetadataTestJSON-479550483 None] Acquiring lock "cinder-50eb4bcc-2adc-4cfe-9df4-bb5159e3b50f-delete_snapshot" by "delete_snapshot" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:14:19 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-e6320a86-dac0-492b-b9db-ab0b0e55bd11 tempest-SnapshotMetadataTestJSON-479550483 None] Lock "cinder-50eb4bcc-2adc-4cfe-9df4-bb5159e3b50f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:14:19 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-e6320a86-dac0-492b-b9db-ab0b0e55bd11 tempest-SnapshotMetadataTestJSON-479550483 None] Acquiring lock "cinder-quobyte-0a729334-95d1-4e22-991e-41a8a880864f" by "delete_snapshot" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:14:19 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-e6320a86-dac0-492b-b9db-ab0b0e55bd11 tempest-SnapshotMetadataTestJSON-479550483 None] Lock "cinder-quobyte-0a729334-95d1-4e22-991e-41a8a880864f" acquired by "delete_snapshot" :: waited 0.039s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:14:19 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-e6320a86-dac0-492b-b9db-ab0b0e55bd11 tempest-SnapshotMetadataTestJSON-479550483 None] Acquiring lock "cinder-quobyte-50eb4bcc-2adc-4cfe-9df4-bb5159e3b50f" by "_delete_snapshot" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:14:19 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-e6320a86-dac0-492b-b9db-ab0b0e55bd11 tempest-SnapshotMetadataTestJSON-479550483 None] Lock "cinder-quobyte-50eb4bcc-2adc-4cfe-9df4-bb5159e3b50f" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:14:19 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-e6320a86-dac0-492b-b9db-ab0b0e55bd11 tempest-SnapshotMetadataTestJSON-479550483 None] Deleting offline snapshot 50eb4bcc-2adc-4cfe-9df4-bb5159e3b50f of volume 0a729334-95d1-4e22-991e-41a8a880864f {{(pid=83345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 10 13:14:19 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-e6320a86-dac0-492b-b9db-ab0b0e55bd11 tempest-SnapshotMetadataTestJSON-479550483 None] snapshot_file for this snap is: volume-0a729334-95d1-4e22-991e-41a8a880864f.50eb4bcc-2adc-4cfe-9df4-bb5159e3b50f {{(pid=83345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 10 13:14:19 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[91f363a2-36e6-4cf8-895d-b62a83574158]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:14:19 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-e6320a86-dac0-492b-b9db-ab0b0e55bd11 tempest-SnapshotMetadataTestJSON-479550483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-0a729334-95d1-4e22-991e-41a8a880864f.50eb4bcc-2adc-4cfe-9df4-bb5159e3b50f {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:14:20 devstack sudo[87151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-0a729334-95d1-4e22-991e-41a8a880864f.50eb4bcc-2adc-4cfe-9df4-bb5159e3b50f
Apr 10 13:14:20 devstack sudo[87151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:14:20 devstack sudo[87136]: pam_unix(sudo:session): session closed for user root
Apr 10 13:14:20 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-2121c030-3a87-4214-b77b-95be1294c19d tempest-ServerRescueNegativeTestJSON-2073982593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-71a5e2b7-d1f9-4d1b-b3bb-fa148933b5c6 1073741824" returned: 0 in 1.742s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:14:20 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-2121c030-3a87-4214-b77b-95be1294c19d tempest-ServerRescueNegativeTestJSON-2073982593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-71a5e2b7-d1f9-4d1b-b3bb-fa148933b5c6 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:14:20 devstack sudo[87153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-71a5e2b7-d1f9-4d1b-b3bb-fa148933b5c6
Apr 10 13:14:20 devstack sudo[87153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:14:21 devstack sudo[87153]: pam_unix(sudo:session): session closed for user root
Apr 10 13:14:21 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-2121c030-3a87-4214-b77b-95be1294c19d tempest-ServerRescueNegativeTestJSON-2073982593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-71a5e2b7-d1f9-4d1b-b3bb-fa148933b5c6" returned: 0 in 0.991s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:14:21 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-2121c030-3a87-4214-b77b-95be1294c19d tempest-ServerRescueNegativeTestJSON-2073982593 None] <== create_volume: return (2808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'} {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 13:14:21 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-2121c030-3a87-4214-b77b-95be1294c19d tempest-ServerRescueNegativeTestJSON-2073982593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.813s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:14:21 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-2121c030-3a87-4214-b77b-95be1294c19d tempest-ServerRescueNegativeTestJSON-2073982593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be29ce5e-4535-4c0f-b027-8416771f4994) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71a5e2b7-d1f9-4d1b-b3bb-fa148933b5c6', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:14:21 devstack sudo[87151]: pam_unix(sudo:session): session closed for user root
Apr 10 13:14:21 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-2121c030-3a87-4214-b77b-95be1294c19d tempest-ServerRescueNegativeTestJSON-2073982593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c16f8b54-cedf-4315-821d-876751e6a69b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:14:21 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-e6320a86-dac0-492b-b9db-ab0b0e55bd11 tempest-SnapshotMetadataTestJSON-479550483 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-0a729334-95d1-4e22-991e-41a8a880864f.50eb4bcc-2adc-4cfe-9df4-bb5159e3b50f" returned: 0 in 1.537s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:14:21 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-e6320a86-dac0-492b-b9db-ab0b0e55bd11 tempest-SnapshotMetadataTestJSON-479550483 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a729334-95d1-4e22-991e-41a8a880864f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 13:14:21 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-2121c030-3a87-4214-b77b-95be1294c19d tempest-ServerRescueNegativeTestJSON-2073982593 None] Volume volume-71a5e2b7-d1f9-4d1b-b3bb-fa148933b5c6 (71a5e2b7-d1f9-4d1b-b3bb-fa148933b5c6): created successfully
Apr 10 13:14:21 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-2121c030-3a87-4214-b77b-95be1294c19d tempest-ServerRescueNegativeTestJSON-2073982593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c16f8b54-cedf-4315-821d-876751e6a69b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:14:21 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-2121c030-3a87-4214-b77b-95be1294c19d tempest-ServerRescueNegativeTestJSON-2073982593 None] Flow 'volume_create_manager' (833211c0-7d8e-4754-864c-9192433a5d49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:14:21 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7aa9c34-d1db-46c1-bd46-48d4052f5aa1]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:14:21 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-e6320a86-dac0-492b-b9db-ab0b0e55bd11 tempest-SnapshotMetadataTestJSON-479550483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-0a729334-95d1-4e22-991e-41a8a880864f {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:14:21 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-2121c030-3a87-4214-b77b-95be1294c19d tempest-ServerRescueNegativeTestJSON-2073982593 None] Created volume successfully.
Apr 10 13:14:21 devstack sudo[87190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-0a729334-95d1-4e22-991e-41a8a880864f
Apr 10 13:14:21 devstack sudo[87190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:14:22 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-623d555e-802f-48cc-a9d3-9d6a758c9eca tempest-VolumesActionsTest-353155709 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:14:22 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-623d555e-802f-48cc-a9d3-9d6a758c9eca tempest-VolumesActionsTest-353155709 None] Flow 'volume_create_manager' (d8e480f9-b0c1-4e73-af8b-3d8b151d4f41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:14:22 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-623d555e-802f-48cc-a9d3-9d6a758c9eca tempest-VolumesActionsTest-353155709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de1b8f1b-4e62-459c-bbb8-4a8c215cc0d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:14:22 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-623d555e-802f-48cc-a9d3-9d6a758c9eca tempest-VolumesActionsTest-353155709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de1b8f1b-4e62-459c-bbb8-4a8c215cc0d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:14:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-419088962',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99a2ad7b-89ba-4314-8b09-0871e97a3712,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='639a5912675e4a76a1cb73f7b3af9760',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:14:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:14:22Z,use_quota=True,user_id='47100375f7e24d87aa353ce039244389',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:14:22 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-623d555e-802f-48cc-a9d3-9d6a758c9eca tempest-VolumesActionsTest-353155709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b705d10d-e295-473b-99f7-cbea21b4a503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:14:22 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-623d555e-802f-48cc-a9d3-9d6a758c9eca tempest-VolumesActionsTest-353155709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b705d10d-e295-473b-99f7-cbea21b4a503) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:14:22 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-623d555e-802f-48cc-a9d3-9d6a758c9eca tempest-VolumesActionsTest-353155709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (475d8e0a-e216-458f-b71d-05c371e80b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:14:22 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-623d555e-802f-48cc-a9d3-9d6a758c9eca tempest-VolumesActionsTest-353155709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (475d8e0a-e216-458f-b71d-05c371e80b56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99a2ad7b-89ba-4314-8b09-0871e97a3712', 'volume_name': 'volume-99a2ad7b-89ba-4314-8b09-0871e97a3712', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:14:22 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-623d555e-802f-48cc-a9d3-9d6a758c9eca tempest-VolumesActionsTest-353155709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59aa1a46-0cda-4ba3-9026-81f9620c4012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:14:22 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-623d555e-802f-48cc-a9d3-9d6a758c9eca tempest-VolumesActionsTest-353155709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59aa1a46-0cda-4ba3-9026-81f9620c4012) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:14:22 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-623d555e-802f-48cc-a9d3-9d6a758c9eca tempest-VolumesActionsTest-353155709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c50c698-631e-4063-9316-7e9b1475898f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:14:22 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-623d555e-802f-48cc-a9d3-9d6a758c9eca tempest-VolumesActionsTest-353155709 None] Volume 99a2ad7b-89ba-4314-8b09-0871e97a3712: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99a2ad7b-89ba-4314-8b09-0871e97a3712', 'volume_size': 1}
Apr 10 13:14:22 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-623d555e-802f-48cc-a9d3-9d6a758c9eca tempest-VolumesActionsTest-353155709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:14:22 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-623d555e-802f-48cc-a9d3-9d6a758c9eca tempest-VolumesActionsTest-353155709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:14:22 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-623d555e-802f-48cc-a9d3-9d6a758c9eca tempest-VolumesActionsTest-353155709 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f252bf08b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:14:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-419088962',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99a2ad7b-89ba-4314-8b09-0871e97a3712,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='639a5912675e4a76a1cb73f7b3af9760',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:14:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:14:22Z,use_quota=True,user_id='47100375f7e24d87aa353ce039244389',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)}" {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 13:14:22 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-623d555e-802f-48cc-a9d3-9d6a758c9eca tempest-VolumesActionsTest-353155709 None] Creating volume 99a2ad7b-89ba-4314-8b09-0871e97a3712 {{(pid=83345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 13:14:22 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-623d555e-802f-48cc-a9d3-9d6a758c9eca tempest-VolumesActionsTest-353155709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:14:22 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-623d555e-802f-48cc-a9d3-9d6a758c9eca tempest-VolumesActionsTest-353155709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:14:22 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-623d555e-802f-48cc-a9d3-9d6a758c9eca tempest-VolumesActionsTest-353155709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:14:22 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-623d555e-802f-48cc-a9d3-9d6a758c9eca tempest-VolumesActionsTest-353155709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:14:22 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-623d555e-802f-48cc-a9d3-9d6a758c9eca tempest-VolumesActionsTest-353155709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:14:22 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-623d555e-802f-48cc-a9d3-9d6a758c9eca tempest-VolumesActionsTest-353155709 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:14:22 devstack cinder-volume[83345]: INFO cinder.volume.drivers.remotefs [None req-623d555e-802f-48cc-a9d3-9d6a758c9eca tempest-VolumesActionsTest-353155709 None] casted to osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331
Apr 10 13:14:22 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-623d555e-802f-48cc-a9d3-9d6a758c9eca tempest-VolumesActionsTest-353155709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-99a2ad7b-89ba-4314-8b09-0871e97a3712 1073741824 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:14:22 devstack sudo[87194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-99a2ad7b-89ba-4314-8b09-0871e97a3712 1073741824
Apr 10 13:14:22 devstack sudo[87194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:14:22 devstack sudo[87190]: pam_unix(sudo:session): session closed for user root
Apr 10 13:14:22 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-e6320a86-dac0-492b-b9db-ab0b0e55bd11 tempest-SnapshotMetadataTestJSON-479550483 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-0a729334-95d1-4e22-991e-41a8a880864f" returned: 0 in 0.873s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:14:22 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-e6320a86-dac0-492b-b9db-ab0b0e55bd11 tempest-SnapshotMetadataTestJSON-479550483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-0a729334-95d1-4e22-991e-41a8a880864f.50eb4bcc-2adc-4cfe-9df4-bb5159e3b50f {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:14:22 devstack sudo[87197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-0a729334-95d1-4e22-991e-41a8a880864f.50eb4bcc-2adc-4cfe-9df4-bb5159e3b50f
Apr 10 13:14:22 devstack sudo[87197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:14:23 devstack sudo[87194]: pam_unix(sudo:session): session closed for user root
Apr 10 13:14:23 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-623d555e-802f-48cc-a9d3-9d6a758c9eca tempest-VolumesActionsTest-353155709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-99a2ad7b-89ba-4314-8b09-0871e97a3712 1073741824" returned: 0 in 0.829s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:14:23 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-623d555e-802f-48cc-a9d3-9d6a758c9eca tempest-VolumesActionsTest-353155709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-99a2ad7b-89ba-4314-8b09-0871e97a3712 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:14:23 devstack sudo[87206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-99a2ad7b-89ba-4314-8b09-0871e97a3712
Apr 10 13:14:23 devstack sudo[87206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:14:23 devstack sudo[87197]: pam_unix(sudo:session): session closed for user root
Apr 10 13:14:23 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-e6320a86-dac0-492b-b9db-ab0b0e55bd11 tempest-SnapshotMetadataTestJSON-479550483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-0a729334-95d1-4e22-991e-41a8a880864f.50eb4bcc-2adc-4cfe-9df4-bb5159e3b50f" returned: 0 in 1.158s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:14:23 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-e6320a86-dac0-492b-b9db-ab0b0e55bd11 tempest-SnapshotMetadataTestJSON-479550483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-0a729334-95d1-4e22-991e-41a8a880864f.50eb4bcc-2adc-4cfe-9df4-bb5159e3b50f {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:14:23 devstack sudo[87209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-0a729334-95d1-4e22-991e-41a8a880864f.50eb4bcc-2adc-4cfe-9df4-bb5159e3b50f
Apr 10 13:14:23 devstack sudo[87209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:14:23 devstack sudo[87206]: pam_unix(sudo:session): session closed for user root
Apr 10 13:14:23 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-623d555e-802f-48cc-a9d3-9d6a758c9eca tempest-VolumesActionsTest-353155709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-99a2ad7b-89ba-4314-8b09-0871e97a3712" returned: 0 in 0.849s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:14:23 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-623d555e-802f-48cc-a9d3-9d6a758c9eca tempest-VolumesActionsTest-353155709 None] <== create_volume: return (1736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'} {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 13:14:23 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-623d555e-802f-48cc-a9d3-9d6a758c9eca tempest-VolumesActionsTest-353155709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.739s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:14:24 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-623d555e-802f-48cc-a9d3-9d6a758c9eca tempest-VolumesActionsTest-353155709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c50c698-631e-4063-9316-7e9b1475898f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99a2ad7b-89ba-4314-8b09-0871e97a3712', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:14:24 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-623d555e-802f-48cc-a9d3-9d6a758c9eca tempest-VolumesActionsTest-353155709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38c024e1-f4c7-4b0b-9524-73a5862995be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:14:24 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-623d555e-802f-48cc-a9d3-9d6a758c9eca tempest-VolumesActionsTest-353155709 None] Volume volume-99a2ad7b-89ba-4314-8b09-0871e97a3712 (99a2ad7b-89ba-4314-8b09-0871e97a3712): created successfully
Apr 10 13:14:24 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-623d555e-802f-48cc-a9d3-9d6a758c9eca tempest-VolumesActionsTest-353155709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38c024e1-f4c7-4b0b-9524-73a5862995be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:14:24 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-623d555e-802f-48cc-a9d3-9d6a758c9eca tempest-VolumesActionsTest-353155709 None] Flow 'volume_create_manager' (d8e480f9-b0c1-4e73-af8b-3d8b151d4f41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:14:24 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-623d555e-802f-48cc-a9d3-9d6a758c9eca tempest-VolumesActionsTest-353155709 None] Created volume successfully.
Apr 10 13:14:24 devstack sudo[87209]: pam_unix(sudo:session): session closed for user root
Apr 10 13:14:24 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-e6320a86-dac0-492b-b9db-ab0b0e55bd11 tempest-SnapshotMetadataTestJSON-479550483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-0a729334-95d1-4e22-991e-41a8a880864f.50eb4bcc-2adc-4cfe-9df4-bb5159e3b50f" returned: 0 in 0.700s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:14:24 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-e6320a86-dac0-492b-b9db-ab0b0e55bd11 tempest-SnapshotMetadataTestJSON-479550483 None] Lock "cinder-quobyte-50eb4bcc-2adc-4cfe-9df4-bb5159e3b50f" released by "_delete_snapshot" :: held 4.502s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:14:24 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-e6320a86-dac0-492b-b9db-ab0b0e55bd11 tempest-SnapshotMetadataTestJSON-479550483 None] Lock "cinder-quobyte-0a729334-95d1-4e22-991e-41a8a880864f" released by "delete_snapshot" :: held 4.541s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:14:24 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-e6320a86-dac0-492b-b9db-ab0b0e55bd11 tempest-SnapshotMetadataTestJSON-479550483 None] Created reservations ['54d6cd4e-fc68-4673-8471-dee6c9a6b3f2', '8b83e034-737c-49f3-bbd8-b503a6badfef', 'dcf41159-941f-47e3-b4d9-80a19bafffee', 'd631d6fb-b00c-4e14-b3f9-b02b63b4b446'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:14:24 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-e6320a86-dac0-492b-b9db-ab0b0e55bd11 tempest-SnapshotMetadataTestJSON-479550483 None] Delete snapshot completed successfully.
Apr 10 13:14:24 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-e6320a86-dac0-492b-b9db-ab0b0e55bd11 tempest-SnapshotMetadataTestJSON-479550483 None] Lock "cinder-50eb4bcc-2adc-4cfe-9df4-bb5159e3b50f-delete_snapshot" released by "delete_snapshot" :: held 4.802s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:14:25 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-488a7088-8338-442e-aa47-95b10434f7d0 tempest-SnapshotMetadataTestJSON-479550483 None] Acquiring lock "cinder-0a729334-95d1-4e22-991e-41a8a880864f-delete_volume" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:14:25 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-488a7088-8338-442e-aa47-95b10434f7d0 tempest-SnapshotMetadataTestJSON-479550483 None] Lock "cinder-0a729334-95d1-4e22-991e-41a8a880864f-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:14:25 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-488a7088-8338-442e-aa47-95b10434f7d0 tempest-SnapshotMetadataTestJSON-479550483 None] Acquiring lock "cinder-quobyte-0a729334-95d1-4e22-991e-41a8a880864f" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:14:25 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-488a7088-8338-442e-aa47-95b10434f7d0 tempest-SnapshotMetadataTestJSON-479550483 None] Lock "cinder-quobyte-0a729334-95d1-4e22-991e-41a8a880864f" acquired by "delete_volume" :: waited 0.058s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:14:25 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3958ca7-c8c1-482d-9cc2-6ee5f9606c07]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:14:25 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-488a7088-8338-442e-aa47-95b10434f7d0 tempest-SnapshotMetadataTestJSON-479550483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-0a729334-95d1-4e22-991e-41a8a880864f {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:14:25 devstack sudo[87216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-0a729334-95d1-4e22-991e-41a8a880864f
Apr 10 13:14:25 devstack sudo[87216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:14:26 devstack sudo[87216]: pam_unix(sudo:session): session closed for user root
Apr 10 13:14:26 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-488a7088-8338-442e-aa47-95b10434f7d0 tempest-SnapshotMetadataTestJSON-479550483 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-0a729334-95d1-4e22-991e-41a8a880864f" returned: 0 in 1.116s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:14:26 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-488a7088-8338-442e-aa47-95b10434f7d0 tempest-SnapshotMetadataTestJSON-479550483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-0a729334-95d1-4e22-991e-41a8a880864f {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:14:26 devstack sudo[87222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-0a729334-95d1-4e22-991e-41a8a880864f
Apr 10 13:14:26 devstack sudo[87222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:14:27 devstack sudo[87222]: pam_unix(sudo:session): session closed for user root
Apr 10 13:14:27 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-488a7088-8338-442e-aa47-95b10434f7d0 tempest-SnapshotMetadataTestJSON-479550483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-0a729334-95d1-4e22-991e-41a8a880864f" returned: 0 in 0.660s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:14:27 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-488a7088-8338-442e-aa47-95b10434f7d0 tempest-SnapshotMetadataTestJSON-479550483 None] Lock "cinder-quobyte-0a729334-95d1-4e22-991e-41a8a880864f" released by "delete_volume" :: held 1.848s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:14:27 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-488a7088-8338-442e-aa47-95b10434f7d0 tempest-SnapshotMetadataTestJSON-479550483 None] Created reservations ['ff30090d-f13a-4c6c-bd66-3536105618f4', 'a5c48526-22b0-47ca-a933-c0894c423045', '4429b32d-479f-4d02-ade3-13c1f0b53d0c', '9c1e9917-697f-4d2c-aff3-6dd1925b2b30'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:14:27 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-488a7088-8338-442e-aa47-95b10434f7d0 tempest-SnapshotMetadataTestJSON-479550483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:14:27 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-488a7088-8338-442e-aa47-95b10434f7d0 tempest-SnapshotMetadataTestJSON-479550483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:14:27 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-488a7088-8338-442e-aa47-95b10434f7d0 tempest-SnapshotMetadataTestJSON-479550483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:14:27 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-488a7088-8338-442e-aa47-95b10434f7d0 tempest-SnapshotMetadataTestJSON-479550483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:14:27 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-488a7088-8338-442e-aa47-95b10434f7d0 tempest-SnapshotMetadataTestJSON-479550483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:14:27 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-488a7088-8338-442e-aa47-95b10434f7d0 tempest-SnapshotMetadataTestJSON-479550483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:14:27 devstack sudo[87281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:14:27 devstack sudo[87281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:14:28 devstack sudo[87281]: pam_unix(sudo:session): session closed for user root
Apr 10 13:14:28 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-488a7088-8338-442e-aa47-95b10434f7d0 tempest-SnapshotMetadataTestJSON-479550483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.889s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:14:28 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-488a7088-8338-442e-aa47-95b10434f7d0 tempest-SnapshotMetadataTestJSON-479550483 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:14:28 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-488a7088-8338-442e-aa47-95b10434f7d0 tempest-SnapshotMetadataTestJSON-479550483 None] Deleted volume successfully.
Apr 10 13:14:28 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-488a7088-8338-442e-aa47-95b10434f7d0 tempest-SnapshotMetadataTestJSON-479550483 None] Lock "cinder-0a729334-95d1-4e22-991e-41a8a880864f-delete_volume" released by "delete_volume" :: held 3.086s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:14:30 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-785d6efa-423f-44c9-8aa6-669d89ca6a46 tempest-VolumesMetadataTest-1138137382 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:14:30 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-785d6efa-423f-44c9-8aa6-669d89ca6a46 tempest-VolumesMetadataTest-1138137382 None] Flow 'volume_create_manager' (6274a3e4-dd20-44db-bc3b-be279fd9d7b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:14:30 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-785d6efa-423f-44c9-8aa6-669d89ca6a46 tempest-VolumesMetadataTest-1138137382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac92b61d-530c-4340-b11c-a06e50748e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:14:30 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-785d6efa-423f-44c9-8aa6-669d89ca6a46 tempest-VolumesMetadataTest-1138137382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac92b61d-530c-4340-b11c-a06e50748e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:14:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-750754481',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ddf405b-8928-4401-b9cf-8715075ebcbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54ee3e388eb84e1db7ac9685a430bd56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:14:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:14:30Z,use_quota=True,user_id='d9a1caed4ee44ca3b58c4efe78bddc9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:14:30 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-785d6efa-423f-44c9-8aa6-669d89ca6a46 tempest-VolumesMetadataTest-1138137382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74fdeb94-e3d2-4a2f-998e-8b4afa20a036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:14:30 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-785d6efa-423f-44c9-8aa6-669d89ca6a46 tempest-VolumesMetadataTest-1138137382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74fdeb94-e3d2-4a2f-998e-8b4afa20a036) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:14:30 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-785d6efa-423f-44c9-8aa6-669d89ca6a46 tempest-VolumesMetadataTest-1138137382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59b369e6-54d7-4f23-a5fc-196e95ad3f57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:14:30 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-785d6efa-423f-44c9-8aa6-669d89ca6a46 tempest-VolumesMetadataTest-1138137382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59b369e6-54d7-4f23-a5fc-196e95ad3f57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ddf405b-8928-4401-b9cf-8715075ebcbb', 'volume_name': 'volume-4ddf405b-8928-4401-b9cf-8715075ebcbb', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:14:30 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-785d6efa-423f-44c9-8aa6-669d89ca6a46 tempest-VolumesMetadataTest-1138137382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9449d09-e98e-44e6-8fe2-5845c15e5ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:14:30 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-785d6efa-423f-44c9-8aa6-669d89ca6a46 tempest-VolumesMetadataTest-1138137382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9449d09-e98e-44e6-8fe2-5845c15e5ecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:14:30 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-785d6efa-423f-44c9-8aa6-669d89ca6a46 tempest-VolumesMetadataTest-1138137382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b38d1aa2-615e-4d6f-b19a-ceac81c725d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:14:30 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-785d6efa-423f-44c9-8aa6-669d89ca6a46 tempest-VolumesMetadataTest-1138137382 None] Volume 4ddf405b-8928-4401-b9cf-8715075ebcbb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ddf405b-8928-4401-b9cf-8715075ebcbb', 'volume_size': 1}
Apr 10 13:14:30 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-785d6efa-423f-44c9-8aa6-669d89ca6a46 tempest-VolumesMetadataTest-1138137382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:14:30 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-785d6efa-423f-44c9-8aa6-669d89ca6a46 tempest-VolumesMetadataTest-1138137382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:14:30 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-785d6efa-423f-44c9-8aa6-669d89ca6a46 tempest-VolumesMetadataTest-1138137382 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f252bf08b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:14:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-750754481',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ddf405b-8928-4401-b9cf-8715075ebcbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54ee3e388eb84e1db7ac9685a430bd56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:14:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:14:30Z,use_quota=True,user_id='d9a1caed4ee44ca3b58c4efe78bddc9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)}" {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 13:14:30 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-785d6efa-423f-44c9-8aa6-669d89ca6a46 tempest-VolumesMetadataTest-1138137382 None] Creating volume 4ddf405b-8928-4401-b9cf-8715075ebcbb {{(pid=83345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 13:14:30 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-785d6efa-423f-44c9-8aa6-669d89ca6a46 tempest-VolumesMetadataTest-1138137382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:14:30 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-785d6efa-423f-44c9-8aa6-669d89ca6a46 tempest-VolumesMetadataTest-1138137382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:14:30 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-785d6efa-423f-44c9-8aa6-669d89ca6a46 tempest-VolumesMetadataTest-1138137382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:14:30 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-785d6efa-423f-44c9-8aa6-669d89ca6a46 tempest-VolumesMetadataTest-1138137382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:14:30 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-785d6efa-423f-44c9-8aa6-669d89ca6a46 tempest-VolumesMetadataTest-1138137382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:14:30 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-785d6efa-423f-44c9-8aa6-669d89ca6a46 tempest-VolumesMetadataTest-1138137382 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:14:30 devstack cinder-volume[83345]: INFO cinder.volume.drivers.remotefs [None req-785d6efa-423f-44c9-8aa6-669d89ca6a46 tempest-VolumesMetadataTest-1138137382 None] casted to osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331
Apr 10 13:14:30 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-785d6efa-423f-44c9-8aa6-669d89ca6a46 tempest-VolumesMetadataTest-1138137382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4ddf405b-8928-4401-b9cf-8715075ebcbb 1073741824 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:14:30 devstack sudo[87292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4ddf405b-8928-4401-b9cf-8715075ebcbb 1073741824
Apr 10 13:14:30 devstack sudo[87292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:14:31 devstack sudo[87292]: pam_unix(sudo:session): session closed for user root
Apr 10 13:14:31 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-785d6efa-423f-44c9-8aa6-669d89ca6a46 tempest-VolumesMetadataTest-1138137382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4ddf405b-8928-4401-b9cf-8715075ebcbb 1073741824" returned: 0 in 0.993s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:14:31 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-785d6efa-423f-44c9-8aa6-669d89ca6a46 tempest-VolumesMetadataTest-1138137382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4ddf405b-8928-4401-b9cf-8715075ebcbb {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:14:31 devstack sudo[87298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4ddf405b-8928-4401-b9cf-8715075ebcbb
Apr 10 13:14:31 devstack sudo[87298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:14:31 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-c788df3b-70aa-4019-827e-06f731dbd1e4 tempest-GroupsV320Test-1942477290 None] Group tempest-GroupsV320Test-Group-1752865320: creating
Apr 10 13:14:31 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-c788df3b-70aa-4019-827e-06f731dbd1e4 tempest-GroupsV320Test-1942477290 None] Group tempest-GroupsV320Test-Group-1752865320: created successfully
Apr 10 13:14:31 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-c788df3b-70aa-4019-827e-06f731dbd1e4 tempest-GroupsV320Test-1942477290 None] Create group completed successfully.
Apr 10 13:14:31 devstack sudo[87298]: pam_unix(sudo:session): session closed for user root
Apr 10 13:14:31 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-785d6efa-423f-44c9-8aa6-669d89ca6a46 tempest-VolumesMetadataTest-1138137382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4ddf405b-8928-4401-b9cf-8715075ebcbb" returned: 0 in 0.583s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:14:31 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-785d6efa-423f-44c9-8aa6-669d89ca6a46 tempest-VolumesMetadataTest-1138137382 None] <== create_volume: return (1617ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'} {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 13:14:31 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-785d6efa-423f-44c9-8aa6-669d89ca6a46 tempest-VolumesMetadataTest-1138137382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.619s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:14:31 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-785d6efa-423f-44c9-8aa6-669d89ca6a46 tempest-VolumesMetadataTest-1138137382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b38d1aa2-615e-4d6f-b19a-ceac81c725d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ddf405b-8928-4401-b9cf-8715075ebcbb', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:14:31 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-785d6efa-423f-44c9-8aa6-669d89ca6a46 tempest-VolumesMetadataTest-1138137382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (333c7dfd-a308-4da4-8233-02075f759689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:14:31 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-785d6efa-423f-44c9-8aa6-669d89ca6a46 tempest-VolumesMetadataTest-1138137382 None] Volume volume-4ddf405b-8928-4401-b9cf-8715075ebcbb (4ddf405b-8928-4401-b9cf-8715075ebcbb): created successfully
Apr 10 13:14:31 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-785d6efa-423f-44c9-8aa6-669d89ca6a46 tempest-VolumesMetadataTest-1138137382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (333c7dfd-a308-4da4-8233-02075f759689) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:14:31 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-785d6efa-423f-44c9-8aa6-669d89ca6a46 tempest-VolumesMetadataTest-1138137382 None] Flow 'volume_create_manager' (6274a3e4-dd20-44db-bc3b-be279fd9d7b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:14:31 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-785d6efa-423f-44c9-8aa6-669d89ca6a46 tempest-VolumesMetadataTest-1138137382 None] Created volume successfully.
Apr 10 13:14:33 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-a5f0a6ab-49d8-4ff2-888c-6609139bb6f8 tempest-VolumesMetadataTest-1138137382 None] Acquiring lock "cinder-4ddf405b-8928-4401-b9cf-8715075ebcbb-delete_volume" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:14:33 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-a5f0a6ab-49d8-4ff2-888c-6609139bb6f8 tempest-VolumesMetadataTest-1138137382 None] Lock "cinder-4ddf405b-8928-4401-b9cf-8715075ebcbb-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:14:33 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-a5f0a6ab-49d8-4ff2-888c-6609139bb6f8 tempest-VolumesMetadataTest-1138137382 None] Acquiring lock "cinder-quobyte-4ddf405b-8928-4401-b9cf-8715075ebcbb" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:14:33 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-a5f0a6ab-49d8-4ff2-888c-6609139bb6f8 tempest-VolumesMetadataTest-1138137382 None] Lock "cinder-quobyte-4ddf405b-8928-4401-b9cf-8715075ebcbb" acquired by "delete_volume" :: waited 0.016s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:14:33 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[824dae65-d353-49e6-9f9f-dbdb4d7045b4]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:14:33 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-a5f0a6ab-49d8-4ff2-888c-6609139bb6f8 tempest-VolumesMetadataTest-1138137382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4ddf405b-8928-4401-b9cf-8715075ebcbb {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:14:33 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-3b90e476-cd55-40ee-9084-f4c4b29227b3 tempest-GroupsV320Test-1942477290 None] Created reservations ['fe873ae0-e019-46a2-bad6-264ede53cb4d'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:14:33 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-3b90e476-cd55-40ee-9084-f4c4b29227b3 tempest-GroupsV320Test-1942477290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:14:33 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-3b90e476-cd55-40ee-9084-f4c4b29227b3 tempest-GroupsV320Test-1942477290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:14:33 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-3b90e476-cd55-40ee-9084-f4c4b29227b3 tempest-GroupsV320Test-1942477290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:14:33 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-3b90e476-cd55-40ee-9084-f4c4b29227b3 tempest-GroupsV320Test-1942477290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:14:33 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-3b90e476-cd55-40ee-9084-f4c4b29227b3 tempest-GroupsV320Test-1942477290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:14:33 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-3b90e476-cd55-40ee-9084-f4c4b29227b3 tempest-GroupsV320Test-1942477290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:14:33 devstack sudo[87347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4ddf405b-8928-4401-b9cf-8715075ebcbb
Apr 10 13:14:33 devstack sudo[87347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:14:33 devstack sudo[87348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:14:33 devstack sudo[87348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:14:34 devstack sudo[87348]: pam_unix(sudo:session): session closed for user root
Apr 10 13:14:34 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-3b90e476-cd55-40ee-9084-f4c4b29227b3 tempest-GroupsV320Test-1942477290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.612s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:14:34 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-3b90e476-cd55-40ee-9084-f4c4b29227b3 tempest-GroupsV320Test-1942477290 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:14:34 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-3b90e476-cd55-40ee-9084-f4c4b29227b3 tempest-GroupsV320Test-1942477290 None] Delete group completed successfully.
Apr 10 13:14:34 devstack sudo[87347]: pam_unix(sudo:session): session closed for user root
Apr 10 13:14:34 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-a5f0a6ab-49d8-4ff2-888c-6609139bb6f8 tempest-VolumesMetadataTest-1138137382 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4ddf405b-8928-4401-b9cf-8715075ebcbb" returned: 0 in 0.819s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:14:34 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-a5f0a6ab-49d8-4ff2-888c-6609139bb6f8 tempest-VolumesMetadataTest-1138137382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4ddf405b-8928-4401-b9cf-8715075ebcbb {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:14:34 devstack sudo[87355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4ddf405b-8928-4401-b9cf-8715075ebcbb
Apr 10 13:14:34 devstack sudo[87355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:14:34 devstack sudo[87355]: pam_unix(sudo:session): session closed for user root
Apr 10 13:14:34 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-a5f0a6ab-49d8-4ff2-888c-6609139bb6f8 tempest-VolumesMetadataTest-1138137382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4ddf405b-8928-4401-b9cf-8715075ebcbb" returned: 0 in 0.719s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:14:34 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-a5f0a6ab-49d8-4ff2-888c-6609139bb6f8 tempest-VolumesMetadataTest-1138137382 None] Lock "cinder-quobyte-4ddf405b-8928-4401-b9cf-8715075ebcbb" released by "delete_volume" :: held 1.648s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:14:35 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-a5f0a6ab-49d8-4ff2-888c-6609139bb6f8 tempest-VolumesMetadataTest-1138137382 None] Created reservations ['8bbf04d7-092f-455e-94e0-c188b66fa932', '23efa4cd-ccd3-46d6-95e3-557cc8e6492a', '2979c2cc-4a51-4822-a7cd-7a10aed96386', '89d86867-3da3-4a24-88aa-d2d952495be4'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:14:35 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-a5f0a6ab-49d8-4ff2-888c-6609139bb6f8 tempest-VolumesMetadataTest-1138137382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:14:35 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-a5f0a6ab-49d8-4ff2-888c-6609139bb6f8 tempest-VolumesMetadataTest-1138137382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:14:35 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-a5f0a6ab-49d8-4ff2-888c-6609139bb6f8 tempest-VolumesMetadataTest-1138137382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:14:35 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-a5f0a6ab-49d8-4ff2-888c-6609139bb6f8 tempest-VolumesMetadataTest-1138137382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:14:35 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-a5f0a6ab-49d8-4ff2-888c-6609139bb6f8 tempest-VolumesMetadataTest-1138137382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:14:35 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-a5f0a6ab-49d8-4ff2-888c-6609139bb6f8 tempest-VolumesMetadataTest-1138137382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:14:35 devstack sudo[87362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:14:35 devstack sudo[87362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:14:35 devstack sudo[87362]: pam_unix(sudo:session): session closed for user root
Apr 10 13:14:35 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-a5f0a6ab-49d8-4ff2-888c-6609139bb6f8 tempest-VolumesMetadataTest-1138137382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.557s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:14:35 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-a5f0a6ab-49d8-4ff2-888c-6609139bb6f8 tempest-VolumesMetadataTest-1138137382 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:14:35 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-a5f0a6ab-49d8-4ff2-888c-6609139bb6f8 tempest-VolumesMetadataTest-1138137382 None] Deleted volume successfully.
Apr 10 13:14:35 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-a5f0a6ab-49d8-4ff2-888c-6609139bb6f8 tempest-VolumesMetadataTest-1138137382 None] Lock "cinder-4ddf405b-8928-4401-b9cf-8715075ebcbb-delete_volume" released by "delete_volume" :: held 2.469s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:14:40 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-aab4182f-4727-4ad9-bbf9-f076175072cc tempest-VolumesActionsTest-353155709 None] Acquiring lock "cinder-99a2ad7b-89ba-4314-8b09-0871e97a3712" by "attach_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:14:40 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-aab4182f-4727-4ad9-bbf9-f076175072cc tempest-VolumesActionsTest-353155709 None] Lock "cinder-99a2ad7b-89ba-4314-8b09-0871e97a3712" acquired by "attach_volume" :: waited 0.033s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:14:40 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-aab4182f-4727-4ad9-bbf9-f076175072cc tempest-VolumesActionsTest-353155709 None] Attaching volume 99a2ad7b-89ba-4314-8b09-0871e97a3712 to instance 7991208b-2c58-4136-b2c5-437e94a1bbea at mountpoint /dev/vdb on host None.
Apr 10 13:14:40 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-aab4182f-4727-4ad9-bbf9-f076175072cc tempest-VolumesActionsTest-353155709 None] Attach volume completed successfully.
Apr 10 13:14:40 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-aab4182f-4727-4ad9-bbf9-f076175072cc tempest-VolumesActionsTest-353155709 None] Lock "cinder-99a2ad7b-89ba-4314-8b09-0871e97a3712" released by "attach_volume" :: held 0.181s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:14:40 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-0d879096-8680-4950-ae1a-3b5fc62b6a49 tempest-VolumesActionsTest-353155709 None] Acquiring lock "cinder-99a2ad7b-89ba-4314-8b09-0871e97a3712-detach_volume" by "detach_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:14:41 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-0d879096-8680-4950-ae1a-3b5fc62b6a49 tempest-VolumesActionsTest-353155709 None] Lock "cinder-99a2ad7b-89ba-4314-8b09-0871e97a3712-detach_volume" acquired by "detach_volume" :: waited 0.025s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:14:41 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-0d879096-8680-4950-ae1a-3b5fc62b6a49 tempest-VolumesActionsTest-353155709 None] Detaching volume 99a2ad7b-89ba-4314-8b09-0871e97a3712 from instance 7991208b-2c58-4136-b2c5-437e94a1bbea.
Apr 10 13:14:41 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-0d879096-8680-4950-ae1a-3b5fc62b6a49 tempest-VolumesActionsTest-353155709 None] Detach volume completed successfully.
Apr 10 13:14:41 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-0d879096-8680-4950-ae1a-3b5fc62b6a49 tempest-VolumesActionsTest-353155709 None] Lock "cinder-99a2ad7b-89ba-4314-8b09-0871e97a3712-detach_volume" released by "detach_volume" :: held 0.111s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:14:41 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-8a48750d-17be-4806-a44b-88965f8b0dd6 tempest-ServerRescueNegativeTestJSON-2073982593 None] Acquiring lock "cinder-71a5e2b7-d1f9-4d1b-b3bb-fa148933b5c6-delete_volume" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:14:41 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-8a48750d-17be-4806-a44b-88965f8b0dd6 tempest-ServerRescueNegativeTestJSON-2073982593 None] Lock "cinder-71a5e2b7-d1f9-4d1b-b3bb-fa148933b5c6-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:14:41 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-8a48750d-17be-4806-a44b-88965f8b0dd6 tempest-ServerRescueNegativeTestJSON-2073982593 None] Acquiring lock "cinder-quobyte-71a5e2b7-d1f9-4d1b-b3bb-fa148933b5c6" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:14:41 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-8a48750d-17be-4806-a44b-88965f8b0dd6 tempest-ServerRescueNegativeTestJSON-2073982593 None] Lock "cinder-quobyte-71a5e2b7-d1f9-4d1b-b3bb-fa148933b5c6" acquired by "delete_volume" :: waited 0.037s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:14:42 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c4a82b-746b-4135-8539-c1a5dcbaedbf]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:14:42 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-8a48750d-17be-4806-a44b-88965f8b0dd6 tempest-ServerRescueNegativeTestJSON-2073982593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-71a5e2b7-d1f9-4d1b-b3bb-fa148933b5c6 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:14:42 devstack sudo[87447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-71a5e2b7-d1f9-4d1b-b3bb-fa148933b5c6
Apr 10 13:14:42 devstack sudo[87447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:14:42 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc00464d-af03-446e-aeaf-d2cfc859f59f tempest-VolumesTransfersTest-282802536 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:14:42 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-fc00464d-af03-446e-aeaf-d2cfc859f59f tempest-VolumesTransfersTest-282802536 None] Flow 'volume_create_manager' (35a4ec5d-ab30-436a-b3fc-69f27e16cfbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:14:42 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-fc00464d-af03-446e-aeaf-d2cfc859f59f tempest-VolumesTransfersTest-282802536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf918da1-ca8f-49c3-9526-61f1b04c5392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:14:42 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-fc00464d-af03-446e-aeaf-d2cfc859f59f tempest-VolumesTransfersTest-282802536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf918da1-ca8f-49c3-9526-61f1b04c5392) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:14:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1470782601',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2a27d9e-0ae8-4eaa-9095-0ad0ffdc64f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5932d9c286f24a9c8f27dd5798f4c01f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:14:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:14:43Z,use_quota=True,user_id='a1174d6af1464fbfa08b4908b72e39bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:14:42 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-fc00464d-af03-446e-aeaf-d2cfc859f59f tempest-VolumesTransfersTest-282802536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f287d761-9423-460b-94e4-349779cacbdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:14:42 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-fc00464d-af03-446e-aeaf-d2cfc859f59f tempest-VolumesTransfersTest-282802536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f287d761-9423-460b-94e4-349779cacbdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:14:42 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-fc00464d-af03-446e-aeaf-d2cfc859f59f tempest-VolumesTransfersTest-282802536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03f5e647-b11b-4344-96ae-664980974bb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:14:42 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-fc00464d-af03-446e-aeaf-d2cfc859f59f tempest-VolumesTransfersTest-282802536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03f5e647-b11b-4344-96ae-664980974bb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2a27d9e-0ae8-4eaa-9095-0ad0ffdc64f7', 'volume_name': 'volume-d2a27d9e-0ae8-4eaa-9095-0ad0ffdc64f7', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:14:42 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-fc00464d-af03-446e-aeaf-d2cfc859f59f tempest-VolumesTransfersTest-282802536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c45f529-737f-451e-a996-48488a237d5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:14:42 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-fc00464d-af03-446e-aeaf-d2cfc859f59f tempest-VolumesTransfersTest-282802536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c45f529-737f-451e-a996-48488a237d5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:14:42 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-fc00464d-af03-446e-aeaf-d2cfc859f59f tempest-VolumesTransfersTest-282802536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e51848d8-0b59-4387-b01e-15fd8780226e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:14:42 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-fc00464d-af03-446e-aeaf-d2cfc859f59f tempest-VolumesTransfersTest-282802536 None] Volume d2a27d9e-0ae8-4eaa-9095-0ad0ffdc64f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2a27d9e-0ae8-4eaa-9095-0ad0ffdc64f7', 'volume_size': 1}
Apr 10 13:14:42 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-fc00464d-af03-446e-aeaf-d2cfc859f59f tempest-VolumesTransfersTest-282802536 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:14:42 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-fc00464d-af03-446e-aeaf-d2cfc859f59f tempest-VolumesTransfersTest-282802536 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:14:42 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-fc00464d-af03-446e-aeaf-d2cfc859f59f tempest-VolumesTransfersTest-282802536 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f252bf08b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:14:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1470782601',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2a27d9e-0ae8-4eaa-9095-0ad0ffdc64f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5932d9c286f24a9c8f27dd5798f4c01f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:14:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:14:43Z,use_quota=True,user_id='a1174d6af1464fbfa08b4908b72e39bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)}" {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 13:14:42 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-fc00464d-af03-446e-aeaf-d2cfc859f59f tempest-VolumesTransfersTest-282802536 None] Creating volume d2a27d9e-0ae8-4eaa-9095-0ad0ffdc64f7 {{(pid=83345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 13:14:42 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-fc00464d-af03-446e-aeaf-d2cfc859f59f tempest-VolumesTransfersTest-282802536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:14:42 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-fc00464d-af03-446e-aeaf-d2cfc859f59f tempest-VolumesTransfersTest-282802536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:14:42 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-fc00464d-af03-446e-aeaf-d2cfc859f59f tempest-VolumesTransfersTest-282802536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:14:42 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-fc00464d-af03-446e-aeaf-d2cfc859f59f tempest-VolumesTransfersTest-282802536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:14:42 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-fc00464d-af03-446e-aeaf-d2cfc859f59f tempest-VolumesTransfersTest-282802536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:14:42 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-fc00464d-af03-446e-aeaf-d2cfc859f59f tempest-VolumesTransfersTest-282802536 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:14:42 devstack cinder-volume[83345]: INFO cinder.volume.drivers.remotefs [None req-fc00464d-af03-446e-aeaf-d2cfc859f59f tempest-VolumesTransfersTest-282802536 None] casted to osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331
Apr 10 13:14:42 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-fc00464d-af03-446e-aeaf-d2cfc859f59f tempest-VolumesTransfersTest-282802536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-d2a27d9e-0ae8-4eaa-9095-0ad0ffdc64f7 1073741824 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:14:42 devstack sudo[87451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-d2a27d9e-0ae8-4eaa-9095-0ad0ffdc64f7 1073741824
Apr 10 13:14:42 devstack sudo[87451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:14:43 devstack sudo[87447]: pam_unix(sudo:session): session closed for user root
Apr 10 13:14:43 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-8a48750d-17be-4806-a44b-88965f8b0dd6 tempest-ServerRescueNegativeTestJSON-2073982593 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-71a5e2b7-d1f9-4d1b-b3bb-fa148933b5c6" returned: 0 in 1.076s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:14:43 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-8a48750d-17be-4806-a44b-88965f8b0dd6 tempest-ServerRescueNegativeTestJSON-2073982593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-71a5e2b7-d1f9-4d1b-b3bb-fa148933b5c6 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:14:43 devstack sudo[87458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-71a5e2b7-d1f9-4d1b-b3bb-fa148933b5c6
Apr 10 13:14:43 devstack sudo[87458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:14:44 devstack sudo[87458]: pam_unix(sudo:session): session closed for user root
Apr 10 13:14:44 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-8a48750d-17be-4806-a44b-88965f8b0dd6 tempest-ServerRescueNegativeTestJSON-2073982593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-71a5e2b7-d1f9-4d1b-b3bb-fa148933b5c6" returned: 0 in 1.161s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:14:44 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-8a48750d-17be-4806-a44b-88965f8b0dd6 tempest-ServerRescueNegativeTestJSON-2073982593 None] Lock "cinder-quobyte-71a5e2b7-d1f9-4d1b-b3bb-fa148933b5c6" released by "delete_volume" :: held 2.356s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:14:44 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-8a48750d-17be-4806-a44b-88965f8b0dd6 tempest-ServerRescueNegativeTestJSON-2073982593 None] Created reservations ['f0dbea9b-8875-4bc4-80ab-2fe4864ed7f9', '9fe7e3ec-eab5-414f-9570-c15a9c7a49f2', '0b40a596-cd4d-4fee-8dbe-615b970add60', '2d1a9201-cf8c-4765-93c1-9c114d6cb2ea'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:14:44 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-8a48750d-17be-4806-a44b-88965f8b0dd6 tempest-ServerRescueNegativeTestJSON-2073982593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:14:44 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-8a48750d-17be-4806-a44b-88965f8b0dd6 tempest-ServerRescueNegativeTestJSON-2073982593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:14:44 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-8a48750d-17be-4806-a44b-88965f8b0dd6 tempest-ServerRescueNegativeTestJSON-2073982593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:14:44 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-8a48750d-17be-4806-a44b-88965f8b0dd6 tempest-ServerRescueNegativeTestJSON-2073982593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:14:44 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-8a48750d-17be-4806-a44b-88965f8b0dd6 tempest-ServerRescueNegativeTestJSON-2073982593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:14:44 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-8a48750d-17be-4806-a44b-88965f8b0dd6 tempest-ServerRescueNegativeTestJSON-2073982593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:14:44 devstack sudo[87451]: pam_unix(sudo:session): session closed for user root
Apr 10 13:14:44 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-fc00464d-af03-446e-aeaf-d2cfc859f59f tempest-VolumesTransfersTest-282802536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-d2a27d9e-0ae8-4eaa-9095-0ad0ffdc64f7 1073741824" returned: 0 in 1.486s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:14:44 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-fc00464d-af03-446e-aeaf-d2cfc859f59f tempest-VolumesTransfersTest-282802536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-d2a27d9e-0ae8-4eaa-9095-0ad0ffdc64f7 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:14:44 devstack sudo[87544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:14:44 devstack sudo[87544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:14:44 devstack sudo[87545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-d2a27d9e-0ae8-4eaa-9095-0ad0ffdc64f7
Apr 10 13:14:44 devstack sudo[87545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:14:45 devstack sudo[87544]: pam_unix(sudo:session): session closed for user root
Apr 10 13:14:45 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-8a48750d-17be-4806-a44b-88965f8b0dd6 tempest-ServerRescueNegativeTestJSON-2073982593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 1.048s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:14:45 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-8a48750d-17be-4806-a44b-88965f8b0dd6 tempest-ServerRescueNegativeTestJSON-2073982593 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:14:45 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-8a48750d-17be-4806-a44b-88965f8b0dd6 tempest-ServerRescueNegativeTestJSON-2073982593 None] Deleted volume successfully.
Apr 10 13:14:45 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-8a48750d-17be-4806-a44b-88965f8b0dd6 tempest-ServerRescueNegativeTestJSON-2073982593 None] Lock "cinder-71a5e2b7-d1f9-4d1b-b3bb-fa148933b5c6-delete_volume" released by "delete_volume" :: held 3.743s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:14:45 devstack sudo[87545]: pam_unix(sudo:session): session closed for user root
Apr 10 13:14:45 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-fc00464d-af03-446e-aeaf-d2cfc859f59f tempest-VolumesTransfersTest-282802536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-d2a27d9e-0ae8-4eaa-9095-0ad0ffdc64f7" returned: 0 in 1.126s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:14:45 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-fc00464d-af03-446e-aeaf-d2cfc859f59f tempest-VolumesTransfersTest-282802536 None] <== create_volume: return (2669ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'} {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 13:14:45 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-fc00464d-af03-446e-aeaf-d2cfc859f59f tempest-VolumesTransfersTest-282802536 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.672s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:14:45 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-fc00464d-af03-446e-aeaf-d2cfc859f59f tempest-VolumesTransfersTest-282802536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e51848d8-0b59-4387-b01e-15fd8780226e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2a27d9e-0ae8-4eaa-9095-0ad0ffdc64f7', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:14:45 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-fc00464d-af03-446e-aeaf-d2cfc859f59f tempest-VolumesTransfersTest-282802536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72e98722-437f-48f3-8bfd-3fc1e2de8b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:14:45 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-fc00464d-af03-446e-aeaf-d2cfc859f59f tempest-VolumesTransfersTest-282802536 None] Volume volume-d2a27d9e-0ae8-4eaa-9095-0ad0ffdc64f7 (d2a27d9e-0ae8-4eaa-9095-0ad0ffdc64f7): created successfully
Apr 10 13:14:45 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-fc00464d-af03-446e-aeaf-d2cfc859f59f tempest-VolumesTransfersTest-282802536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72e98722-437f-48f3-8bfd-3fc1e2de8b94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:14:45 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-fc00464d-af03-446e-aeaf-d2cfc859f59f tempest-VolumesTransfersTest-282802536 None] Flow 'volume_create_manager' (35a4ec5d-ab30-436a-b3fc-69f27e16cfbc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:14:45 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-fc00464d-af03-446e-aeaf-d2cfc859f59f tempest-VolumesTransfersTest-282802536 None] Created volume successfully.
Apr 10 13:14:46 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-8c6043cc-5ec8-4e5e-afa8-d8a4cc8c9614 tempest-VolumesTransfersTest-312085825 None] Transfer volume completed successfully.
Apr 10 13:14:48 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-4ce082b1-210a-4018-9356-aa4c1f228788 tempest-VolumesTransfersTest-189018965 None] Acquiring lock "cinder-d2a27d9e-0ae8-4eaa-9095-0ad0ffdc64f7-delete_volume" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:14:48 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-4ce082b1-210a-4018-9356-aa4c1f228788 tempest-VolumesTransfersTest-189018965 None] Lock "cinder-d2a27d9e-0ae8-4eaa-9095-0ad0ffdc64f7-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:14:48 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-63f529b7-782f-43b2-a417-40ecfbcf71cb tempest-VolumeQuotasNegativeTestJSON-1220524757 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:14:48 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-63f529b7-782f-43b2-a417-40ecfbcf71cb tempest-VolumeQuotasNegativeTestJSON-1220524757 None] Flow 'volume_create_manager' (1f0de7dc-1e49-40bf-9c40-366ac4bc374b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:14:48 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-63f529b7-782f-43b2-a417-40ecfbcf71cb tempest-VolumeQuotasNegativeTestJSON-1220524757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8be00263-e9ae-4d3a-87c6-a224c0596a45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:14:48 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-4ce082b1-210a-4018-9356-aa4c1f228788 tempest-VolumesTransfersTest-189018965 None] Acquiring lock "cinder-quobyte-d2a27d9e-0ae8-4eaa-9095-0ad0ffdc64f7" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:14:48 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-63f529b7-782f-43b2-a417-40ecfbcf71cb tempest-VolumeQuotasNegativeTestJSON-1220524757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8be00263-e9ae-4d3a-87c6-a224c0596a45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:14:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1549894717',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed6cd8a2-073c-4357-972d-426b02028bfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9042330a9a484976a76d84697759988c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:14:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:14:48Z,use_quota=True,user_id='b340f7129e894ba9a2931c0d7411ff11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:14:48 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-63f529b7-782f-43b2-a417-40ecfbcf71cb tempest-VolumeQuotasNegativeTestJSON-1220524757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a723650-aa52-4c5c-accb-1d93a78d4e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:14:48 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-63f529b7-782f-43b2-a417-40ecfbcf71cb tempest-VolumeQuotasNegativeTestJSON-1220524757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a723650-aa52-4c5c-accb-1d93a78d4e02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:14:48 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-63f529b7-782f-43b2-a417-40ecfbcf71cb tempest-VolumeQuotasNegativeTestJSON-1220524757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ae4e4ff-0cbd-493b-aa40-fc64b1189f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:14:48 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-63f529b7-782f-43b2-a417-40ecfbcf71cb tempest-VolumeQuotasNegativeTestJSON-1220524757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ae4e4ff-0cbd-493b-aa40-fc64b1189f74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed6cd8a2-073c-4357-972d-426b02028bfa', 'volume_name': 'volume-ed6cd8a2-073c-4357-972d-426b02028bfa', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:14:48 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-63f529b7-782f-43b2-a417-40ecfbcf71cb tempest-VolumeQuotasNegativeTestJSON-1220524757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdc5ad8f-0cd8-43e1-b602-07ad64d00d95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:14:48 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-63f529b7-782f-43b2-a417-40ecfbcf71cb tempest-VolumeQuotasNegativeTestJSON-1220524757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdc5ad8f-0cd8-43e1-b602-07ad64d00d95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:14:48 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-63f529b7-782f-43b2-a417-40ecfbcf71cb tempest-VolumeQuotasNegativeTestJSON-1220524757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d7c0a2b-8e29-425e-a6b4-2b3be34e1250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:14:48 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-63f529b7-782f-43b2-a417-40ecfbcf71cb tempest-VolumeQuotasNegativeTestJSON-1220524757 None] Volume ed6cd8a2-073c-4357-972d-426b02028bfa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed6cd8a2-073c-4357-972d-426b02028bfa', 'volume_size': 1}
Apr 10 13:14:48 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-63f529b7-782f-43b2-a417-40ecfbcf71cb tempest-VolumeQuotasNegativeTestJSON-1220524757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:14:48 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-63f529b7-782f-43b2-a417-40ecfbcf71cb tempest-VolumeQuotasNegativeTestJSON-1220524757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:14:48 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-63f529b7-782f-43b2-a417-40ecfbcf71cb tempest-VolumeQuotasNegativeTestJSON-1220524757 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f252bf08b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:14:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1549894717',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed6cd8a2-073c-4357-972d-426b02028bfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9042330a9a484976a76d84697759988c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:14:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:14:48Z,use_quota=True,user_id='b340f7129e894ba9a2931c0d7411ff11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)}" {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 13:14:48 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-63f529b7-782f-43b2-a417-40ecfbcf71cb tempest-VolumeQuotasNegativeTestJSON-1220524757 None] Creating volume ed6cd8a2-073c-4357-972d-426b02028bfa {{(pid=83345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 13:14:48 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-63f529b7-782f-43b2-a417-40ecfbcf71cb tempest-VolumeQuotasNegativeTestJSON-1220524757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:14:48 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-63f529b7-782f-43b2-a417-40ecfbcf71cb tempest-VolumeQuotasNegativeTestJSON-1220524757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:14:48 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-63f529b7-782f-43b2-a417-40ecfbcf71cb tempest-VolumeQuotasNegativeTestJSON-1220524757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:14:48 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-63f529b7-782f-43b2-a417-40ecfbcf71cb tempest-VolumeQuotasNegativeTestJSON-1220524757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:14:48 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-63f529b7-782f-43b2-a417-40ecfbcf71cb tempest-VolumeQuotasNegativeTestJSON-1220524757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:14:48 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-63f529b7-782f-43b2-a417-40ecfbcf71cb tempest-VolumeQuotasNegativeTestJSON-1220524757 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:14:48 devstack cinder-volume[83345]: INFO cinder.volume.drivers.remotefs [None req-63f529b7-782f-43b2-a417-40ecfbcf71cb tempest-VolumeQuotasNegativeTestJSON-1220524757 None] casted to osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331
Apr 10 13:14:48 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-63f529b7-782f-43b2-a417-40ecfbcf71cb tempest-VolumeQuotasNegativeTestJSON-1220524757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-ed6cd8a2-073c-4357-972d-426b02028bfa 1073741824 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:14:48 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-4ce082b1-210a-4018-9356-aa4c1f228788 tempest-VolumesTransfersTest-189018965 None] Lock "cinder-quobyte-d2a27d9e-0ae8-4eaa-9095-0ad0ffdc64f7" acquired by "delete_volume" :: waited 0.066s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:14:48 devstack sudo[87583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-ed6cd8a2-073c-4357-972d-426b02028bfa 1073741824
Apr 10 13:14:48 devstack sudo[87583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:14:48 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[604e224a-93b6-4aeb-87df-57c35401e148]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:14:48 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-4ce082b1-210a-4018-9356-aa4c1f228788 tempest-VolumesTransfersTest-189018965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-d2a27d9e-0ae8-4eaa-9095-0ad0ffdc64f7 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:14:48 devstack sudo[87585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-d2a27d9e-0ae8-4eaa-9095-0ad0ffdc64f7
Apr 10 13:14:48 devstack sudo[87585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:14:48 devstack sudo[87585]: pam_unix(sudo:session): session closed for user root
Apr 10 13:14:48 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-4ce082b1-210a-4018-9356-aa4c1f228788 tempest-VolumesTransfersTest-189018965 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-d2a27d9e-0ae8-4eaa-9095-0ad0ffdc64f7" returned: 0 in 0.578s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:14:48 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-4ce082b1-210a-4018-9356-aa4c1f228788 tempest-VolumesTransfersTest-189018965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-d2a27d9e-0ae8-4eaa-9095-0ad0ffdc64f7 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:14:48 devstack sudo[87595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-d2a27d9e-0ae8-4eaa-9095-0ad0ffdc64f7
Apr 10 13:14:48 devstack sudo[87595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:14:48 devstack sudo[87583]: pam_unix(sudo:session): session closed for user root
Apr 10 13:14:48 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-63f529b7-782f-43b2-a417-40ecfbcf71cb tempest-VolumeQuotasNegativeTestJSON-1220524757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-ed6cd8a2-073c-4357-972d-426b02028bfa 1073741824" returned: 0 in 0.705s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:14:48 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-63f529b7-782f-43b2-a417-40ecfbcf71cb tempest-VolumeQuotasNegativeTestJSON-1220524757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-ed6cd8a2-073c-4357-972d-426b02028bfa {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:14:48 devstack sudo[87597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-ed6cd8a2-073c-4357-972d-426b02028bfa
Apr 10 13:14:48 devstack sudo[87597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:14:49 devstack sudo[87595]: pam_unix(sudo:session): session closed for user root
Apr 10 13:14:49 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-4ce082b1-210a-4018-9356-aa4c1f228788 tempest-VolumesTransfersTest-189018965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-d2a27d9e-0ae8-4eaa-9095-0ad0ffdc64f7" returned: 0 in 0.531s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:14:49 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-4ce082b1-210a-4018-9356-aa4c1f228788 tempest-VolumesTransfersTest-189018965 None] Lock "cinder-quobyte-d2a27d9e-0ae8-4eaa-9095-0ad0ffdc64f7" released by "delete_volume" :: held 1.176s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:14:49 devstack sudo[87597]: pam_unix(sudo:session): session closed for user root
Apr 10 13:14:49 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-63f529b7-782f-43b2-a417-40ecfbcf71cb tempest-VolumeQuotasNegativeTestJSON-1220524757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-ed6cd8a2-073c-4357-972d-426b02028bfa" returned: 0 in 0.553s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:14:49 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-63f529b7-782f-43b2-a417-40ecfbcf71cb tempest-VolumeQuotasNegativeTestJSON-1220524757 None] <== create_volume: return (1287ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'} {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 13:14:49 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-63f529b7-782f-43b2-a417-40ecfbcf71cb tempest-VolumeQuotasNegativeTestJSON-1220524757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.290s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:14:49 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-4ce082b1-210a-4018-9356-aa4c1f228788 tempest-VolumesTransfersTest-189018965 None] Created reservations ['71a654b8-de78-45c6-96ab-7f414db47dbd', '778e1079-37a0-42cf-a344-1b7e6571e074', '763f8aab-e6cb-43d7-bd0a-1650d24f56ef', '6abd0d3e-7a55-4c0a-8301-6c705071918c'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:14:49 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-63f529b7-782f-43b2-a417-40ecfbcf71cb tempest-VolumeQuotasNegativeTestJSON-1220524757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d7c0a2b-8e29-425e-a6b4-2b3be34e1250) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed6cd8a2-073c-4357-972d-426b02028bfa', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:14:49 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-63f529b7-782f-43b2-a417-40ecfbcf71cb tempest-VolumeQuotasNegativeTestJSON-1220524757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24467c8f-b33e-4f4c-acf3-116755cb5976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:14:49 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-63f529b7-782f-43b2-a417-40ecfbcf71cb tempest-VolumeQuotasNegativeTestJSON-1220524757 None] Volume volume-ed6cd8a2-073c-4357-972d-426b02028bfa (ed6cd8a2-073c-4357-972d-426b02028bfa): created successfully
Apr 10 13:14:49 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-63f529b7-782f-43b2-a417-40ecfbcf71cb tempest-VolumeQuotasNegativeTestJSON-1220524757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24467c8f-b33e-4f4c-acf3-116755cb5976) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:14:49 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-63f529b7-782f-43b2-a417-40ecfbcf71cb tempest-VolumeQuotasNegativeTestJSON-1220524757 None] Flow 'volume_create_manager' (1f0de7dc-1e49-40bf-9c40-366ac4bc374b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:14:49 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-63f529b7-782f-43b2-a417-40ecfbcf71cb tempest-VolumeQuotasNegativeTestJSON-1220524757 None] Created volume successfully.
Apr 10 13:14:49 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-4ce082b1-210a-4018-9356-aa4c1f228788 tempest-VolumesTransfersTest-189018965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:14:49 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-4ce082b1-210a-4018-9356-aa4c1f228788 tempest-VolumesTransfersTest-189018965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:14:49 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-4ce082b1-210a-4018-9356-aa4c1f228788 tempest-VolumesTransfersTest-189018965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:14:49 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-4ce082b1-210a-4018-9356-aa4c1f228788 tempest-VolumesTransfersTest-189018965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:14:49 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-4ce082b1-210a-4018-9356-aa4c1f228788 tempest-VolumesTransfersTest-189018965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:14:49 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-4ce082b1-210a-4018-9356-aa4c1f228788 tempest-VolumesTransfersTest-189018965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:14:49 devstack sudo[87601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:14:49 devstack sudo[87601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:14:50 devstack sudo[87601]: pam_unix(sudo:session): session closed for user root
Apr 10 13:14:50 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-4ce082b1-210a-4018-9356-aa4c1f228788 tempest-VolumesTransfersTest-189018965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.520s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:14:50 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-4ce082b1-210a-4018-9356-aa4c1f228788 tempest-VolumesTransfersTest-189018965 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:14:50 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-4ce082b1-210a-4018-9356-aa4c1f228788 tempest-VolumesTransfersTest-189018965 None] Deleted volume successfully.
Apr 10 13:14:50 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-4ce082b1-210a-4018-9356-aa4c1f228788 tempest-VolumesTransfersTest-189018965 None] Lock "cinder-d2a27d9e-0ae8-4eaa-9095-0ad0ffdc64f7-delete_volume" released by "delete_volume" :: held 2.143s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:14:50 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-338a2ef4-2867-42b2-9c94-68d6768b2405 tempest-VolumesTransfersTest-282802536 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:14:50 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-338a2ef4-2867-42b2-9c94-68d6768b2405 tempest-VolumesTransfersTest-282802536 None] Flow 'volume_create_manager' (e4501a95-d4d5-46c6-afe1-7e66c661acf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:14:50 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-338a2ef4-2867-42b2-9c94-68d6768b2405 tempest-VolumesTransfersTest-282802536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0500ccb8-e38c-4bfd-93a7-e1b60c26cf24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:14:50 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-338a2ef4-2867-42b2-9c94-68d6768b2405 tempest-VolumesTransfersTest-282802536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0500ccb8-e38c-4bfd-93a7-e1b60c26cf24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:14:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-805145275',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75fb72d5-25d5-4705-b5bc-3d12b4652cf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5932d9c286f24a9c8f27dd5798f4c01f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:14:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:14:51Z,use_quota=True,user_id='a1174d6af1464fbfa08b4908b72e39bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:14:50 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-338a2ef4-2867-42b2-9c94-68d6768b2405 tempest-VolumesTransfersTest-282802536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe83201f-9b80-4877-94c2-52f86ba0abe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:14:50 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-338a2ef4-2867-42b2-9c94-68d6768b2405 tempest-VolumesTransfersTest-282802536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe83201f-9b80-4877-94c2-52f86ba0abe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:14:50 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-338a2ef4-2867-42b2-9c94-68d6768b2405 tempest-VolumesTransfersTest-282802536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9701194-3ef9-4d90-ac7a-929f5f1e06e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:14:50 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-338a2ef4-2867-42b2-9c94-68d6768b2405 tempest-VolumesTransfersTest-282802536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9701194-3ef9-4d90-ac7a-929f5f1e06e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75fb72d5-25d5-4705-b5bc-3d12b4652cf7', 'volume_name': 'volume-75fb72d5-25d5-4705-b5bc-3d12b4652cf7', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:14:50 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-338a2ef4-2867-42b2-9c94-68d6768b2405 tempest-VolumesTransfersTest-282802536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2041757b-5b65-409a-8d57-62faa72be823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:14:50 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-338a2ef4-2867-42b2-9c94-68d6768b2405 tempest-VolumesTransfersTest-282802536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2041757b-5b65-409a-8d57-62faa72be823) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:14:50 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-338a2ef4-2867-42b2-9c94-68d6768b2405 tempest-VolumesTransfersTest-282802536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d7d4e8f-1c93-4571-9546-1f4b27e4652a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:14:50 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-338a2ef4-2867-42b2-9c94-68d6768b2405 tempest-VolumesTransfersTest-282802536 None] Volume 75fb72d5-25d5-4705-b5bc-3d12b4652cf7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75fb72d5-25d5-4705-b5bc-3d12b4652cf7', 'volume_size': 1}
Apr 10 13:14:50 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-338a2ef4-2867-42b2-9c94-68d6768b2405 tempest-VolumesTransfersTest-282802536 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:14:50 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-338a2ef4-2867-42b2-9c94-68d6768b2405 tempest-VolumesTransfersTest-282802536 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:14:50 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-338a2ef4-2867-42b2-9c94-68d6768b2405 tempest-VolumesTransfersTest-282802536 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f252bf08b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:14:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-805145275',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75fb72d5-25d5-4705-b5bc-3d12b4652cf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5932d9c286f24a9c8f27dd5798f4c01f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:14:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:14:51Z,use_quota=True,user_id='a1174d6af1464fbfa08b4908b72e39bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)}" {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 13:14:50 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-338a2ef4-2867-42b2-9c94-68d6768b2405 tempest-VolumesTransfersTest-282802536 None] Creating volume 75fb72d5-25d5-4705-b5bc-3d12b4652cf7 {{(pid=83345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 13:14:50 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-338a2ef4-2867-42b2-9c94-68d6768b2405 tempest-VolumesTransfersTest-282802536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:14:50 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-338a2ef4-2867-42b2-9c94-68d6768b2405 tempest-VolumesTransfersTest-282802536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:14:50 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-338a2ef4-2867-42b2-9c94-68d6768b2405 tempest-VolumesTransfersTest-282802536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:14:50 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-338a2ef4-2867-42b2-9c94-68d6768b2405 tempest-VolumesTransfersTest-282802536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:14:50 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-338a2ef4-2867-42b2-9c94-68d6768b2405 tempest-VolumesTransfersTest-282802536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:14:50 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-338a2ef4-2867-42b2-9c94-68d6768b2405 tempest-VolumesTransfersTest-282802536 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:14:50 devstack cinder-volume[83345]: INFO cinder.volume.drivers.remotefs [None req-338a2ef4-2867-42b2-9c94-68d6768b2405 tempest-VolumesTransfersTest-282802536 None] casted to osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331
Apr 10 13:14:50 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-338a2ef4-2867-42b2-9c94-68d6768b2405 tempest-VolumesTransfersTest-282802536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-75fb72d5-25d5-4705-b5bc-3d12b4652cf7 1073741824 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:14:50 devstack sudo[87608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-75fb72d5-25d5-4705-b5bc-3d12b4652cf7 1073741824
Apr 10 13:14:50 devstack sudo[87608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:14:51 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-ebc7de1e-cf45-4b9c-9d86-88aea6f1ddff tempest-VolumeQuotasNegativeTestJSON-1220524757 None] Acquiring lock "cinder-ed6cd8a2-073c-4357-972d-426b02028bfa-delete_volume" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:14:51 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-ebc7de1e-cf45-4b9c-9d86-88aea6f1ddff tempest-VolumeQuotasNegativeTestJSON-1220524757 None] Lock "cinder-ed6cd8a2-073c-4357-972d-426b02028bfa-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:14:51 devstack sudo[87608]: pam_unix(sudo:session): session closed for user root
Apr 10 13:14:51 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-ebc7de1e-cf45-4b9c-9d86-88aea6f1ddff tempest-VolumeQuotasNegativeTestJSON-1220524757 None] Acquiring lock "cinder-quobyte-ed6cd8a2-073c-4357-972d-426b02028bfa" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:14:51 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-338a2ef4-2867-42b2-9c94-68d6768b2405 tempest-VolumesTransfersTest-282802536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-75fb72d5-25d5-4705-b5bc-3d12b4652cf7 1073741824" returned: 0 in 0.585s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:14:51 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-ebc7de1e-cf45-4b9c-9d86-88aea6f1ddff tempest-VolumeQuotasNegativeTestJSON-1220524757 None] Lock "cinder-quobyte-ed6cd8a2-073c-4357-972d-426b02028bfa" acquired by "delete_volume" :: waited 0.012s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:14:51 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[74725325-a3be-4667-9bea-d6d9548b9ef9]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:14:51 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ebc7de1e-cf45-4b9c-9d86-88aea6f1ddff tempest-VolumeQuotasNegativeTestJSON-1220524757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-ed6cd8a2-073c-4357-972d-426b02028bfa {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:14:51 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-338a2ef4-2867-42b2-9c94-68d6768b2405 tempest-VolumesTransfersTest-282802536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-75fb72d5-25d5-4705-b5bc-3d12b4652cf7 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:14:51 devstack sudo[87614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-75fb72d5-25d5-4705-b5bc-3d12b4652cf7
Apr 10 13:14:51 devstack sudo[87614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:14:51 devstack sudo[87613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-ed6cd8a2-073c-4357-972d-426b02028bfa
Apr 10 13:14:51 devstack sudo[87613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:14:51 devstack sudo[87614]: pam_unix(sudo:session): session closed for user root
Apr 10 13:14:51 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-338a2ef4-2867-42b2-9c94-68d6768b2405 tempest-VolumesTransfersTest-282802536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-75fb72d5-25d5-4705-b5bc-3d12b4652cf7" returned: 0 in 0.469s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:14:51 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-338a2ef4-2867-42b2-9c94-68d6768b2405 tempest-VolumesTransfersTest-282802536 None] <== create_volume: return (1134ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'} {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 13:14:51 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-338a2ef4-2867-42b2-9c94-68d6768b2405 tempest-VolumesTransfersTest-282802536 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.137s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:14:51 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-338a2ef4-2867-42b2-9c94-68d6768b2405 tempest-VolumesTransfersTest-282802536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d7d4e8f-1c93-4571-9546-1f4b27e4652a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75fb72d5-25d5-4705-b5bc-3d12b4652cf7', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:14:51 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-338a2ef4-2867-42b2-9c94-68d6768b2405 tempest-VolumesTransfersTest-282802536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c45123a-ab5b-446f-b560-c2d3d6c38ebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:14:51 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-338a2ef4-2867-42b2-9c94-68d6768b2405 tempest-VolumesTransfersTest-282802536 None] Volume volume-75fb72d5-25d5-4705-b5bc-3d12b4652cf7 (75fb72d5-25d5-4705-b5bc-3d12b4652cf7): created successfully
Apr 10 13:14:51 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-338a2ef4-2867-42b2-9c94-68d6768b2405 tempest-VolumesTransfersTest-282802536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c45123a-ab5b-446f-b560-c2d3d6c38ebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:14:51 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-338a2ef4-2867-42b2-9c94-68d6768b2405 tempest-VolumesTransfersTest-282802536 None] Flow 'volume_create_manager' (e4501a95-d4d5-46c6-afe1-7e66c661acf7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:14:51 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-338a2ef4-2867-42b2-9c94-68d6768b2405 tempest-VolumesTransfersTest-282802536 None] Created volume successfully.
Apr 10 13:14:52 devstack sudo[87613]: pam_unix(sudo:session): session closed for user root
Apr 10 13:14:52 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ebc7de1e-cf45-4b9c-9d86-88aea6f1ddff tempest-VolumeQuotasNegativeTestJSON-1220524757 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-ed6cd8a2-073c-4357-972d-426b02028bfa" returned: 0 in 0.655s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:14:52 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ebc7de1e-cf45-4b9c-9d86-88aea6f1ddff tempest-VolumeQuotasNegativeTestJSON-1220524757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-ed6cd8a2-073c-4357-972d-426b02028bfa {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:14:52 devstack sudo[87623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-ed6cd8a2-073c-4357-972d-426b02028bfa
Apr 10 13:14:52 devstack sudo[87623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:14:52 devstack sudo[87623]: pam_unix(sudo:session): session closed for user root
Apr 10 13:14:52 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ebc7de1e-cf45-4b9c-9d86-88aea6f1ddff tempest-VolumeQuotasNegativeTestJSON-1220524757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-ed6cd8a2-073c-4357-972d-426b02028bfa" returned: 0 in 0.467s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:14:52 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-ebc7de1e-cf45-4b9c-9d86-88aea6f1ddff tempest-VolumeQuotasNegativeTestJSON-1220524757 None] Lock "cinder-quobyte-ed6cd8a2-073c-4357-972d-426b02028bfa" released by "delete_volume" :: held 1.175s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:14:52 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-ebc7de1e-cf45-4b9c-9d86-88aea6f1ddff tempest-VolumeQuotasNegativeTestJSON-1220524757 None] Created reservations ['707b9720-9db9-431e-9dfc-2bb0b9932c13', 'ea284772-a952-4c17-99ff-1b818a909af1', '922ff546-0bd6-4b24-bd60-c9be046e6ef4', 'e27debfd-1c9b-4772-9b4c-15f991c1f1b4'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:14:52 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-ebc7de1e-cf45-4b9c-9d86-88aea6f1ddff tempest-VolumeQuotasNegativeTestJSON-1220524757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:14:52 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-ebc7de1e-cf45-4b9c-9d86-88aea6f1ddff tempest-VolumeQuotasNegativeTestJSON-1220524757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:14:52 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-ebc7de1e-cf45-4b9c-9d86-88aea6f1ddff tempest-VolumeQuotasNegativeTestJSON-1220524757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:14:52 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-ebc7de1e-cf45-4b9c-9d86-88aea6f1ddff tempest-VolumeQuotasNegativeTestJSON-1220524757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:14:52 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-ebc7de1e-cf45-4b9c-9d86-88aea6f1ddff tempest-VolumeQuotasNegativeTestJSON-1220524757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:14:52 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ebc7de1e-cf45-4b9c-9d86-88aea6f1ddff tempest-VolumeQuotasNegativeTestJSON-1220524757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:14:52 devstack sudo[87626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:14:52 devstack sudo[87626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:14:52 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-c59ee3be-011c-420e-9dd5-a40c5e4412d6 tempest-VolumesTransfersTest-189018965 None] Acquiring lock "cinder-75fb72d5-25d5-4705-b5bc-3d12b4652cf7-delete_volume" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:14:52 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-c59ee3be-011c-420e-9dd5-a40c5e4412d6 tempest-VolumesTransfersTest-189018965 None] Lock "cinder-75fb72d5-25d5-4705-b5bc-3d12b4652cf7-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:14:52 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-c59ee3be-011c-420e-9dd5-a40c5e4412d6 tempest-VolumesTransfersTest-189018965 None] Acquiring lock "cinder-quobyte-75fb72d5-25d5-4705-b5bc-3d12b4652cf7" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:14:52 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-c59ee3be-011c-420e-9dd5-a40c5e4412d6 tempest-VolumesTransfersTest-189018965 None] Lock "cinder-quobyte-75fb72d5-25d5-4705-b5bc-3d12b4652cf7" acquired by "delete_volume" :: waited 0.016s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:14:53 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[28fa625c-2839-4c57-bad7-a5b3730868d0]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:14:53 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-c59ee3be-011c-420e-9dd5-a40c5e4412d6 tempest-VolumesTransfersTest-189018965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-75fb72d5-25d5-4705-b5bc-3d12b4652cf7 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:14:53 devstack sudo[87637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-75fb72d5-25d5-4705-b5bc-3d12b4652cf7
Apr 10 13:14:53 devstack sudo[87637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:14:53 devstack sudo[87626]: pam_unix(sudo:session): session closed for user root
Apr 10 13:14:53 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ebc7de1e-cf45-4b9c-9d86-88aea6f1ddff tempest-VolumeQuotasNegativeTestJSON-1220524757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.517s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:14:53 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-ebc7de1e-cf45-4b9c-9d86-88aea6f1ddff tempest-VolumeQuotasNegativeTestJSON-1220524757 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:14:53 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-ebc7de1e-cf45-4b9c-9d86-88aea6f1ddff tempest-VolumeQuotasNegativeTestJSON-1220524757 None] Deleted volume successfully.
Apr 10 13:14:53 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-ebc7de1e-cf45-4b9c-9d86-88aea6f1ddff tempest-VolumeQuotasNegativeTestJSON-1220524757 None] Lock "cinder-ed6cd8a2-073c-4357-972d-426b02028bfa-delete_volume" released by "delete_volume" :: held 1.876s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:14:53 devstack cinder-volume[83345]: DEBUG oslo_service.periodic_task [None req-c3f44832-ad7f-424b-a850-32c7352a19c5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83345) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 10 13:14:53 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-c3f44832-ad7f-424b-a850-32c7352a19c5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:14:53 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-c3f44832-ad7f-424b-a850-32c7352a19c5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:14:53 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-c3f44832-ad7f-424b-a850-32c7352a19c5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:14:53 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-c3f44832-ad7f-424b-a850-32c7352a19c5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:14:53 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-c3f44832-ad7f-424b-a850-32c7352a19c5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:14:53 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-c3f44832-ad7f-424b-a850-32c7352a19c5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:14:53 devstack sudo[87661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:14:53 devstack sudo[87661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:14:53 devstack sudo[87637]: pam_unix(sudo:session): session closed for user root
Apr 10 13:14:53 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-c59ee3be-011c-420e-9dd5-a40c5e4412d6 tempest-VolumesTransfersTest-189018965 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-75fb72d5-25d5-4705-b5bc-3d12b4652cf7" returned: 0 in 0.647s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:14:53 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-c59ee3be-011c-420e-9dd5-a40c5e4412d6 tempest-VolumesTransfersTest-189018965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-75fb72d5-25d5-4705-b5bc-3d12b4652cf7 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:14:53 devstack sudo[87664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-75fb72d5-25d5-4705-b5bc-3d12b4652cf7
Apr 10 13:14:53 devstack sudo[87664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:14:54 devstack sudo[87661]: pam_unix(sudo:session): session closed for user root
Apr 10 13:14:54 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-c3f44832-ad7f-424b-a850-32c7352a19c5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.516s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:14:54 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-c3f44832-ad7f-424b-a850-32c7352a19c5 None None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:14:54 devstack sudo[87664]: pam_unix(sudo:session): session closed for user root
Apr 10 13:14:54 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-c59ee3be-011c-420e-9dd5-a40c5e4412d6 tempest-VolumesTransfersTest-189018965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-75fb72d5-25d5-4705-b5bc-3d12b4652cf7" returned: 0 in 0.500s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:14:54 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-c59ee3be-011c-420e-9dd5-a40c5e4412d6 tempest-VolumesTransfersTest-189018965 None] Lock "cinder-quobyte-75fb72d5-25d5-4705-b5bc-3d12b4652cf7" released by "delete_volume" :: held 1.186s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:14:54 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-c59ee3be-011c-420e-9dd5-a40c5e4412d6 tempest-VolumesTransfersTest-189018965 None] Created reservations ['abae34fa-bf8b-4eee-aa22-8135594c6bb8', 'ed1491d8-74ad-435c-b104-622ed217e2f1', '2038e26b-0400-49cb-afb6-48c5c0da0eca', 'e4caaa83-8f3e-49b4-8399-58fb7f6c2202'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:14:54 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-c59ee3be-011c-420e-9dd5-a40c5e4412d6 tempest-VolumesTransfersTest-189018965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:14:54 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-c59ee3be-011c-420e-9dd5-a40c5e4412d6 tempest-VolumesTransfersTest-189018965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:14:54 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-c59ee3be-011c-420e-9dd5-a40c5e4412d6 tempest-VolumesTransfersTest-189018965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:14:54 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-c59ee3be-011c-420e-9dd5-a40c5e4412d6 tempest-VolumesTransfersTest-189018965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:14:54 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-c59ee3be-011c-420e-9dd5-a40c5e4412d6 tempest-VolumesTransfersTest-189018965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:14:54 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-c59ee3be-011c-420e-9dd5-a40c5e4412d6 tempest-VolumesTransfersTest-189018965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:14:54 devstack sudo[87669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:14:54 devstack sudo[87669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:14:54 devstack sudo[87669]: pam_unix(sudo:session): session closed for user root
Apr 10 13:14:54 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-c59ee3be-011c-420e-9dd5-a40c5e4412d6 tempest-VolumesTransfersTest-189018965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.493s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:14:54 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-c59ee3be-011c-420e-9dd5-a40c5e4412d6 tempest-VolumesTransfersTest-189018965 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:14:54 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-c59ee3be-011c-420e-9dd5-a40c5e4412d6 tempest-VolumesTransfersTest-189018965 None] Deleted volume successfully.
Apr 10 13:14:54 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-c59ee3be-011c-420e-9dd5-a40c5e4412d6 tempest-VolumesTransfersTest-189018965 None] Lock "cinder-75fb72d5-25d5-4705-b5bc-3d12b4652cf7-delete_volume" released by "delete_volume" :: held 1.854s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:14:58 devstack cinder-volume[83345]: DEBUG dbcounter [-] [83345] Writing DB stats cinder:SELECT=120,cinder:UPDATE=162,cinder:INSERT=38,cinder:DELETE=9 {{(pid=83345) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 10 13:14:58 devstack cinder-volume[83345]: DEBUG dbcounter [-] [83345] Writing DB stats cinder:SELECT=116,cinder:UPDATE=134,cinder:INSERT=33,cinder:DELETE=12 {{(pid=83345) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 10 13:14:58 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0e82028-f5d7-4487-b897-e0a215198c56 tempest-VolumeTypesAccessTest-765241066 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:14:58 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-e0e82028-f5d7-4487-b897-e0a215198c56 tempest-VolumeTypesAccessTest-765241066 None] Flow 'volume_create_manager' (297e9343-a456-44eb-aff2-cc2841d04d06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:14:58 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-e0e82028-f5d7-4487-b897-e0a215198c56 tempest-VolumeTypesAccessTest-765241066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36b40aab-d458-41cc-8c21-b40cef2498b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:14:58 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-e0e82028-f5d7-4487-b897-e0a215198c56 tempest-VolumeTypesAccessTest-765241066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36b40aab-d458-41cc-8c21-b40cef2498b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:14:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-802697413',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c4b4604-f4dd-4966-b0c0-4fad3114e0b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41e1bc2f0c3244498b0e2bc52f53d130',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:14:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:14:58Z,use_quota=True,user_id='e57a876972954ab79c0a449ea935a0d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01fe84fb-7cd7-4d57-a8a2-82ff125e1b46),volume_type_id=01fe84fb-7cd7-4d57-a8a2-82ff125e1b46)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:14:58 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-e0e82028-f5d7-4487-b897-e0a215198c56 tempest-VolumeTypesAccessTest-765241066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe23ca40-c7a4-4814-981d-20fdbf265713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:14:58 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-e0e82028-f5d7-4487-b897-e0a215198c56 tempest-VolumeTypesAccessTest-765241066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe23ca40-c7a4-4814-981d-20fdbf265713) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:14:58 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-e0e82028-f5d7-4487-b897-e0a215198c56 tempest-VolumeTypesAccessTest-765241066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b5cb7a8-d09b-4705-923e-b2d06f2468eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:14:58 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-e0e82028-f5d7-4487-b897-e0a215198c56 tempest-VolumeTypesAccessTest-765241066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b5cb7a8-d09b-4705-923e-b2d06f2468eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c4b4604-f4dd-4966-b0c0-4fad3114e0b4', 'volume_name': 'volume-6c4b4604-f4dd-4966-b0c0-4fad3114e0b4', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:14:58 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-e0e82028-f5d7-4487-b897-e0a215198c56 tempest-VolumeTypesAccessTest-765241066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed373698-1c22-4bf2-8982-291b2b8ff8fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:14:58 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-e0e82028-f5d7-4487-b897-e0a215198c56 tempest-VolumeTypesAccessTest-765241066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed373698-1c22-4bf2-8982-291b2b8ff8fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:14:58 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-e0e82028-f5d7-4487-b897-e0a215198c56 tempest-VolumeTypesAccessTest-765241066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a21b8e38-145f-4c7d-bc63-6e843ccd6367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:14:58 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-e0e82028-f5d7-4487-b897-e0a215198c56 tempest-VolumeTypesAccessTest-765241066 None] Volume 6c4b4604-f4dd-4966-b0c0-4fad3114e0b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c4b4604-f4dd-4966-b0c0-4fad3114e0b4', 'volume_size': 1}
Apr 10 13:14:58 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-e0e82028-f5d7-4487-b897-e0a215198c56 tempest-VolumeTypesAccessTest-765241066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:14:58 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-e0e82028-f5d7-4487-b897-e0a215198c56 tempest-VolumeTypesAccessTest-765241066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:14:58 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-e0e82028-f5d7-4487-b897-e0a215198c56 tempest-VolumeTypesAccessTest-765241066 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f252bf08b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:14:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-802697413',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c4b4604-f4dd-4966-b0c0-4fad3114e0b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41e1bc2f0c3244498b0e2bc52f53d130',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:14:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:14:58Z,use_quota=True,user_id='e57a876972954ab79c0a449ea935a0d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01fe84fb-7cd7-4d57-a8a2-82ff125e1b46),volume_type_id=01fe84fb-7cd7-4d57-a8a2-82ff125e1b46)}" {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 13:14:58 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-e0e82028-f5d7-4487-b897-e0a215198c56 tempest-VolumeTypesAccessTest-765241066 None] Creating volume 6c4b4604-f4dd-4966-b0c0-4fad3114e0b4 {{(pid=83345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 13:14:58 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-e0e82028-f5d7-4487-b897-e0a215198c56 tempest-VolumeTypesAccessTest-765241066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:14:58 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-e0e82028-f5d7-4487-b897-e0a215198c56 tempest-VolumeTypesAccessTest-765241066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:14:58 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-e0e82028-f5d7-4487-b897-e0a215198c56 tempest-VolumeTypesAccessTest-765241066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:14:58 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-e0e82028-f5d7-4487-b897-e0a215198c56 tempest-VolumeTypesAccessTest-765241066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:14:58 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-e0e82028-f5d7-4487-b897-e0a215198c56 tempest-VolumeTypesAccessTest-765241066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:14:58 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-e0e82028-f5d7-4487-b897-e0a215198c56 tempest-VolumeTypesAccessTest-765241066 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:14:58 devstack cinder-volume[83345]: INFO cinder.volume.drivers.remotefs [None req-e0e82028-f5d7-4487-b897-e0a215198c56 tempest-VolumeTypesAccessTest-765241066 None] casted to osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331
Apr 10 13:14:58 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-e0e82028-f5d7-4487-b897-e0a215198c56 tempest-VolumeTypesAccessTest-765241066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-6c4b4604-f4dd-4966-b0c0-4fad3114e0b4 1073741824 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:14:58 devstack sudo[87689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-6c4b4604-f4dd-4966-b0c0-4fad3114e0b4 1073741824
Apr 10 13:14:58 devstack sudo[87689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:14:58 devstack sudo[87689]: pam_unix(sudo:session): session closed for user root
Apr 10 13:14:58 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-e0e82028-f5d7-4487-b897-e0a215198c56 tempest-VolumeTypesAccessTest-765241066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-6c4b4604-f4dd-4966-b0c0-4fad3114e0b4 1073741824" returned: 0 in 0.647s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:14:58 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-e0e82028-f5d7-4487-b897-e0a215198c56 tempest-VolumeTypesAccessTest-765241066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-6c4b4604-f4dd-4966-b0c0-4fad3114e0b4 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:14:59 devstack sudo[87694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-6c4b4604-f4dd-4966-b0c0-4fad3114e0b4
Apr 10 13:14:59 devstack sudo[87694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:14:59 devstack sudo[87694]: pam_unix(sudo:session): session closed for user root
Apr 10 13:14:59 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-e0e82028-f5d7-4487-b897-e0a215198c56 tempest-VolumeTypesAccessTest-765241066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-6c4b4604-f4dd-4966-b0c0-4fad3114e0b4" returned: 0 in 0.538s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:14:59 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-e0e82028-f5d7-4487-b897-e0a215198c56 tempest-VolumeTypesAccessTest-765241066 None] <== create_volume: return (1217ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'} {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 13:14:59 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-e0e82028-f5d7-4487-b897-e0a215198c56 tempest-VolumeTypesAccessTest-765241066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.218s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:14:59 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-e0e82028-f5d7-4487-b897-e0a215198c56 tempest-VolumeTypesAccessTest-765241066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a21b8e38-145f-4c7d-bc63-6e843ccd6367) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c4b4604-f4dd-4966-b0c0-4fad3114e0b4', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:14:59 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-e0e82028-f5d7-4487-b897-e0a215198c56 tempest-VolumeTypesAccessTest-765241066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09d1e1ea-514e-42c0-9b27-4a71c4f0b3bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:14:59 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-e0e82028-f5d7-4487-b897-e0a215198c56 tempest-VolumeTypesAccessTest-765241066 None] Volume volume-6c4b4604-f4dd-4966-b0c0-4fad3114e0b4 (6c4b4604-f4dd-4966-b0c0-4fad3114e0b4): created successfully
Apr 10 13:14:59 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-e0e82028-f5d7-4487-b897-e0a215198c56 tempest-VolumeTypesAccessTest-765241066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09d1e1ea-514e-42c0-9b27-4a71c4f0b3bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:14:59 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-e0e82028-f5d7-4487-b897-e0a215198c56 tempest-VolumeTypesAccessTest-765241066 None] Flow 'volume_create_manager' (297e9343-a456-44eb-aff2-cc2841d04d06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:14:59 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-e0e82028-f5d7-4487-b897-e0a215198c56 tempest-VolumeTypesAccessTest-765241066 None] Created volume successfully.
Apr 10 13:15:00 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-b10bd041-835a-49cd-af3a-0da4f252b829 tempest-VolumesTransfersV355Test-1925984413 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:15:00 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-b10bd041-835a-49cd-af3a-0da4f252b829 tempest-VolumesTransfersV355Test-1925984413 None] Flow 'volume_create_manager' (4bfd213c-6f31-4e69-9a4a-2cd23a980a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:15:00 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-b10bd041-835a-49cd-af3a-0da4f252b829 tempest-VolumesTransfersV355Test-1925984413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddb0aa13-24b0-4572-99de-3a8a1b2e2a86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:15:00 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-b10bd041-835a-49cd-af3a-0da4f252b829 tempest-VolumesTransfersV355Test-1925984413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddb0aa13-24b0-4572-99de-3a8a1b2e2a86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:15:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-722286982',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7cc8b04-ef3c-42a9-a536-e451778e9a43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73ee7e4275874394a75df46de2a5fe8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:15:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:15:00Z,use_quota=True,user_id='d42a309d1c7f41b2ab59b7d57040896f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:15:00 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-b10bd041-835a-49cd-af3a-0da4f252b829 tempest-VolumesTransfersV355Test-1925984413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54f54913-de93-4d09-a599-be6059d34b17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:15:00 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-b10bd041-835a-49cd-af3a-0da4f252b829 tempest-VolumesTransfersV355Test-1925984413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54f54913-de93-4d09-a599-be6059d34b17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:15:00 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-b10bd041-835a-49cd-af3a-0da4f252b829 tempest-VolumesTransfersV355Test-1925984413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aaa4c052-129b-448d-9524-516353920cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:15:00 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-b10bd041-835a-49cd-af3a-0da4f252b829 tempest-VolumesTransfersV355Test-1925984413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aaa4c052-129b-448d-9524-516353920cde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7cc8b04-ef3c-42a9-a536-e451778e9a43', 'volume_name': 'volume-b7cc8b04-ef3c-42a9-a536-e451778e9a43', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:15:00 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-b10bd041-835a-49cd-af3a-0da4f252b829 tempest-VolumesTransfersV355Test-1925984413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94b5833e-b9fa-4cf6-9a53-bbba314e49eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:15:00 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-b10bd041-835a-49cd-af3a-0da4f252b829 tempest-VolumesTransfersV355Test-1925984413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94b5833e-b9fa-4cf6-9a53-bbba314e49eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:15:00 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-b10bd041-835a-49cd-af3a-0da4f252b829 tempest-VolumesTransfersV355Test-1925984413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15fa6290-ad11-4076-b533-c97023cbb36b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:15:00 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-b10bd041-835a-49cd-af3a-0da4f252b829 tempest-VolumesTransfersV355Test-1925984413 None] Volume b7cc8b04-ef3c-42a9-a536-e451778e9a43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7cc8b04-ef3c-42a9-a536-e451778e9a43', 'volume_size': 1}
Apr 10 13:15:00 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-b10bd041-835a-49cd-af3a-0da4f252b829 tempest-VolumesTransfersV355Test-1925984413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:15:00 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-b10bd041-835a-49cd-af3a-0da4f252b829 tempest-VolumesTransfersV355Test-1925984413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:15:00 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-b10bd041-835a-49cd-af3a-0da4f252b829 tempest-VolumesTransfersV355Test-1925984413 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f252bf08b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:15:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-722286982',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7cc8b04-ef3c-42a9-a536-e451778e9a43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73ee7e4275874394a75df46de2a5fe8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:15:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:15:00Z,use_quota=True,user_id='d42a309d1c7f41b2ab59b7d57040896f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)}" {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 13:15:00 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-b10bd041-835a-49cd-af3a-0da4f252b829 tempest-VolumesTransfersV355Test-1925984413 None] Creating volume b7cc8b04-ef3c-42a9-a536-e451778e9a43 {{(pid=83345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 13:15:00 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-b10bd041-835a-49cd-af3a-0da4f252b829 tempest-VolumesTransfersV355Test-1925984413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:15:00 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-b10bd041-835a-49cd-af3a-0da4f252b829 tempest-VolumesTransfersV355Test-1925984413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:15:00 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-b10bd041-835a-49cd-af3a-0da4f252b829 tempest-VolumesTransfersV355Test-1925984413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:15:00 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-b10bd041-835a-49cd-af3a-0da4f252b829 tempest-VolumesTransfersV355Test-1925984413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:15:00 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-b10bd041-835a-49cd-af3a-0da4f252b829 tempest-VolumesTransfersV355Test-1925984413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:15:00 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-b10bd041-835a-49cd-af3a-0da4f252b829 tempest-VolumesTransfersV355Test-1925984413 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:15:00 devstack cinder-volume[83345]: INFO cinder.volume.drivers.remotefs [None req-b10bd041-835a-49cd-af3a-0da4f252b829 tempest-VolumesTransfersV355Test-1925984413 None] casted to osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331
Apr 10 13:15:00 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-b10bd041-835a-49cd-af3a-0da4f252b829 tempest-VolumesTransfersV355Test-1925984413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b7cc8b04-ef3c-42a9-a536-e451778e9a43 1073741824 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:15:00 devstack sudo[87701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b7cc8b04-ef3c-42a9-a536-e451778e9a43 1073741824
Apr 10 13:15:00 devstack sudo[87701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:15:00 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-20b4a7cb-ffed-4159-bbbe-ed7fa8da221c tempest-VolumeTypesAccessTest-765241066 None] Acquiring lock "cinder-6c4b4604-f4dd-4966-b0c0-4fad3114e0b4-delete_volume" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:15:00 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-20b4a7cb-ffed-4159-bbbe-ed7fa8da221c tempest-VolumeTypesAccessTest-765241066 None] Lock "cinder-6c4b4604-f4dd-4966-b0c0-4fad3114e0b4-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:15:00 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-20b4a7cb-ffed-4159-bbbe-ed7fa8da221c tempest-VolumeTypesAccessTest-765241066 None] Acquiring lock "cinder-quobyte-6c4b4604-f4dd-4966-b0c0-4fad3114e0b4" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:15:00 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-20b4a7cb-ffed-4159-bbbe-ed7fa8da221c tempest-VolumeTypesAccessTest-765241066 None] Lock "cinder-quobyte-6c4b4604-f4dd-4966-b0c0-4fad3114e0b4" acquired by "delete_volume" :: waited 0.019s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:15:00 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[0431af44-ec25-459d-8103-95b5660466b5]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:15:00 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-20b4a7cb-ffed-4159-bbbe-ed7fa8da221c tempest-VolumeTypesAccessTest-765241066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-6c4b4604-f4dd-4966-b0c0-4fad3114e0b4 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:15:00 devstack sudo[87703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-6c4b4604-f4dd-4966-b0c0-4fad3114e0b4
Apr 10 13:15:00 devstack sudo[87703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:15:01 devstack sudo[87701]: pam_unix(sudo:session): session closed for user root
Apr 10 13:15:01 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-b10bd041-835a-49cd-af3a-0da4f252b829 tempest-VolumesTransfersV355Test-1925984413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b7cc8b04-ef3c-42a9-a536-e451778e9a43 1073741824" returned: 0 in 0.909s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:15:01 devstack sudo[87703]: pam_unix(sudo:session): session closed for user root
Apr 10 13:15:01 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-20b4a7cb-ffed-4159-bbbe-ed7fa8da221c tempest-VolumeTypesAccessTest-765241066 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-6c4b4604-f4dd-4966-b0c0-4fad3114e0b4" returned: 0 in 0.738s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:15:01 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-20b4a7cb-ffed-4159-bbbe-ed7fa8da221c tempest-VolumeTypesAccessTest-765241066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-6c4b4604-f4dd-4966-b0c0-4fad3114e0b4 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:15:01 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-b10bd041-835a-49cd-af3a-0da4f252b829 tempest-VolumesTransfersV355Test-1925984413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b7cc8b04-ef3c-42a9-a536-e451778e9a43 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:15:01 devstack sudo[87737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-6c4b4604-f4dd-4966-b0c0-4fad3114e0b4
Apr 10 13:15:01 devstack sudo[87737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:15:01 devstack sudo[87739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b7cc8b04-ef3c-42a9-a536-e451778e9a43
Apr 10 13:15:01 devstack sudo[87739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:15:01 devstack sudo[87737]: pam_unix(sudo:session): session closed for user root
Apr 10 13:15:01 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-20b4a7cb-ffed-4159-bbbe-ed7fa8da221c tempest-VolumeTypesAccessTest-765241066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-6c4b4604-f4dd-4966-b0c0-4fad3114e0b4" returned: 0 in 0.545s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:15:01 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-20b4a7cb-ffed-4159-bbbe-ed7fa8da221c tempest-VolumeTypesAccessTest-765241066 None] Lock "cinder-quobyte-6c4b4604-f4dd-4966-b0c0-4fad3114e0b4" released by "delete_volume" :: held 1.320s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:15:01 devstack cinder-volume[83345]: WARNING cinder.quota [None req-20b4a7cb-ffed-4159-bbbe-ed7fa8da221c tempest-VolumeTypesAccessTest-765241066 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1213230900 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1213230900, it is now deprecated. Please use the default quota class for default quota.
Apr 10 13:15:01 devstack cinder-volume[83345]: WARNING cinder.quota [None req-20b4a7cb-ffed-4159-bbbe-ed7fa8da221c tempest-VolumeTypesAccessTest-765241066 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1213230900 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1213230900, it is now deprecated. Please use the default quota class for default quota.
Apr 10 13:15:02 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-20b4a7cb-ffed-4159-bbbe-ed7fa8da221c tempest-VolumeTypesAccessTest-765241066 None] Created reservations ['8910601e-6fe4-4236-a3a4-ab0d8869f32d', '8c658dd6-ebcf-4cbb-a2c8-347704c3ba7d', 'b548266e-b045-4d3d-b572-2336300296f9', '5ce8434b-506a-4a65-afa6-b5642d15fa58'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:15:02 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-20b4a7cb-ffed-4159-bbbe-ed7fa8da221c tempest-VolumeTypesAccessTest-765241066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:15:02 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-20b4a7cb-ffed-4159-bbbe-ed7fa8da221c tempest-VolumeTypesAccessTest-765241066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:15:02 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-20b4a7cb-ffed-4159-bbbe-ed7fa8da221c tempest-VolumeTypesAccessTest-765241066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:15:02 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-20b4a7cb-ffed-4159-bbbe-ed7fa8da221c tempest-VolumeTypesAccessTest-765241066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:15:02 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-20b4a7cb-ffed-4159-bbbe-ed7fa8da221c tempest-VolumeTypesAccessTest-765241066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:15:02 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-20b4a7cb-ffed-4159-bbbe-ed7fa8da221c tempest-VolumeTypesAccessTest-765241066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:15:02 devstack sudo[87746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:15:02 devstack sudo[87746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:15:02 devstack sudo[87739]: pam_unix(sudo:session): session closed for user root
Apr 10 13:15:02 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-b10bd041-835a-49cd-af3a-0da4f252b829 tempest-VolumesTransfersV355Test-1925984413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b7cc8b04-ef3c-42a9-a536-e451778e9a43" returned: 0 in 1.033s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:15:02 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-b10bd041-835a-49cd-af3a-0da4f252b829 tempest-VolumesTransfersV355Test-1925984413 None] <== create_volume: return (2012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'} {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 13:15:02 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-b10bd041-835a-49cd-af3a-0da4f252b829 tempest-VolumesTransfersV355Test-1925984413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.014s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:15:02 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-b10bd041-835a-49cd-af3a-0da4f252b829 tempest-VolumesTransfersV355Test-1925984413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15fa6290-ad11-4076-b533-c97023cbb36b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7cc8b04-ef3c-42a9-a536-e451778e9a43', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:15:02 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-b10bd041-835a-49cd-af3a-0da4f252b829 tempest-VolumesTransfersV355Test-1925984413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb8c791d-1707-43f9-9070-70f1fd220abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:15:02 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-b10bd041-835a-49cd-af3a-0da4f252b829 tempest-VolumesTransfersV355Test-1925984413 None] Volume volume-b7cc8b04-ef3c-42a9-a536-e451778e9a43 (b7cc8b04-ef3c-42a9-a536-e451778e9a43): created successfully
Apr 10 13:15:02 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-b10bd041-835a-49cd-af3a-0da4f252b829 tempest-VolumesTransfersV355Test-1925984413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb8c791d-1707-43f9-9070-70f1fd220abf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:15:02 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-b10bd041-835a-49cd-af3a-0da4f252b829 tempest-VolumesTransfersV355Test-1925984413 None] Flow 'volume_create_manager' (4bfd213c-6f31-4e69-9a4a-2cd23a980a48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:15:02 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-b10bd041-835a-49cd-af3a-0da4f252b829 tempest-VolumesTransfersV355Test-1925984413 None] Created volume successfully.
Apr 10 13:15:02 devstack sudo[87746]: pam_unix(sudo:session): session closed for user root
Apr 10 13:15:02 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-20b4a7cb-ffed-4159-bbbe-ed7fa8da221c tempest-VolumeTypesAccessTest-765241066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.624s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:15:02 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-20b4a7cb-ffed-4159-bbbe-ed7fa8da221c tempest-VolumeTypesAccessTest-765241066 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:15:02 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-20b4a7cb-ffed-4159-bbbe-ed7fa8da221c tempest-VolumeTypesAccessTest-765241066 None] Deleted volume successfully.
Apr 10 13:15:02 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-20b4a7cb-ffed-4159-bbbe-ed7fa8da221c tempest-VolumeTypesAccessTest-765241066 None] Lock "cinder-6c4b4604-f4dd-4966-b0c0-4fad3114e0b4-delete_volume" released by "delete_volume" :: held 2.292s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:15:03 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-b7f1a54d-1ae8-45a6-85fb-1732a2e63739 tempest-VolumesActionsTest-353155709 None] Acquiring lock "cinder-99a2ad7b-89ba-4314-8b09-0871e97a3712" by "attach_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:15:03 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-b7f1a54d-1ae8-45a6-85fb-1732a2e63739 tempest-VolumesActionsTest-353155709 None] Lock "cinder-99a2ad7b-89ba-4314-8b09-0871e97a3712" acquired by "attach_volume" :: waited 0.010s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:15:03 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-b7f1a54d-1ae8-45a6-85fb-1732a2e63739 tempest-VolumesActionsTest-353155709 None] Attaching volume 99a2ad7b-89ba-4314-8b09-0871e97a3712 to instance fa9ca394-6131-4b5c-9adc-cdd1ebe33d34 at mountpoint /dev/vdb on host None.
Apr 10 13:15:03 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-b7f1a54d-1ae8-45a6-85fb-1732a2e63739 tempest-VolumesActionsTest-353155709 None] Attach volume completed successfully.
Apr 10 13:15:03 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-b7f1a54d-1ae8-45a6-85fb-1732a2e63739 tempest-VolumesActionsTest-353155709 None] Lock "cinder-99a2ad7b-89ba-4314-8b09-0871e97a3712" released by "attach_volume" :: held 0.117s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:15:03 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-b3efe6bd-16cf-4963-9fa7-0481f07a5b24 tempest-VolumesTransfersV355Test-1359094797 None] Transfer volume completed successfully.
Apr 10 13:15:04 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-8813e0c6-fd67-406e-8031-da0ee29c6fc7 tempest-VolumesActionsTest-353155709 None] Acquiring lock "cinder-99a2ad7b-89ba-4314-8b09-0871e97a3712-detach_volume" by "detach_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:15:04 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-8813e0c6-fd67-406e-8031-da0ee29c6fc7 tempest-VolumesActionsTest-353155709 None] Lock "cinder-99a2ad7b-89ba-4314-8b09-0871e97a3712-detach_volume" acquired by "detach_volume" :: waited 0.008s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:15:04 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-8813e0c6-fd67-406e-8031-da0ee29c6fc7 tempest-VolumesActionsTest-353155709 None] Detaching volume 99a2ad7b-89ba-4314-8b09-0871e97a3712 from instance fa9ca394-6131-4b5c-9adc-cdd1ebe33d34.
Apr 10 13:15:04 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-8813e0c6-fd67-406e-8031-da0ee29c6fc7 tempest-VolumesActionsTest-353155709 None] Detach volume completed successfully.
Apr 10 13:15:04 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-8813e0c6-fd67-406e-8031-da0ee29c6fc7 tempest-VolumesActionsTest-353155709 None] Lock "cinder-99a2ad7b-89ba-4314-8b09-0871e97a3712-detach_volume" released by "detach_volume" :: held 0.055s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:15:05 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [req-24299763-b453-4893-9607-e7f16b51e831 req-d0bc9a0f-f7b9-4fe2-8d37-8b22614fd395 tempest-VolumesGetTestJSON-497916317 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:15:05 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [req-24299763-b453-4893-9607-e7f16b51e831 req-d0bc9a0f-f7b9-4fe2-8d37-8b22614fd395 tempest-VolumesGetTestJSON-497916317 None] Flow 'volume_create_manager' (f7e2de31-d88b-45b7-b48d-ccf364b31954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:15:05 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [req-24299763-b453-4893-9607-e7f16b51e831 req-d0bc9a0f-f7b9-4fe2-8d37-8b22614fd395 tempest-VolumesGetTestJSON-497916317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e057a257-b0d8-4825-af1b-e261a50d24d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:15:05 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [req-24299763-b453-4893-9607-e7f16b51e831 req-d0bc9a0f-f7b9-4fe2-8d37-8b22614fd395 tempest-VolumesGetTestJSON-497916317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e057a257-b0d8-4825-af1b-e261a50d24d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:15:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-466519014',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1857bb80-e610-4170-8375-3c2c092a2516,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ce3c5376d27f43728f0c33539285b997',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:15:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:15:05Z,use_quota=True,user_id='efb65a4e46fb47c193e235aa5027c1c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:15:05 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [req-24299763-b453-4893-9607-e7f16b51e831 req-d0bc9a0f-f7b9-4fe2-8d37-8b22614fd395 tempest-VolumesGetTestJSON-497916317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b407ef9d-cecf-49dc-845e-2ac2838fd5a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:15:05 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [req-24299763-b453-4893-9607-e7f16b51e831 req-d0bc9a0f-f7b9-4fe2-8d37-8b22614fd395 tempest-VolumesGetTestJSON-497916317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b407ef9d-cecf-49dc-845e-2ac2838fd5a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:15:05 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [req-24299763-b453-4893-9607-e7f16b51e831 req-d0bc9a0f-f7b9-4fe2-8d37-8b22614fd395 tempest-VolumesGetTestJSON-497916317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ceaa5f4e-34bb-4037-bd62-2df51b48da65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:15:05 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [req-24299763-b453-4893-9607-e7f16b51e831 req-d0bc9a0f-f7b9-4fe2-8d37-8b22614fd395 tempest-VolumesGetTestJSON-497916317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ceaa5f4e-34bb-4037-bd62-2df51b48da65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1857bb80-e610-4170-8375-3c2c092a2516', 'volume_name': 'volume-1857bb80-e610-4170-8375-3c2c092a2516', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:15:05 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [req-24299763-b453-4893-9607-e7f16b51e831 req-d0bc9a0f-f7b9-4fe2-8d37-8b22614fd395 tempest-VolumesGetTestJSON-497916317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6a29270-6753-4236-93b1-445ba725aba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:15:05 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [req-24299763-b453-4893-9607-e7f16b51e831 req-d0bc9a0f-f7b9-4fe2-8d37-8b22614fd395 tempest-VolumesGetTestJSON-497916317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6a29270-6753-4236-93b1-445ba725aba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:15:05 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [req-24299763-b453-4893-9607-e7f16b51e831 req-d0bc9a0f-f7b9-4fe2-8d37-8b22614fd395 tempest-VolumesGetTestJSON-497916317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61bf0ed6-b7d2-4ac9-97fd-856e46244ac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:15:05 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [req-24299763-b453-4893-9607-e7f16b51e831 req-d0bc9a0f-f7b9-4fe2-8d37-8b22614fd395 tempest-VolumesGetTestJSON-497916317 None] Volume 1857bb80-e610-4170-8375-3c2c092a2516: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1857bb80-e610-4170-8375-3c2c092a2516', 'volume_size': 1}
Apr 10 13:15:05 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [req-24299763-b453-4893-9607-e7f16b51e831 req-d0bc9a0f-f7b9-4fe2-8d37-8b22614fd395 tempest-VolumesGetTestJSON-497916317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:15:05 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [req-24299763-b453-4893-9607-e7f16b51e831 req-d0bc9a0f-f7b9-4fe2-8d37-8b22614fd395 tempest-VolumesGetTestJSON-497916317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:15:05 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [req-24299763-b453-4893-9607-e7f16b51e831 req-d0bc9a0f-f7b9-4fe2-8d37-8b22614fd395 tempest-VolumesGetTestJSON-497916317 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f252bf08b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:15:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-466519014',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1857bb80-e610-4170-8375-3c2c092a2516,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ce3c5376d27f43728f0c33539285b997',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:15:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:15:05Z,use_quota=True,user_id='efb65a4e46fb47c193e235aa5027c1c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)}" {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 13:15:05 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [req-24299763-b453-4893-9607-e7f16b51e831 req-d0bc9a0f-f7b9-4fe2-8d37-8b22614fd395 tempest-VolumesGetTestJSON-497916317 None] Creating volume 1857bb80-e610-4170-8375-3c2c092a2516 {{(pid=83345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 13:15:05 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [req-24299763-b453-4893-9607-e7f16b51e831 req-d0bc9a0f-f7b9-4fe2-8d37-8b22614fd395 tempest-VolumesGetTestJSON-497916317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:15:05 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [req-24299763-b453-4893-9607-e7f16b51e831 req-d0bc9a0f-f7b9-4fe2-8d37-8b22614fd395 tempest-VolumesGetTestJSON-497916317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:15:05 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [req-24299763-b453-4893-9607-e7f16b51e831 req-d0bc9a0f-f7b9-4fe2-8d37-8b22614fd395 tempest-VolumesGetTestJSON-497916317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:15:05 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [req-24299763-b453-4893-9607-e7f16b51e831 req-d0bc9a0f-f7b9-4fe2-8d37-8b22614fd395 tempest-VolumesGetTestJSON-497916317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:15:05 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [req-24299763-b453-4893-9607-e7f16b51e831 req-d0bc9a0f-f7b9-4fe2-8d37-8b22614fd395 tempest-VolumesGetTestJSON-497916317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:15:05 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [req-24299763-b453-4893-9607-e7f16b51e831 req-d0bc9a0f-f7b9-4fe2-8d37-8b22614fd395 tempest-VolumesGetTestJSON-497916317 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:15:05 devstack cinder-volume[83345]: INFO cinder.volume.drivers.remotefs [req-24299763-b453-4893-9607-e7f16b51e831 req-d0bc9a0f-f7b9-4fe2-8d37-8b22614fd395 tempest-VolumesGetTestJSON-497916317 None] casted to osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331
Apr 10 13:15:05 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [req-24299763-b453-4893-9607-e7f16b51e831 req-d0bc9a0f-f7b9-4fe2-8d37-8b22614fd395 tempest-VolumesGetTestJSON-497916317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-1857bb80-e610-4170-8375-3c2c092a2516 1073741824 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:15:05 devstack sudo[87751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-1857bb80-e610-4170-8375-3c2c092a2516 1073741824
Apr 10 13:15:05 devstack sudo[87751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:15:05 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-380c44ec-b2c6-44c7-987a-6e6ab8b5e775 tempest-VolumesTransfersV355Test-942438938 None] Acquiring lock "cinder-b7cc8b04-ef3c-42a9-a536-e451778e9a43-delete_volume" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:15:05 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-380c44ec-b2c6-44c7-987a-6e6ab8b5e775 tempest-VolumesTransfersV355Test-942438938 None] Lock "cinder-b7cc8b04-ef3c-42a9-a536-e451778e9a43-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:15:05 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-380c44ec-b2c6-44c7-987a-6e6ab8b5e775 tempest-VolumesTransfersV355Test-942438938 None] Acquiring lock "cinder-quobyte-b7cc8b04-ef3c-42a9-a536-e451778e9a43" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:15:05 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-380c44ec-b2c6-44c7-987a-6e6ab8b5e775 tempest-VolumesTransfersV355Test-942438938 None] Lock "cinder-quobyte-b7cc8b04-ef3c-42a9-a536-e451778e9a43" acquired by "delete_volume" :: waited 0.017s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:15:05 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[40e16e51-3c4e-473e-a368-9075fed157c9]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:15:05 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-380c44ec-b2c6-44c7-987a-6e6ab8b5e775 tempest-VolumesTransfersV355Test-942438938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b7cc8b04-ef3c-42a9-a536-e451778e9a43 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:15:05 devstack sudo[87753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b7cc8b04-ef3c-42a9-a536-e451778e9a43
Apr 10 13:15:05 devstack sudo[87753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:15:05 devstack sudo[87751]: pam_unix(sudo:session): session closed for user root
Apr 10 13:15:05 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [req-24299763-b453-4893-9607-e7f16b51e831 req-d0bc9a0f-f7b9-4fe2-8d37-8b22614fd395 tempest-VolumesGetTestJSON-497916317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-1857bb80-e610-4170-8375-3c2c092a2516 1073741824" returned: 0 in 0.762s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:15:05 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [req-24299763-b453-4893-9607-e7f16b51e831 req-d0bc9a0f-f7b9-4fe2-8d37-8b22614fd395 tempest-VolumesGetTestJSON-497916317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-1857bb80-e610-4170-8375-3c2c092a2516 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:15:06 devstack sudo[87767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-1857bb80-e610-4170-8375-3c2c092a2516
Apr 10 13:15:06 devstack sudo[87767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:15:06 devstack sudo[87753]: pam_unix(sudo:session): session closed for user root
Apr 10 13:15:06 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-380c44ec-b2c6-44c7-987a-6e6ab8b5e775 tempest-VolumesTransfersV355Test-942438938 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b7cc8b04-ef3c-42a9-a536-e451778e9a43" returned: 0 in 0.790s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:15:06 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-380c44ec-b2c6-44c7-987a-6e6ab8b5e775 tempest-VolumesTransfersV355Test-942438938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b7cc8b04-ef3c-42a9-a536-e451778e9a43 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:15:06 devstack sudo[87789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b7cc8b04-ef3c-42a9-a536-e451778e9a43
Apr 10 13:15:06 devstack sudo[87789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:15:06 devstack sudo[87767]: pam_unix(sudo:session): session closed for user root
Apr 10 13:15:06 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [req-24299763-b453-4893-9607-e7f16b51e831 req-d0bc9a0f-f7b9-4fe2-8d37-8b22614fd395 tempest-VolumesGetTestJSON-497916317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-1857bb80-e610-4170-8375-3c2c092a2516" returned: 0 in 0.557s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:15:06 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [req-24299763-b453-4893-9607-e7f16b51e831 req-d0bc9a0f-f7b9-4fe2-8d37-8b22614fd395 tempest-VolumesGetTestJSON-497916317 None] <== create_volume: return (1361ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'} {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 13:15:06 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [req-24299763-b453-4893-9607-e7f16b51e831 req-d0bc9a0f-f7b9-4fe2-8d37-8b22614fd395 tempest-VolumesGetTestJSON-497916317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.363s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:15:06 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [req-24299763-b453-4893-9607-e7f16b51e831 req-d0bc9a0f-f7b9-4fe2-8d37-8b22614fd395 tempest-VolumesGetTestJSON-497916317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61bf0ed6-b7d2-4ac9-97fd-856e46244ac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1857bb80-e610-4170-8375-3c2c092a2516', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:15:06 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [req-24299763-b453-4893-9607-e7f16b51e831 req-d0bc9a0f-f7b9-4fe2-8d37-8b22614fd395 tempest-VolumesGetTestJSON-497916317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04d100a8-06e3-42ce-b3e7-7f3f3411de1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:15:06 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [req-24299763-b453-4893-9607-e7f16b51e831 req-d0bc9a0f-f7b9-4fe2-8d37-8b22614fd395 tempest-VolumesGetTestJSON-497916317 None] Volume volume-1857bb80-e610-4170-8375-3c2c092a2516 (1857bb80-e610-4170-8375-3c2c092a2516): created successfully
Apr 10 13:15:06 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [req-24299763-b453-4893-9607-e7f16b51e831 req-d0bc9a0f-f7b9-4fe2-8d37-8b22614fd395 tempest-VolumesGetTestJSON-497916317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04d100a8-06e3-42ce-b3e7-7f3f3411de1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:15:06 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [req-24299763-b453-4893-9607-e7f16b51e831 req-d0bc9a0f-f7b9-4fe2-8d37-8b22614fd395 tempest-VolumesGetTestJSON-497916317 None] Flow 'volume_create_manager' (f7e2de31-d88b-45b7-b48d-ccf364b31954) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:15:06 devstack cinder-volume[83345]: INFO cinder.volume.manager [req-24299763-b453-4893-9607-e7f16b51e831 req-d0bc9a0f-f7b9-4fe2-8d37-8b22614fd395 tempest-VolumesGetTestJSON-497916317 None] Created volume successfully.
Apr 10 13:15:06 devstack sudo[87789]: pam_unix(sudo:session): session closed for user root
Apr 10 13:15:06 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-380c44ec-b2c6-44c7-987a-6e6ab8b5e775 tempest-VolumesTransfersV355Test-942438938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b7cc8b04-ef3c-42a9-a536-e451778e9a43" returned: 0 in 0.583s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:15:06 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-380c44ec-b2c6-44c7-987a-6e6ab8b5e775 tempest-VolumesTransfersV355Test-942438938 None] Lock "cinder-quobyte-b7cc8b04-ef3c-42a9-a536-e451778e9a43" released by "delete_volume" :: held 1.402s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:15:06 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-380c44ec-b2c6-44c7-987a-6e6ab8b5e775 tempest-VolumesTransfersV355Test-942438938 None] Created reservations ['05d3e446-afee-4324-8bb4-9dc169e33de1', '0556f589-6c87-4710-a352-876ccf31adfd', 'ff201a39-c3c6-4771-b803-30289c0d7ca6', 'baf0816b-6b8a-41dc-8023-45fd34b7bd57'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:15:06 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-380c44ec-b2c6-44c7-987a-6e6ab8b5e775 tempest-VolumesTransfersV355Test-942438938 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:15:06 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-380c44ec-b2c6-44c7-987a-6e6ab8b5e775 tempest-VolumesTransfersV355Test-942438938 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:15:06 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-380c44ec-b2c6-44c7-987a-6e6ab8b5e775 tempest-VolumesTransfersV355Test-942438938 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:15:06 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-380c44ec-b2c6-44c7-987a-6e6ab8b5e775 tempest-VolumesTransfersV355Test-942438938 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:15:06 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-380c44ec-b2c6-44c7-987a-6e6ab8b5e775 tempest-VolumesTransfersV355Test-942438938 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:15:06 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-380c44ec-b2c6-44c7-987a-6e6ab8b5e775 tempest-VolumesTransfersV355Test-942438938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:15:06 devstack sudo[87794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:15:06 devstack sudo[87794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:15:07 devstack sudo[87794]: pam_unix(sudo:session): session closed for user root
Apr 10 13:15:07 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-380c44ec-b2c6-44c7-987a-6e6ab8b5e775 tempest-VolumesTransfersV355Test-942438938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.461s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:15:07 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-380c44ec-b2c6-44c7-987a-6e6ab8b5e775 tempest-VolumesTransfersV355Test-942438938 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:15:07 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-380c44ec-b2c6-44c7-987a-6e6ab8b5e775 tempest-VolumesTransfersV355Test-942438938 None] Deleted volume successfully.
Apr 10 13:15:07 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-380c44ec-b2c6-44c7-987a-6e6ab8b5e775 tempest-VolumesTransfersV355Test-942438938 None] Lock "cinder-b7cc8b04-ef3c-42a9-a536-e451778e9a43-delete_volume" released by "delete_volume" :: held 2.093s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:15:07 devstack cinder-volume[83345]: DEBUG cinder.coordination [req-b6806291-7482-48bb-9080-a95031c856b1 req-3532c3b4-93e9-451f-9967-bfbf05ded1bf tempest-VolumesGetTestJSON-497916317 None] Acquiring lock "cinder-1857bb80-e610-4170-8375-3c2c092a2516-delete_volume" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:15:07 devstack cinder-volume[83345]: DEBUG cinder.coordination [req-b6806291-7482-48bb-9080-a95031c856b1 req-3532c3b4-93e9-451f-9967-bfbf05ded1bf tempest-VolumesGetTestJSON-497916317 None] Lock "cinder-1857bb80-e610-4170-8375-3c2c092a2516-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:15:07 devstack cinder-volume[83345]: DEBUG cinder.coordination [req-b6806291-7482-48bb-9080-a95031c856b1 req-3532c3b4-93e9-451f-9967-bfbf05ded1bf tempest-VolumesGetTestJSON-497916317 None] Acquiring lock "cinder-quobyte-1857bb80-e610-4170-8375-3c2c092a2516" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:15:07 devstack cinder-volume[83345]: DEBUG cinder.coordination [req-b6806291-7482-48bb-9080-a95031c856b1 req-3532c3b4-93e9-451f-9967-bfbf05ded1bf tempest-VolumesGetTestJSON-497916317 None] Lock "cinder-quobyte-1857bb80-e610-4170-8375-3c2c092a2516" acquired by "delete_volume" :: waited 0.018s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:15:07 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[5528bfdb-40e3-4d1f-aecd-ca73deaf0d85]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:15:07 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [req-b6806291-7482-48bb-9080-a95031c856b1 req-3532c3b4-93e9-451f-9967-bfbf05ded1bf tempest-VolumesGetTestJSON-497916317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-1857bb80-e610-4170-8375-3c2c092a2516 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:15:07 devstack sudo[87799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-1857bb80-e610-4170-8375-3c2c092a2516
Apr 10 13:15:07 devstack sudo[87799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:15:08 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-20440cfa-1848-4b2e-81e7-5b4975459484 tempest-VolumesTransfersV355Test-1925984413 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:15:08 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-20440cfa-1848-4b2e-81e7-5b4975459484 tempest-VolumesTransfersV355Test-1925984413 None] Flow 'volume_create_manager' (f51e37ce-4eb0-4182-b84d-f5e3af75c058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:15:08 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-20440cfa-1848-4b2e-81e7-5b4975459484 tempest-VolumesTransfersV355Test-1925984413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (315df67f-53e2-4c04-9b2e-f3f4c2f9a3ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:15:08 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-20440cfa-1848-4b2e-81e7-5b4975459484 tempest-VolumesTransfersV355Test-1925984413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (315df67f-53e2-4c04-9b2e-f3f4c2f9a3ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:15:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-935077592',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8f25de2-99bd-466a-b2c8-6123170ddd47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73ee7e4275874394a75df46de2a5fe8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:15:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:15:08Z,use_quota=True,user_id='d42a309d1c7f41b2ab59b7d57040896f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:15:08 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-20440cfa-1848-4b2e-81e7-5b4975459484 tempest-VolumesTransfersV355Test-1925984413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89165a18-f9d3-432a-9338-bcd38a0436ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:15:08 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-20440cfa-1848-4b2e-81e7-5b4975459484 tempest-VolumesTransfersV355Test-1925984413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89165a18-f9d3-432a-9338-bcd38a0436ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:15:08 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-20440cfa-1848-4b2e-81e7-5b4975459484 tempest-VolumesTransfersV355Test-1925984413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3672706-71df-4440-9505-3b951c3897d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:15:08 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-20440cfa-1848-4b2e-81e7-5b4975459484 tempest-VolumesTransfersV355Test-1925984413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3672706-71df-4440-9505-3b951c3897d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8f25de2-99bd-466a-b2c8-6123170ddd47', 'volume_name': 'volume-c8f25de2-99bd-466a-b2c8-6123170ddd47', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:15:08 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-20440cfa-1848-4b2e-81e7-5b4975459484 tempest-VolumesTransfersV355Test-1925984413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc1ed2f4-ccc7-47a7-9429-4f2a62ed21e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:15:08 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-20440cfa-1848-4b2e-81e7-5b4975459484 tempest-VolumesTransfersV355Test-1925984413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc1ed2f4-ccc7-47a7-9429-4f2a62ed21e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:15:08 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-20440cfa-1848-4b2e-81e7-5b4975459484 tempest-VolumesTransfersV355Test-1925984413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd3bb6d2-200a-4cc4-a0e0-807a00e3eead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:15:08 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-20440cfa-1848-4b2e-81e7-5b4975459484 tempest-VolumesTransfersV355Test-1925984413 None] Volume c8f25de2-99bd-466a-b2c8-6123170ddd47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8f25de2-99bd-466a-b2c8-6123170ddd47', 'volume_size': 1}
Apr 10 13:15:08 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-20440cfa-1848-4b2e-81e7-5b4975459484 tempest-VolumesTransfersV355Test-1925984413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:15:08 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-20440cfa-1848-4b2e-81e7-5b4975459484 tempest-VolumesTransfersV355Test-1925984413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:15:08 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-20440cfa-1848-4b2e-81e7-5b4975459484 tempest-VolumesTransfersV355Test-1925984413 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f252bf08b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:15:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-935077592',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8f25de2-99bd-466a-b2c8-6123170ddd47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73ee7e4275874394a75df46de2a5fe8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:15:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:15:08Z,use_quota=True,user_id='d42a309d1c7f41b2ab59b7d57040896f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)}" {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 13:15:08 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-20440cfa-1848-4b2e-81e7-5b4975459484 tempest-VolumesTransfersV355Test-1925984413 None] Creating volume c8f25de2-99bd-466a-b2c8-6123170ddd47 {{(pid=83345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 13:15:08 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-20440cfa-1848-4b2e-81e7-5b4975459484 tempest-VolumesTransfersV355Test-1925984413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:15:08 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-20440cfa-1848-4b2e-81e7-5b4975459484 tempest-VolumesTransfersV355Test-1925984413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:15:08 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-20440cfa-1848-4b2e-81e7-5b4975459484 tempest-VolumesTransfersV355Test-1925984413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:15:08 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-20440cfa-1848-4b2e-81e7-5b4975459484 tempest-VolumesTransfersV355Test-1925984413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:15:08 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-20440cfa-1848-4b2e-81e7-5b4975459484 tempest-VolumesTransfersV355Test-1925984413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:15:08 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-20440cfa-1848-4b2e-81e7-5b4975459484 tempest-VolumesTransfersV355Test-1925984413 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:15:08 devstack cinder-volume[83345]: INFO cinder.volume.drivers.remotefs [None req-20440cfa-1848-4b2e-81e7-5b4975459484 tempest-VolumesTransfersV355Test-1925984413 None] casted to osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331
Apr 10 13:15:08 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-20440cfa-1848-4b2e-81e7-5b4975459484 tempest-VolumesTransfersV355Test-1925984413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-c8f25de2-99bd-466a-b2c8-6123170ddd47 1073741824 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:15:08 devstack sudo[87802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-c8f25de2-99bd-466a-b2c8-6123170ddd47 1073741824
Apr 10 13:15:08 devstack sudo[87802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:15:08 devstack sudo[87799]: pam_unix(sudo:session): session closed for user root
Apr 10 13:15:08 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [req-b6806291-7482-48bb-9080-a95031c856b1 req-3532c3b4-93e9-451f-9967-bfbf05ded1bf tempest-VolumesGetTestJSON-497916317 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-1857bb80-e610-4170-8375-3c2c092a2516" returned: 0 in 0.650s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:15:08 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [req-b6806291-7482-48bb-9080-a95031c856b1 req-3532c3b4-93e9-451f-9967-bfbf05ded1bf tempest-VolumesGetTestJSON-497916317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-1857bb80-e610-4170-8375-3c2c092a2516 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:15:08 devstack sudo[87807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-1857bb80-e610-4170-8375-3c2c092a2516
Apr 10 13:15:08 devstack sudo[87807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:15:08 devstack sudo[87802]: pam_unix(sudo:session): session closed for user root
Apr 10 13:15:08 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-20440cfa-1848-4b2e-81e7-5b4975459484 tempest-VolumesTransfersV355Test-1925984413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-c8f25de2-99bd-466a-b2c8-6123170ddd47 1073741824" returned: 0 in 0.584s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:15:08 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-20440cfa-1848-4b2e-81e7-5b4975459484 tempest-VolumesTransfersV355Test-1925984413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-c8f25de2-99bd-466a-b2c8-6123170ddd47 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:15:08 devstack sudo[87812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-c8f25de2-99bd-466a-b2c8-6123170ddd47
Apr 10 13:15:08 devstack sudo[87812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:15:08 devstack sudo[87807]: pam_unix(sudo:session): session closed for user root
Apr 10 13:15:08 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [req-b6806291-7482-48bb-9080-a95031c856b1 req-3532c3b4-93e9-451f-9967-bfbf05ded1bf tempest-VolumesGetTestJSON-497916317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-1857bb80-e610-4170-8375-3c2c092a2516" returned: 0 in 0.524s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:15:08 devstack cinder-volume[83345]: DEBUG cinder.coordination [req-b6806291-7482-48bb-9080-a95031c856b1 req-3532c3b4-93e9-451f-9967-bfbf05ded1bf tempest-VolumesGetTestJSON-497916317 None] Lock "cinder-quobyte-1857bb80-e610-4170-8375-3c2c092a2516" released by "delete_volume" :: held 1.216s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:15:09 devstack cinder-volume[83345]: DEBUG cinder.quota [req-b6806291-7482-48bb-9080-a95031c856b1 req-3532c3b4-93e9-451f-9967-bfbf05ded1bf tempest-VolumesGetTestJSON-497916317 None] Created reservations ['495fec55-19fe-481b-98a4-7d4ea8c52bcf', '28de7fa6-7168-450f-9308-d75a1980bb9a', 'f045bb35-9d79-4030-baf1-335a55350a45', '88cde4da-dda5-451b-a507-c1d811b35150'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:15:09 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [req-b6806291-7482-48bb-9080-a95031c856b1 req-3532c3b4-93e9-451f-9967-bfbf05ded1bf tempest-VolumesGetTestJSON-497916317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:15:09 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [req-b6806291-7482-48bb-9080-a95031c856b1 req-3532c3b4-93e9-451f-9967-bfbf05ded1bf tempest-VolumesGetTestJSON-497916317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:15:09 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [req-b6806291-7482-48bb-9080-a95031c856b1 req-3532c3b4-93e9-451f-9967-bfbf05ded1bf tempest-VolumesGetTestJSON-497916317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:15:09 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [req-b6806291-7482-48bb-9080-a95031c856b1 req-3532c3b4-93e9-451f-9967-bfbf05ded1bf tempest-VolumesGetTestJSON-497916317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:15:09 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [req-b6806291-7482-48bb-9080-a95031c856b1 req-3532c3b4-93e9-451f-9967-bfbf05ded1bf tempest-VolumesGetTestJSON-497916317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:15:09 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [req-b6806291-7482-48bb-9080-a95031c856b1 req-3532c3b4-93e9-451f-9967-bfbf05ded1bf tempest-VolumesGetTestJSON-497916317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:15:09 devstack sudo[87815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:15:09 devstack sudo[87815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:15:09 devstack sudo[87812]: pam_unix(sudo:session): session closed for user root
Apr 10 13:15:09 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-20440cfa-1848-4b2e-81e7-5b4975459484 tempest-VolumesTransfersV355Test-1925984413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-c8f25de2-99bd-466a-b2c8-6123170ddd47" returned: 0 in 0.561s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:15:09 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-20440cfa-1848-4b2e-81e7-5b4975459484 tempest-VolumesTransfersV355Test-1925984413 None] <== create_volume: return (1173ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'} {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 13:15:09 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-20440cfa-1848-4b2e-81e7-5b4975459484 tempest-VolumesTransfersV355Test-1925984413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.176s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:15:09 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-20440cfa-1848-4b2e-81e7-5b4975459484 tempest-VolumesTransfersV355Test-1925984413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd3bb6d2-200a-4cc4-a0e0-807a00e3eead) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8f25de2-99bd-466a-b2c8-6123170ddd47', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:15:09 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-20440cfa-1848-4b2e-81e7-5b4975459484 tempest-VolumesTransfersV355Test-1925984413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13659d25-3d43-4237-aa9c-7bc407888352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:15:09 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-20440cfa-1848-4b2e-81e7-5b4975459484 tempest-VolumesTransfersV355Test-1925984413 None] Volume volume-c8f25de2-99bd-466a-b2c8-6123170ddd47 (c8f25de2-99bd-466a-b2c8-6123170ddd47): created successfully
Apr 10 13:15:09 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-20440cfa-1848-4b2e-81e7-5b4975459484 tempest-VolumesTransfersV355Test-1925984413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13659d25-3d43-4237-aa9c-7bc407888352) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:15:09 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-20440cfa-1848-4b2e-81e7-5b4975459484 tempest-VolumesTransfersV355Test-1925984413 None] Flow 'volume_create_manager' (f51e37ce-4eb0-4182-b84d-f5e3af75c058) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:15:09 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-20440cfa-1848-4b2e-81e7-5b4975459484 tempest-VolumesTransfersV355Test-1925984413 None] Created volume successfully.
Apr 10 13:15:09 devstack sudo[87815]: pam_unix(sudo:session): session closed for user root
Apr 10 13:15:09 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [req-b6806291-7482-48bb-9080-a95031c856b1 req-3532c3b4-93e9-451f-9967-bfbf05ded1bf tempest-VolumesGetTestJSON-497916317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.487s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:15:09 devstack cinder-volume[83345]: DEBUG cinder.manager [req-b6806291-7482-48bb-9080-a95031c856b1 req-3532c3b4-93e9-451f-9967-bfbf05ded1bf tempest-VolumesGetTestJSON-497916317 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:15:09 devstack cinder-volume[83345]: INFO cinder.volume.manager [req-b6806291-7482-48bb-9080-a95031c856b1 req-3532c3b4-93e9-451f-9967-bfbf05ded1bf tempest-VolumesGetTestJSON-497916317 None] Deleted volume successfully.
Apr 10 13:15:09 devstack cinder-volume[83345]: DEBUG cinder.coordination [req-b6806291-7482-48bb-9080-a95031c856b1 req-3532c3b4-93e9-451f-9967-bfbf05ded1bf tempest-VolumesGetTestJSON-497916317 None] Lock "cinder-1857bb80-e610-4170-8375-3c2c092a2516-delete_volume" released by "delete_volume" :: held 1.895s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:15:10 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-3c876a2d-64a2-49bd-9ecc-08a404501c1b tempest-VolumesTransfersV355Test-942438938 None] Acquiring lock "cinder-c8f25de2-99bd-466a-b2c8-6123170ddd47-delete_volume" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:15:10 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-3c876a2d-64a2-49bd-9ecc-08a404501c1b tempest-VolumesTransfersV355Test-942438938 None] Lock "cinder-c8f25de2-99bd-466a-b2c8-6123170ddd47-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:15:10 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-3c876a2d-64a2-49bd-9ecc-08a404501c1b tempest-VolumesTransfersV355Test-942438938 None] Acquiring lock "cinder-quobyte-c8f25de2-99bd-466a-b2c8-6123170ddd47" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:15:10 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-3c876a2d-64a2-49bd-9ecc-08a404501c1b tempest-VolumesTransfersV355Test-942438938 None] Lock "cinder-quobyte-c8f25de2-99bd-466a-b2c8-6123170ddd47" acquired by "delete_volume" :: waited 0.012s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:15:10 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b8193cf-4550-442b-a70d-52ce0591d2f3]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:15:10 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-3c876a2d-64a2-49bd-9ecc-08a404501c1b tempest-VolumesTransfersV355Test-942438938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-c8f25de2-99bd-466a-b2c8-6123170ddd47 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:15:10 devstack sudo[87819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-c8f25de2-99bd-466a-b2c8-6123170ddd47
Apr 10 13:15:10 devstack sudo[87819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:15:11 devstack sudo[87819]: pam_unix(sudo:session): session closed for user root
Apr 10 13:15:11 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-3c876a2d-64a2-49bd-9ecc-08a404501c1b tempest-VolumesTransfersV355Test-942438938 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-c8f25de2-99bd-466a-b2c8-6123170ddd47" returned: 0 in 0.628s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:15:11 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-3c876a2d-64a2-49bd-9ecc-08a404501c1b tempest-VolumesTransfersV355Test-942438938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-c8f25de2-99bd-466a-b2c8-6123170ddd47 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:15:11 devstack sudo[87824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-c8f25de2-99bd-466a-b2c8-6123170ddd47
Apr 10 13:15:11 devstack sudo[87824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:15:11 devstack sudo[87824]: pam_unix(sudo:session): session closed for user root
Apr 10 13:15:11 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-3c876a2d-64a2-49bd-9ecc-08a404501c1b tempest-VolumesTransfersV355Test-942438938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-c8f25de2-99bd-466a-b2c8-6123170ddd47" returned: 0 in 0.502s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:15:11 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-3c876a2d-64a2-49bd-9ecc-08a404501c1b tempest-VolumesTransfersV355Test-942438938 None] Lock "cinder-quobyte-c8f25de2-99bd-466a-b2c8-6123170ddd47" released by "delete_volume" :: held 1.161s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:15:11 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-3c876a2d-64a2-49bd-9ecc-08a404501c1b tempest-VolumesTransfersV355Test-942438938 None] Created reservations ['bc73a595-9121-46a6-b16f-97de95a01aaf', '8e3fc31f-8eb8-4344-9c26-eb22f07663b2', 'c4396e02-aeca-4240-bd79-cb3e2ac1271c', 'c1786b05-6dc3-42d9-8aeb-99e6e00bb122'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:15:11 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-3c876a2d-64a2-49bd-9ecc-08a404501c1b tempest-VolumesTransfersV355Test-942438938 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:15:11 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-3c876a2d-64a2-49bd-9ecc-08a404501c1b tempest-VolumesTransfersV355Test-942438938 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:15:11 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-3c876a2d-64a2-49bd-9ecc-08a404501c1b tempest-VolumesTransfersV355Test-942438938 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:15:11 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-3c876a2d-64a2-49bd-9ecc-08a404501c1b tempest-VolumesTransfersV355Test-942438938 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:15:11 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-3c876a2d-64a2-49bd-9ecc-08a404501c1b tempest-VolumesTransfersV355Test-942438938 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:15:11 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-3c876a2d-64a2-49bd-9ecc-08a404501c1b tempest-VolumesTransfersV355Test-942438938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:15:11 devstack sudo[87828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:15:11 devstack sudo[87828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:15:12 devstack sudo[87828]: pam_unix(sudo:session): session closed for user root
Apr 10 13:15:12 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-3c876a2d-64a2-49bd-9ecc-08a404501c1b tempest-VolumesTransfersV355Test-942438938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.484s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:15:12 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-3c876a2d-64a2-49bd-9ecc-08a404501c1b tempest-VolumesTransfersV355Test-942438938 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:15:12 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-3c876a2d-64a2-49bd-9ecc-08a404501c1b tempest-VolumesTransfersV355Test-942438938 None] Deleted volume successfully.
Apr 10 13:15:12 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-3c876a2d-64a2-49bd-9ecc-08a404501c1b tempest-VolumesTransfersV355Test-942438938 None] Lock "cinder-c8f25de2-99bd-466a-b2c8-6123170ddd47-delete_volume" released by "delete_volume" :: held 1.850s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:15:12 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-9ad9315a-5c9b-4366-afe1-3a7856a4e50b tempest-GroupSnapshotsV319Test-582040755 None] Group tempest-GroupSnapshotsV319Test-Group-1838415050: creating
Apr 10 13:15:12 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-9ad9315a-5c9b-4366-afe1-3a7856a4e50b tempest-GroupSnapshotsV319Test-582040755 None] Group tempest-GroupSnapshotsV319Test-Group-1838415050: created successfully
Apr 10 13:15:12 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-9ad9315a-5c9b-4366-afe1-3a7856a4e50b tempest-GroupSnapshotsV319Test-582040755 None] Create group completed successfully.
Apr 10 13:15:13 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-d54c7eb1-81fc-4f71-adcb-4a9ab4cd8002 tempest-VolumesExtendTest-27412717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:15:13 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-d54c7eb1-81fc-4f71-adcb-4a9ab4cd8002 tempest-VolumesExtendTest-27412717 None] Flow 'volume_create_manager' (f2412799-3edc-4c0c-beee-7ea771f9c004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:15:13 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-d54c7eb1-81fc-4f71-adcb-4a9ab4cd8002 tempest-VolumesExtendTest-27412717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07b48830-8a2e-4b99-9a9e-8f0f1af7b4b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:15:13 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-d54c7eb1-81fc-4f71-adcb-4a9ab4cd8002 tempest-VolumesExtendTest-27412717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07b48830-8a2e-4b99-9a9e-8f0f1af7b4b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:15:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-603915889',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10eb703a-4bb2-49bb-aeb5-1cf55ee0228a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b1f9e5fee4247619ddbed34edbd16eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:15:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:15:14Z,use_quota=True,user_id='6d7be3aa913e4d759b4510d8ca9b9afc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:15:13 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-d54c7eb1-81fc-4f71-adcb-4a9ab4cd8002 tempest-VolumesExtendTest-27412717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9d20598-1c18-4d3a-8bfa-0e2a3f67d237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:15:13 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-d54c7eb1-81fc-4f71-adcb-4a9ab4cd8002 tempest-VolumesExtendTest-27412717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9d20598-1c18-4d3a-8bfa-0e2a3f67d237) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:15:13 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-d54c7eb1-81fc-4f71-adcb-4a9ab4cd8002 tempest-VolumesExtendTest-27412717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ea9dd0a-036b-4e67-832f-0d4ac0cb804c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:15:13 devstack cinder-volume[83345]: DEBUG cinder.image.glance [None req-d54c7eb1-81fc-4f71-adcb-4a9ab4cd8002 tempest-VolumesExtendTest-27412717 None] Creating Keystone auth plugin from conf {{(pid=83345) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 10 13:15:13 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-d54c7eb1-81fc-4f71-adcb-4a9ab4cd8002 tempest-VolumesExtendTest-27412717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ea9dd0a-036b-4e67-832f-0d4ac0cb804c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '10eb703a-4bb2-49bb-aeb5-1cf55ee0228a', 'volume_name': 'volume-10eb703a-4bb2-49bb-aeb5-1cf55ee0228a', 'volume_size': 1, 'image_id': 'dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8c498714b5e64042a43894acdb754f15', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5', 'created_at': datetime.datetime(2026, 4, 10, 11, 6, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 10, 11, 6, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f252b351120>}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:15:13 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-d54c7eb1-81fc-4f71-adcb-4a9ab4cd8002 tempest-VolumesExtendTest-27412717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e40710f4-8045-4218-a28a-ee9bc6b1fae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:15:13 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-d54c7eb1-81fc-4f71-adcb-4a9ab4cd8002 tempest-VolumesExtendTest-27412717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e40710f4-8045-4218-a28a-ee9bc6b1fae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:15:13 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-d54c7eb1-81fc-4f71-adcb-4a9ab4cd8002 tempest-VolumesExtendTest-27412717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4b94f1e-7e07-4f57-bdc9-ed57c906f8ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:15:13 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-d54c7eb1-81fc-4f71-adcb-4a9ab4cd8002 tempest-VolumesExtendTest-27412717 None] Volume 10eb703a-4bb2-49bb-aeb5-1cf55ee0228a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-10eb703a-4bb2-49bb-aeb5-1cf55ee0228a', 'volume_size': 1, 'image_id': 'dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8c498714b5e64042a43894acdb754f15', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5', 'created_at': datetime.datetime(2026, 4, 10, 11, 6, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 10, 11, 6, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f252b351120>}
Apr 10 13:15:13 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-d54c7eb1-81fc-4f71-adcb-4a9ab4cd8002 tempest-VolumesExtendTest-27412717 None] Trying to clone 10eb703a-4bb2-49bb-aeb5-1cf55ee0228a from image dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5 at location (None, [{'url': 'file:///opt/stack/data/glance/images/dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5', 'metadata': {}}]). {{(pid=83345) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 10 13:15:14 devstack cinder-volume[83345]: DEBUG cinder.image.image_utils [None req-d54c7eb1-81fc-4f71-adcb-4a9ab4cd8002 tempest-VolumesExtendTest-27412717 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5_wmx3w6sfdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83345) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 10 13:15:14 devstack cinder-volume[83345]: INFO cinder.image.image_utils [None req-d54c7eb1-81fc-4f71-adcb-4a9ab4cd8002 tempest-VolumesExtendTest-27412717 None] Image download 20.69 MB at 20.69 MB/s
Apr 10 13:15:14 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[3be23008-6c20-4ad2-9e37-6028c6afef36]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:15:14 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-d54c7eb1-81fc-4f71-adcb-4a9ab4cd8002 tempest-VolumesExtendTest-27412717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5_wmx3w6sfdevstack@QuobyteHD {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:15:14 devstack sudo[87832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5_wmx3w6sfdevstack@QuobyteHD
Apr 10 13:15:14 devstack sudo[87832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:15:14 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-95452903-ed59-4642-b29f-1843ce73adb5 tempest-GroupSnapshotsV319Test-582040755 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:15:14 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-95452903-ed59-4642-b29f-1843ce73adb5 tempest-GroupSnapshotsV319Test-582040755 None] Flow 'volume_create_manager' (12c57265-73e5-4123-8408-2b53b054c283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:15:14 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-95452903-ed59-4642-b29f-1843ce73adb5 tempest-GroupSnapshotsV319Test-582040755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cefefd4-90d7-4555-88ca-e6951660aa79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:15:14 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-95452903-ed59-4642-b29f-1843ce73adb5 tempest-GroupSnapshotsV319Test-582040755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cefefd4-90d7-4555-88ca-e6951660aa79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:15:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1449047272',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ceb4d6c5-8a60-4b50-9924-8c37ddc9e15a,host='devstack@QuobyteHD#QuobyteHD',id=bd6cb3c3-833b-42f9-b167-94db568edb7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb53fc55090b4e9e97a76931a7453633',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:15:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:15:14Z,use_quota=True,user_id='a6ac4742382b4bce8287d4ce25a74832',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4340074-60a8-4d91-82f8-3fc72c0d2a3a),volume_type_id=a4340074-60a8-4d91-82f8-3fc72c0d2a3a)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:15:14 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-95452903-ed59-4642-b29f-1843ce73adb5 tempest-GroupSnapshotsV319Test-582040755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80531c38-94ca-4b50-afaf-2d53fbfe81c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:15:14 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-95452903-ed59-4642-b29f-1843ce73adb5 tempest-GroupSnapshotsV319Test-582040755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80531c38-94ca-4b50-afaf-2d53fbfe81c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:15:14 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-95452903-ed59-4642-b29f-1843ce73adb5 tempest-GroupSnapshotsV319Test-582040755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (699d4e41-bf29-4a75-af1a-4223e5e37cbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:15:14 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-95452903-ed59-4642-b29f-1843ce73adb5 tempest-GroupSnapshotsV319Test-582040755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (699d4e41-bf29-4a75-af1a-4223e5e37cbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd6cb3c3-833b-42f9-b167-94db568edb7d', 'volume_name': 'volume-bd6cb3c3-833b-42f9-b167-94db568edb7d', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:15:14 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-95452903-ed59-4642-b29f-1843ce73adb5 tempest-GroupSnapshotsV319Test-582040755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0e32bcb-e6bd-4da8-b789-36135045fa7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:15:14 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-95452903-ed59-4642-b29f-1843ce73adb5 tempest-GroupSnapshotsV319Test-582040755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0e32bcb-e6bd-4da8-b789-36135045fa7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:15:14 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-95452903-ed59-4642-b29f-1843ce73adb5 tempest-GroupSnapshotsV319Test-582040755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0e96d54-8e65-4c42-b663-27dc53cba4e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:15:14 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-95452903-ed59-4642-b29f-1843ce73adb5 tempest-GroupSnapshotsV319Test-582040755 None] Volume bd6cb3c3-833b-42f9-b167-94db568edb7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd6cb3c3-833b-42f9-b167-94db568edb7d', 'volume_size': 1}
Apr 10 13:15:14 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-95452903-ed59-4642-b29f-1843ce73adb5 tempest-GroupSnapshotsV319Test-582040755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:15:14 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-95452903-ed59-4642-b29f-1843ce73adb5 tempest-GroupSnapshotsV319Test-582040755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:15:14 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-95452903-ed59-4642-b29f-1843ce73adb5 tempest-GroupSnapshotsV319Test-582040755 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f252bf08b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=ceb4d6c5-8a60-4b50-9924-8c37ddc9e15a,created_at=2026-04-10T11:15:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1449047272',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ceb4d6c5-8a60-4b50-9924-8c37ddc9e15a,host='devstack@QuobyteHD#QuobyteHD',id=bd6cb3c3-833b-42f9-b167-94db568edb7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb53fc55090b4e9e97a76931a7453633',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:15:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:15:14Z,use_quota=True,user_id='a6ac4742382b4bce8287d4ce25a74832',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4340074-60a8-4d91-82f8-3fc72c0d2a3a),volume_type_id=a4340074-60a8-4d91-82f8-3fc72c0d2a3a)}" {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 13:15:14 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-95452903-ed59-4642-b29f-1843ce73adb5 tempest-GroupSnapshotsV319Test-582040755 None] Creating volume bd6cb3c3-833b-42f9-b167-94db568edb7d {{(pid=83345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 13:15:14 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-95452903-ed59-4642-b29f-1843ce73adb5 tempest-GroupSnapshotsV319Test-582040755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:15:14 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-95452903-ed59-4642-b29f-1843ce73adb5 tempest-GroupSnapshotsV319Test-582040755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:15:14 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-95452903-ed59-4642-b29f-1843ce73adb5 tempest-GroupSnapshotsV319Test-582040755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:15:14 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-95452903-ed59-4642-b29f-1843ce73adb5 tempest-GroupSnapshotsV319Test-582040755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:15:14 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-95452903-ed59-4642-b29f-1843ce73adb5 tempest-GroupSnapshotsV319Test-582040755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:15:14 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-95452903-ed59-4642-b29f-1843ce73adb5 tempest-GroupSnapshotsV319Test-582040755 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:15:14 devstack cinder-volume[83345]: INFO cinder.volume.drivers.remotefs [None req-95452903-ed59-4642-b29f-1843ce73adb5 tempest-GroupSnapshotsV319Test-582040755 None] casted to osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331
Apr 10 13:15:14 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-95452903-ed59-4642-b29f-1843ce73adb5 tempest-GroupSnapshotsV319Test-582040755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-bd6cb3c3-833b-42f9-b167-94db568edb7d 1073741824 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:15:14 devstack sudo[87834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-bd6cb3c3-833b-42f9-b167-94db568edb7d 1073741824
Apr 10 13:15:14 devstack sudo[87834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:15:14 devstack sudo[87832]: pam_unix(sudo:session): session closed for user root
Apr 10 13:15:14 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-d54c7eb1-81fc-4f71-adcb-4a9ab4cd8002 tempest-VolumesExtendTest-27412717 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5_wmx3w6sfdevstack@QuobyteHD" returned: 0 in 0.613s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:15:14 devstack cinder-volume[83345]: DEBUG cinder.image.image_utils [None req-d54c7eb1-81fc-4f71-adcb-4a9ab4cd8002 tempest-VolumesExtendTest-27412717 None] Temporary image dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5 is fetched for user 6d7be3aa913e4d759b4510d8ca9b9afc. {{(pid=83345) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 10 13:15:14 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[046a58a7-ee7f-4364-8a17-76f4e8c92efc]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:15:14 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-d54c7eb1-81fc-4f71-adcb-4a9ab4cd8002 tempest-VolumesExtendTest-27412717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5_wmx3w6sfdevstack@QuobyteHD {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:15:14 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-46da98bf-b02e-472f-8794-4367f021c6eb tempest-VolumesActionsTest-353155709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:15:14 devstack sudo[87839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5_wmx3w6sfdevstack@QuobyteHD
Apr 10 13:15:14 devstack sudo[87839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:15:15 devstack sudo[87834]: pam_unix(sudo:session): session closed for user root
Apr 10 13:15:15 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-95452903-ed59-4642-b29f-1843ce73adb5 tempest-GroupSnapshotsV319Test-582040755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-bd6cb3c3-833b-42f9-b167-94db568edb7d 1073741824" returned: 0 in 0.584s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:15:15 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-95452903-ed59-4642-b29f-1843ce73adb5 tempest-GroupSnapshotsV319Test-582040755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-bd6cb3c3-833b-42f9-b167-94db568edb7d {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:15:15 devstack sudo[87844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-bd6cb3c3-833b-42f9-b167-94db568edb7d
Apr 10 13:15:15 devstack sudo[87844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:15:15 devstack sudo[87839]: pam_unix(sudo:session): session closed for user root
Apr 10 13:15:15 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-d54c7eb1-81fc-4f71-adcb-4a9ab4cd8002 tempest-VolumesExtendTest-27412717 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5_wmx3w6sfdevstack@QuobyteHD" returned: 0 in 0.557s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:15:15 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-d54c7eb1-81fc-4f71-adcb-4a9ab4cd8002 tempest-VolumesExtendTest-27412717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:15:15 devstack sudo[87844]: pam_unix(sudo:session): session closed for user root
Apr 10 13:15:15 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-95452903-ed59-4642-b29f-1843ce73adb5 tempest-GroupSnapshotsV319Test-582040755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-bd6cb3c3-833b-42f9-b167-94db568edb7d" returned: 0 in 0.474s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:15:15 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-95452903-ed59-4642-b29f-1843ce73adb5 tempest-GroupSnapshotsV319Test-582040755 None] <== create_volume: return (1083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'} {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 13:15:15 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-95452903-ed59-4642-b29f-1843ce73adb5 tempest-GroupSnapshotsV319Test-582040755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.086s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:15:15 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-46da98bf-b02e-472f-8794-4367f021c6eb tempest-VolumesActionsTest-353155709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.837s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:15:15 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-95452903-ed59-4642-b29f-1843ce73adb5 tempest-GroupSnapshotsV319Test-582040755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0e96d54-8e65-4c42-b663-27dc53cba4e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd6cb3c3-833b-42f9-b167-94db568edb7d', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:15:15 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-95452903-ed59-4642-b29f-1843ce73adb5 tempest-GroupSnapshotsV319Test-582040755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afc2a34d-d4dd-4c24-b282-d608cdfde29a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:15:15 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[837216ad-0c4c-4896-b9ed-83f15abad606]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:15:15 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-46da98bf-b02e-472f-8794-4367f021c6eb tempest-VolumesActionsTest-353155709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-99a2ad7b-89ba-4314-8b09-0871e97a3712 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:15:15 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-95452903-ed59-4642-b29f-1843ce73adb5 tempest-GroupSnapshotsV319Test-582040755 None] Volume volume-bd6cb3c3-833b-42f9-b167-94db568edb7d (bd6cb3c3-833b-42f9-b167-94db568edb7d): created successfully
Apr 10 13:15:15 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-95452903-ed59-4642-b29f-1843ce73adb5 tempest-GroupSnapshotsV319Test-582040755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afc2a34d-d4dd-4c24-b282-d608cdfde29a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:15:15 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-95452903-ed59-4642-b29f-1843ce73adb5 tempest-GroupSnapshotsV319Test-582040755 None] Flow 'volume_create_manager' (12c57265-73e5-4123-8408-2b53b054c283) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:15:15 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-95452903-ed59-4642-b29f-1843ce73adb5 tempest-GroupSnapshotsV319Test-582040755 None] Created volume successfully.
Apr 10 13:15:15 devstack sudo[87850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-99a2ad7b-89ba-4314-8b09-0871e97a3712
Apr 10 13:15:15 devstack sudo[87850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:15:16 devstack sudo[87850]: pam_unix(sudo:session): session closed for user root
Apr 10 13:15:16 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-46da98bf-b02e-472f-8794-4367f021c6eb tempest-VolumesActionsTest-353155709 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-99a2ad7b-89ba-4314-8b09-0871e97a3712" returned: 0 in 0.520s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:15:16 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[31c5cb24-ce49-4b4c-8de8-d7a22218ac0e]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:15:16 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-46da98bf-b02e-472f-8794-4367f021c6eb tempest-VolumesActionsTest-353155709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-99a2ad7b-89ba-4314-8b09-0871e97a3712 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:15:16 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-4deeb986-dff9-4e65-b6a5-33063ea5c639 tempest-VolumesGetTest-1325070593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:15:16 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-4deeb986-dff9-4e65-b6a5-33063ea5c639 tempest-VolumesGetTest-1325070593 None] Flow 'volume_create_manager' (b42c19e7-19d6-45b2-84bf-27018ff44fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:15:16 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-4deeb986-dff9-4e65-b6a5-33063ea5c639 tempest-VolumesGetTest-1325070593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5422b9d3-6525-4634-be9d-f07f74d17ff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:15:16 devstack sudo[87855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-99a2ad7b-89ba-4314-8b09-0871e97a3712
Apr 10 13:15:16 devstack sudo[87855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:15:16 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-4deeb986-dff9-4e65-b6a5-33063ea5c639 tempest-VolumesGetTest-1325070593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5422b9d3-6525-4634-be9d-f07f74d17ff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:15:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1970904031',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb6e8bb5-c0d7-427e-aa31-981465227b55,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='2164901a19c74ad5a7ac47fa92772df3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:15:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:15:16Z,use_quota=True,user_id='e6a465b820764bf78e3ec91bbb896b7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:15:16 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-4deeb986-dff9-4e65-b6a5-33063ea5c639 tempest-VolumesGetTest-1325070593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (132be208-2f4d-48c6-a4e2-a618a1ba8a28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:15:16 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-4deeb986-dff9-4e65-b6a5-33063ea5c639 tempest-VolumesGetTest-1325070593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (132be208-2f4d-48c6-a4e2-a618a1ba8a28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:15:16 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-4deeb986-dff9-4e65-b6a5-33063ea5c639 tempest-VolumesGetTest-1325070593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (018cb959-7549-4ba7-a862-2deba9af7087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:15:16 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-4deeb986-dff9-4e65-b6a5-33063ea5c639 tempest-VolumesGetTest-1325070593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (018cb959-7549-4ba7-a862-2deba9af7087) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb6e8bb5-c0d7-427e-aa31-981465227b55', 'volume_name': 'volume-eb6e8bb5-c0d7-427e-aa31-981465227b55', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:15:16 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-4deeb986-dff9-4e65-b6a5-33063ea5c639 tempest-VolumesGetTest-1325070593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34b29e38-b48a-4ccb-9557-2c11f8a44092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:15:16 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-4deeb986-dff9-4e65-b6a5-33063ea5c639 tempest-VolumesGetTest-1325070593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34b29e38-b48a-4ccb-9557-2c11f8a44092) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:15:16 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-4deeb986-dff9-4e65-b6a5-33063ea5c639 tempest-VolumesGetTest-1325070593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e19f049-5511-4a10-b8a3-18c95415e6f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:15:16 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-4deeb986-dff9-4e65-b6a5-33063ea5c639 tempest-VolumesGetTest-1325070593 None] Volume eb6e8bb5-c0d7-427e-aa31-981465227b55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb6e8bb5-c0d7-427e-aa31-981465227b55', 'volume_size': 1}
Apr 10 13:15:16 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-4deeb986-dff9-4e65-b6a5-33063ea5c639 tempest-VolumesGetTest-1325070593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:15:16 devstack sudo[87855]: pam_unix(sudo:session): session closed for user root
Apr 10 13:15:16 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-46da98bf-b02e-472f-8794-4367f021c6eb tempest-VolumesActionsTest-353155709 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-99a2ad7b-89ba-4314-8b09-0871e97a3712" returned: 0 in 0.495s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:15:16 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-46da98bf-b02e-472f-8794-4367f021c6eb tempest-VolumesActionsTest-353155709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-99a2ad7b-89ba-4314-8b09-0871e97a3712 /opt/stack/data/cinder/conversion/99a2ad7b-89ba-4314-8b09-0871e97a3712.temp_image.95079220-59a6-4eb4-ac61-163c1b93f8663af1pvad.img {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:15:16 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-1310f784-e928-4a31-9ae2-55245e99d313 tempest-GroupSnapshotsV319Test-582040755 None] GroupSnapshot 39c17885-591e-40d0-9282-0a5482aba8f5: creating.
Apr 10 13:15:16 devstack sudo[87860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-99a2ad7b-89ba-4314-8b09-0871e97a3712 /opt/stack/data/cinder/conversion/99a2ad7b-89ba-4314-8b09-0871e97a3712.temp_image.95079220-59a6-4eb4-ac61-163c1b93f8663af1pvad.img
Apr 10 13:15:16 devstack sudo[87860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:15:16 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-1310f784-e928-4a31-9ae2-55245e99d313 tempest-GroupSnapshotsV319Test-582040755 None] Group snapshot 39c17885-591e-40d0-9282-0a5482aba8f5: creating. {{(pid=83345) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 10 13:15:16 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-1310f784-e928-4a31-9ae2-55245e99d313 tempest-GroupSnapshotsV319Test-582040755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:15:18 devstack sudo[87860]: pam_unix(sudo:session): session closed for user root
Apr 10 13:15:18 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-46da98bf-b02e-472f-8794-4367f021c6eb tempest-VolumesActionsTest-353155709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-99a2ad7b-89ba-4314-8b09-0871e97a3712 /opt/stack/data/cinder/conversion/99a2ad7b-89ba-4314-8b09-0871e97a3712.temp_image.95079220-59a6-4eb4-ac61-163c1b93f8663af1pvad.img" returned: 0 in 2.087s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:15:18 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a072394-a4e2-45b6-b36a-97d616a3779d]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:15:18 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-46da98bf-b02e-472f-8794-4367f021c6eb tempest-VolumesActionsTest-353155709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-99a2ad7b-89ba-4314-8b09-0871e97a3712 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:15:18 devstack sudo[87878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-99a2ad7b-89ba-4314-8b09-0871e97a3712
Apr 10 13:15:18 devstack sudo[87878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:15:19 devstack sudo[87878]: pam_unix(sudo:session): session closed for user root
Apr 10 13:15:19 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-46da98bf-b02e-472f-8794-4367f021c6eb tempest-VolumesActionsTest-353155709 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-99a2ad7b-89ba-4314-8b09-0871e97a3712" returned: 0 in 0.593s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:15:19 devstack cinder-volume[83345]: DEBUG cinder.image.image_utils [None req-46da98bf-b02e-472f-8794-4367f021c6eb tempest-VolumesActionsTest-353155709 None] Image conversion details: src /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-99a2ad7b-89ba-4314-8b09-0871e97a3712, size 1024.00 MB, duration 2.09 sec, destination /opt/stack/data/cinder/conversion/99a2ad7b-89ba-4314-8b09-0871e97a3712.temp_image.95079220-59a6-4eb4-ac61-163c1b93f8663af1pvad.img {{(pid=83345) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 10 13:15:19 devstack cinder-volume[83345]: INFO cinder.image.image_utils [None req-46da98bf-b02e-472f-8794-4367f021c6eb tempest-VolumesActionsTest-353155709 None] Converted 1024.00 MB image at 490.42 MB/s
Apr 10 13:15:19 devstack cinder-volume[83345]: DEBUG cinder.image.image_utils [None req-46da98bf-b02e-472f-8794-4367f021c6eb tempest-VolumesActionsTest-353155709 None] 95079220-59a6-4eb4-ac61-163c1b93f866 was raw, no need to convert to raw {{(pid=83345) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}}
Apr 10 13:15:26 devstack cinder-volume[83345]: DEBUG dbcounter [-] [83345] Writing DB stats cinder:SELECT=45,cinder:UPDATE=53,cinder:DELETE=4,cinder:INSERT=9 {{(pid=83345) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 10 13:15:28 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-46da98bf-b02e-472f-8794-4367f021c6eb tempest-VolumesActionsTest-353155709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 13.193s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:15:28 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-46da98bf-b02e-472f-8794-4367f021c6eb tempest-VolumesActionsTest-353155709 None] Uploaded volume to glance image-id: 95079220-59a6-4eb4-ac61-163c1b93f866. {{(pid=83345) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Apr 10 13:15:28 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-d54c7eb1-81fc-4f71-adcb-4a9ab4cd8002 tempest-VolumesExtendTest-27412717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.532s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:15:28 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-d54c7eb1-81fc-4f71-adcb-4a9ab4cd8002 tempest-VolumesExtendTest-27412717 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f252bf08b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:15:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-603915889',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10eb703a-4bb2-49bb-aeb5-1cf55ee0228a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b1f9e5fee4247619ddbed34edbd16eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:15:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:15:14Z,use_quota=True,user_id='6d7be3aa913e4d759b4510d8ca9b9afc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)}" {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 13:15:28 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-d54c7eb1-81fc-4f71-adcb-4a9ab4cd8002 tempest-VolumesExtendTest-27412717 None] Creating volume 10eb703a-4bb2-49bb-aeb5-1cf55ee0228a {{(pid=83345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 13:15:28 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-d54c7eb1-81fc-4f71-adcb-4a9ab4cd8002 tempest-VolumesExtendTest-27412717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:15:28 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-d54c7eb1-81fc-4f71-adcb-4a9ab4cd8002 tempest-VolumesExtendTest-27412717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:15:28 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-d54c7eb1-81fc-4f71-adcb-4a9ab4cd8002 tempest-VolumesExtendTest-27412717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:15:28 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-d54c7eb1-81fc-4f71-adcb-4a9ab4cd8002 tempest-VolumesExtendTest-27412717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:15:28 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-d54c7eb1-81fc-4f71-adcb-4a9ab4cd8002 tempest-VolumesExtendTest-27412717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:15:28 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-d54c7eb1-81fc-4f71-adcb-4a9ab4cd8002 tempest-VolumesExtendTest-27412717 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:15:28 devstack cinder-volume[83345]: INFO cinder.volume.drivers.remotefs [None req-d54c7eb1-81fc-4f71-adcb-4a9ab4cd8002 tempest-VolumesExtendTest-27412717 None] casted to osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331
Apr 10 13:15:28 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-d54c7eb1-81fc-4f71-adcb-4a9ab4cd8002 tempest-VolumesExtendTest-27412717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-10eb703a-4bb2-49bb-aeb5-1cf55ee0228a 1073741824 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:15:28 devstack sudo[87919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-10eb703a-4bb2-49bb-aeb5-1cf55ee0228a 1073741824
Apr 10 13:15:28 devstack sudo[87919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:15:28 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-46da98bf-b02e-472f-8794-4367f021c6eb tempest-VolumesActionsTest-353155709 None] Copy volume to image completed successfully.
Apr 10 13:15:29 devstack sudo[87919]: pam_unix(sudo:session): session closed for user root
Apr 10 13:15:29 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-d54c7eb1-81fc-4f71-adcb-4a9ab4cd8002 tempest-VolumesExtendTest-27412717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-10eb703a-4bb2-49bb-aeb5-1cf55ee0228a 1073741824" returned: 0 in 0.518s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:15:29 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-d54c7eb1-81fc-4f71-adcb-4a9ab4cd8002 tempest-VolumesExtendTest-27412717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-10eb703a-4bb2-49bb-aeb5-1cf55ee0228a {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:15:29 devstack sudo[87924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-10eb703a-4bb2-49bb-aeb5-1cf55ee0228a
Apr 10 13:15:29 devstack sudo[87924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:15:29 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-5cf4070d-1043-402d-b9e5-629fb822a522 tempest-VolumesActionsTest-353155709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:15:29 devstack sudo[87924]: pam_unix(sudo:session): session closed for user root
Apr 10 13:15:29 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-d54c7eb1-81fc-4f71-adcb-4a9ab4cd8002 tempest-VolumesExtendTest-27412717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-10eb703a-4bb2-49bb-aeb5-1cf55ee0228a" returned: 0 in 0.433s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:15:29 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-d54c7eb1-81fc-4f71-adcb-4a9ab4cd8002 tempest-VolumesExtendTest-27412717 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'} {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 13:15:29 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-d54c7eb1-81fc-4f71-adcb-4a9ab4cd8002 tempest-VolumesExtendTest-27412717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:15:29 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-4deeb986-dff9-4e65-b6a5-33063ea5c639 tempest-VolumesGetTest-1325070593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.527s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:15:29 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-4deeb986-dff9-4e65-b6a5-33063ea5c639 tempest-VolumesGetTest-1325070593 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f252bf08b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:15:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1970904031',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb6e8bb5-c0d7-427e-aa31-981465227b55,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='2164901a19c74ad5a7ac47fa92772df3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:15:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:15:16Z,use_quota=True,user_id='e6a465b820764bf78e3ec91bbb896b7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)}" {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 13:15:29 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-4deeb986-dff9-4e65-b6a5-33063ea5c639 tempest-VolumesGetTest-1325070593 None] Creating volume eb6e8bb5-c0d7-427e-aa31-981465227b55 {{(pid=83345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 13:15:29 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-4deeb986-dff9-4e65-b6a5-33063ea5c639 tempest-VolumesGetTest-1325070593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:15:29 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-4deeb986-dff9-4e65-b6a5-33063ea5c639 tempest-VolumesGetTest-1325070593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:15:29 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-4deeb986-dff9-4e65-b6a5-33063ea5c639 tempest-VolumesGetTest-1325070593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:15:29 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-4deeb986-dff9-4e65-b6a5-33063ea5c639 tempest-VolumesGetTest-1325070593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:15:29 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-4deeb986-dff9-4e65-b6a5-33063ea5c639 tempest-VolumesGetTest-1325070593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:15:29 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-4deeb986-dff9-4e65-b6a5-33063ea5c639 tempest-VolumesGetTest-1325070593 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:15:29 devstack cinder-volume[83345]: INFO cinder.volume.drivers.remotefs [None req-4deeb986-dff9-4e65-b6a5-33063ea5c639 tempest-VolumesGetTest-1325070593 None] casted to osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331
Apr 10 13:15:29 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-4deeb986-dff9-4e65-b6a5-33063ea5c639 tempest-VolumesGetTest-1325070593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-eb6e8bb5-c0d7-427e-aa31-981465227b55 1073741824 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:15:29 devstack sudo[87927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-eb6e8bb5-c0d7-427e-aa31-981465227b55 1073741824
Apr 10 13:15:29 devstack sudo[87927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:15:29 devstack cinder-volume[83345]: DEBUG cinder.volume.volume_utils [None req-d54c7eb1-81fc-4f71-adcb-4a9ab4cd8002 tempest-VolumesExtendTest-27412717 None] Attempting download of dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5 ((None, [{'url': 'file:///opt/stack/data/glance/images/dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5', 'metadata': {}}])) to volume 10eb703a-4bb2-49bb-aeb5-1cf55ee0228a. {{(pid=83345) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 10 13:15:29 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[17c2013b-02b2-4861-ad2f-86668ae7f102]: (4, 'raw') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:15:29 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-d54c7eb1-81fc-4f71-adcb-4a9ab4cd8002 tempest-VolumesExtendTest-27412717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5_zrd_faxj {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:15:30 devstack sudo[87929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5_zrd_faxj
Apr 10 13:15:30 devstack sudo[87929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:15:30 devstack sudo[87927]: pam_unix(sudo:session): session closed for user root
Apr 10 13:15:30 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-4deeb986-dff9-4e65-b6a5-33063ea5c639 tempest-VolumesGetTest-1325070593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-eb6e8bb5-c0d7-427e-aa31-981465227b55 1073741824" returned: 0 in 0.473s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:15:30 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-4deeb986-dff9-4e65-b6a5-33063ea5c639 tempest-VolumesGetTest-1325070593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-eb6e8bb5-c0d7-427e-aa31-981465227b55 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:15:30 devstack sudo[87929]: pam_unix(sudo:session): session closed for user root
Apr 10 13:15:30 devstack sudo[87936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-eb6e8bb5-c0d7-427e-aa31-981465227b55
Apr 10 13:15:30 devstack sudo[87936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:15:30 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-d54c7eb1-81fc-4f71-adcb-4a9ab4cd8002 tempest-VolumesExtendTest-27412717 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5_zrd_faxj" returned: 0 in 0.497s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:15:30 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-d54c7eb1-81fc-4f71-adcb-4a9ab4cd8002 tempest-VolumesExtendTest-27412717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5_zrd_faxj {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:15:30 devstack sudo[87938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5_zrd_faxj
Apr 10 13:15:30 devstack sudo[87938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:15:30 devstack sudo[87936]: pam_unix(sudo:session): session closed for user root
Apr 10 13:15:30 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-4deeb986-dff9-4e65-b6a5-33063ea5c639 tempest-VolumesGetTest-1325070593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-eb6e8bb5-c0d7-427e-aa31-981465227b55" returned: 0 in 0.407s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:15:30 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-4deeb986-dff9-4e65-b6a5-33063ea5c639 tempest-VolumesGetTest-1325070593 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'} {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 13:15:30 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-4deeb986-dff9-4e65-b6a5-33063ea5c639 tempest-VolumesGetTest-1325070593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:15:30 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-1310f784-e928-4a31-9ae2-55245e99d313 tempest-GroupSnapshotsV319Test-582040755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 14.028s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:15:30 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-4deeb986-dff9-4e65-b6a5-33063ea5c639 tempest-VolumesGetTest-1325070593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e19f049-5511-4a10-b8a3-18c95415e6f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb6e8bb5-c0d7-427e-aa31-981465227b55', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:15:30 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-4deeb986-dff9-4e65-b6a5-33063ea5c639 tempest-VolumesGetTest-1325070593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ab06bf4-ed89-4159-af4f-bbb6484fca74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:15:30 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-4deeb986-dff9-4e65-b6a5-33063ea5c639 tempest-VolumesGetTest-1325070593 None] Volume volume-eb6e8bb5-c0d7-427e-aa31-981465227b55 (eb6e8bb5-c0d7-427e-aa31-981465227b55): created successfully
Apr 10 13:15:30 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-4deeb986-dff9-4e65-b6a5-33063ea5c639 tempest-VolumesGetTest-1325070593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ab06bf4-ed89-4159-af4f-bbb6484fca74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:15:30 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-4deeb986-dff9-4e65-b6a5-33063ea5c639 tempest-VolumesGetTest-1325070593 None] Flow 'volume_create_manager' (b42c19e7-19d6-45b2-84bf-27018ff44fe9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:15:30 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-1310f784-e928-4a31-9ae2-55245e99d313 tempest-GroupSnapshotsV319Test-582040755 None] Creating offline snapshot 98eaf222-6701-4231-be9e-fd0101952773 of volume bd6cb3c3-833b-42f9-b167-94db568edb7d {{(pid=83345) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 10 13:15:30 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-4deeb986-dff9-4e65-b6a5-33063ea5c639 tempest-VolumesGetTest-1325070593 None] Created volume successfully.
Apr 10 13:15:30 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba02bab2-4d70-4399-87e1-596f9b75b3fa]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:15:30 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-1310f784-e928-4a31-9ae2-55245e99d313 tempest-GroupSnapshotsV319Test-582040755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-bd6cb3c3-833b-42f9-b167-94db568edb7d {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:15:30 devstack sudo[87938]: pam_unix(sudo:session): session closed for user root
Apr 10 13:15:30 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-d54c7eb1-81fc-4f71-adcb-4a9ab4cd8002 tempest-VolumesExtendTest-27412717 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5_zrd_faxj" returned: 1 in 0.465s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:15:30 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-d54c7eb1-81fc-4f71-adcb-4a9ab4cd8002 tempest-VolumesExtendTest-27412717 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5_zrd_faxj' failed. Not Retrying. {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 10 13:15:30 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[784e2c96-06bc-40e9-ad9e-c7fc5c81a93b]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:15:30 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-d54c7eb1-81fc-4f71-adcb-4a9ab4cd8002 tempest-VolumesExtendTest-27412717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5_wmx3w6sfdevstack@QuobyteHD {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:15:30 devstack sudo[87943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-bd6cb3c3-833b-42f9-b167-94db568edb7d
Apr 10 13:15:30 devstack sudo[87943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:15:30 devstack sudo[87944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5_wmx3w6sfdevstack@QuobyteHD
Apr 10 13:15:30 devstack sudo[87944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:15:31 devstack sudo[87943]: pam_unix(sudo:session): session closed for user root
Apr 10 13:15:31 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-1310f784-e928-4a31-9ae2-55245e99d313 tempest-GroupSnapshotsV319Test-582040755 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-bd6cb3c3-833b-42f9-b167-94db568edb7d" returned: 0 in 0.506s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:15:31 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-1310f784-e928-4a31-9ae2-55245e99d313 tempest-GroupSnapshotsV319Test-582040755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-bd6cb3c3-833b-42f9-b167-94db568edb7d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-bd6cb3c3-833b-42f9-b167-94db568edb7d.98eaf222-6701-4231-be9e-fd0101952773 1G {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:15:31 devstack sudo[87944]: pam_unix(sudo:session): session closed for user root
Apr 10 13:15:31 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-d54c7eb1-81fc-4f71-adcb-4a9ab4cd8002 tempest-VolumesExtendTest-27412717 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5_wmx3w6sfdevstack@QuobyteHD" returned: 0 in 0.488s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:15:31 devstack cinder-volume[83345]: DEBUG cinder.image.image_utils [None req-d54c7eb1-81fc-4f71-adcb-4a9ab4cd8002 tempest-VolumesExtendTest-27412717 None] dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5 was qcow2, converting to raw {{(pid=83345) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 10 13:15:31 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-d54c7eb1-81fc-4f71-adcb-4a9ab4cd8002 tempest-VolumesExtendTest-27412717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5_wmx3w6sfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-10eb703a-4bb2-49bb-aeb5-1cf55ee0228a {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:15:31 devstack sudo[87953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-bd6cb3c3-833b-42f9-b167-94db568edb7d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-bd6cb3c3-833b-42f9-b167-94db568edb7d.98eaf222-6701-4231-be9e-fd0101952773 1G
Apr 10 13:15:31 devstack sudo[87953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:15:31 devstack sudo[87955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5_wmx3w6sfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-10eb703a-4bb2-49bb-aeb5-1cf55ee0228a
Apr 10 13:15:31 devstack sudo[87955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:15:31 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bd393ac-d0ad-4b1b-8c6c-87f5ff15c723 tempest-VolumesGetTest-1325070593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:15:31 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-7bd393ac-d0ad-4b1b-8c6c-87f5ff15c723 tempest-VolumesGetTest-1325070593 None] Flow 'volume_create_manager' (47dd518f-7242-4543-9150-d48791c28169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:15:31 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-7bd393ac-d0ad-4b1b-8c6c-87f5ff15c723 tempest-VolumesGetTest-1325070593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (614cf863-f534-4b19-8a56-9b1abb7642a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:15:31 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-7bd393ac-d0ad-4b1b-8c6c-87f5ff15c723 tempest-VolumesGetTest-1325070593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (614cf863-f534-4b19-8a56-9b1abb7642a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:15:31Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1535948604',display_name='tempest-VolumesGetTest-Volume-1369598762',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10de490e-de9e-42fd-a7c7-9135b2ef73a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2164901a19c74ad5a7ac47fa92772df3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:15:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:15:32Z,use_quota=True,user_id='e6a465b820764bf78e3ec91bbb896b7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:15:31 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-7bd393ac-d0ad-4b1b-8c6c-87f5ff15c723 tempest-VolumesGetTest-1325070593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (423fe974-2b1d-4bbd-b4dc-cc509a682c32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:15:31 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-7bd393ac-d0ad-4b1b-8c6c-87f5ff15c723 tempest-VolumesGetTest-1325070593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (423fe974-2b1d-4bbd-b4dc-cc509a682c32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:15:31 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-7bd393ac-d0ad-4b1b-8c6c-87f5ff15c723 tempest-VolumesGetTest-1325070593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81edd66c-6fcc-45c7-a2b7-86fb36ecea0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:15:31 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-7bd393ac-d0ad-4b1b-8c6c-87f5ff15c723 tempest-VolumesGetTest-1325070593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81edd66c-6fcc-45c7-a2b7-86fb36ecea0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10de490e-de9e-42fd-a7c7-9135b2ef73a8', 'volume_name': 'volume-10de490e-de9e-42fd-a7c7-9135b2ef73a8', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:15:31 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-7bd393ac-d0ad-4b1b-8c6c-87f5ff15c723 tempest-VolumesGetTest-1325070593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfb14bd1-5a38-4b82-a86c-f85ae2b395bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:15:31 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-7bd393ac-d0ad-4b1b-8c6c-87f5ff15c723 tempest-VolumesGetTest-1325070593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfb14bd1-5a38-4b82-a86c-f85ae2b395bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:15:31 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-7bd393ac-d0ad-4b1b-8c6c-87f5ff15c723 tempest-VolumesGetTest-1325070593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c08e427-31e6-4932-b9a9-57e5d634d583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:15:31 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-7bd393ac-d0ad-4b1b-8c6c-87f5ff15c723 tempest-VolumesGetTest-1325070593 None] Volume 10de490e-de9e-42fd-a7c7-9135b2ef73a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10de490e-de9e-42fd-a7c7-9135b2ef73a8', 'volume_size': 1}
Apr 10 13:15:31 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-7bd393ac-d0ad-4b1b-8c6c-87f5ff15c723 tempest-VolumesGetTest-1325070593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:15:31 devstack sudo[87953]: pam_unix(sudo:session): session closed for user root
Apr 10 13:15:31 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-1310f784-e928-4a31-9ae2-55245e99d313 tempest-GroupSnapshotsV319Test-582040755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-bd6cb3c3-833b-42f9-b167-94db568edb7d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-bd6cb3c3-833b-42f9-b167-94db568edb7d.98eaf222-6701-4231-be9e-fd0101952773 1G" returned: 0 in 0.528s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:15:31 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-1310f784-e928-4a31-9ae2-55245e99d313 tempest-GroupSnapshotsV319Test-582040755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd6cb3c3-833b-42f9-b167-94db568edb7d -F qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-bd6cb3c3-833b-42f9-b167-94db568edb7d.98eaf222-6701-4231-be9e-fd0101952773 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:15:31 devstack sudo[87971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd6cb3c3-833b-42f9-b167-94db568edb7d -F qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-bd6cb3c3-833b-42f9-b167-94db568edb7d.98eaf222-6701-4231-be9e-fd0101952773
Apr 10 13:15:31 devstack sudo[87971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:15:32 devstack sudo[87955]: pam_unix(sudo:session): session closed for user root
Apr 10 13:15:32 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-d54c7eb1-81fc-4f71-adcb-4a9ab4cd8002 tempest-VolumesExtendTest-27412717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5_wmx3w6sfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-10eb703a-4bb2-49bb-aeb5-1cf55ee0228a" returned: 0 in 0.822s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:15:32 devstack cinder-volume[83345]: DEBUG cinder.image.image_utils [None req-d54c7eb1-81fc-4f71-adcb-4a9ab4cd8002 tempest-VolumesExtendTest-27412717 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5_wmx3w6sfdevstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-10eb703a-4bb2-49bb-aeb5-1cf55ee0228a {{(pid=83345) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 10 13:15:32 devstack cinder-volume[83345]: INFO cinder.image.image_utils [None req-d54c7eb1-81fc-4f71-adcb-4a9ab4cd8002 tempest-VolumesExtendTest-27412717 None] Converted 112.00 MB image at 112.00 MB/s
Apr 10 13:15:32 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-d54c7eb1-81fc-4f71-adcb-4a9ab4cd8002 tempest-VolumesExtendTest-27412717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-10eb703a-4bb2-49bb-aeb5-1cf55ee0228a 1G {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:15:32 devstack sudo[87973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-10eb703a-4bb2-49bb-aeb5-1cf55ee0228a 1G
Apr 10 13:15:32 devstack sudo[87973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:15:32 devstack sudo[87971]: pam_unix(sudo:session): session closed for user root
Apr 10 13:15:32 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-1310f784-e928-4a31-9ae2-55245e99d313 tempest-GroupSnapshotsV319Test-582040755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd6cb3c3-833b-42f9-b167-94db568edb7d -F qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-bd6cb3c3-833b-42f9-b167-94db568edb7d.98eaf222-6701-4231-be9e-fd0101952773" returned: 0 in 0.465s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:15:32 devstack cinder-volume[83345]: WARNING cinder.volume.drivers.remotefs [None req-1310f784-e928-4a31-9ae2-55245e99d313 tempest-GroupSnapshotsV319Test-582040755 None] /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-bd6cb3c3-833b-42f9-b167-94db568edb7d.98eaf222-6701-4231-be9e-fd0101952773 is being set with open permissions: ugo+rw: NotImplementedError
Apr 10 13:15:32 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-1310f784-e928-4a31-9ae2-55245e99d313 tempest-GroupSnapshotsV319Test-582040755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-bd6cb3c3-833b-42f9-b167-94db568edb7d.98eaf222-6701-4231-be9e-fd0101952773 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:15:32 devstack sudo[87978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-bd6cb3c3-833b-42f9-b167-94db568edb7d.98eaf222-6701-4231-be9e-fd0101952773
Apr 10 13:15:32 devstack sudo[87978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:15:32 devstack sudo[87973]: pam_unix(sudo:session): session closed for user root
Apr 10 13:15:32 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-d54c7eb1-81fc-4f71-adcb-4a9ab4cd8002 tempest-VolumesExtendTest-27412717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-10eb703a-4bb2-49bb-aeb5-1cf55ee0228a 1G" returned: 0 in 0.445s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:15:32 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[753a1c2f-5121-4046-a035-29eb69ee43f0]: (4, 'raw') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:15:32 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-d54c7eb1-81fc-4f71-adcb-4a9ab4cd8002 tempest-VolumesExtendTest-27412717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-10eb703a-4bb2-49bb-aeb5-1cf55ee0228a {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:15:32 devstack sudo[87983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-10eb703a-4bb2-49bb-aeb5-1cf55ee0228a
Apr 10 13:15:32 devstack sudo[87983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:15:32 devstack sudo[87978]: pam_unix(sudo:session): session closed for user root
Apr 10 13:15:32 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-1310f784-e928-4a31-9ae2-55245e99d313 tempest-GroupSnapshotsV319Test-582040755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-bd6cb3c3-833b-42f9-b167-94db568edb7d.98eaf222-6701-4231-be9e-fd0101952773" returned: 0 in 0.417s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:15:32 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-1310f784-e928-4a31-9ae2-55245e99d313 tempest-GroupSnapshotsV319Test-582040755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-bd6cb3c3-833b-42f9-b167-94db568edb7d.info {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:15:32 devstack sudo[87986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-bd6cb3c3-833b-42f9-b167-94db568edb7d.info
Apr 10 13:15:32 devstack sudo[87986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:15:33 devstack sudo[87983]: pam_unix(sudo:session): session closed for user root
Apr 10 13:15:33 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-d54c7eb1-81fc-4f71-adcb-4a9ab4cd8002 tempest-VolumesExtendTest-27412717 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-10eb703a-4bb2-49bb-aeb5-1cf55ee0228a" returned: 0 in 0.464s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:15:33 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-d54c7eb1-81fc-4f71-adcb-4a9ab4cd8002 tempest-VolumesExtendTest-27412717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-10eb703a-4bb2-49bb-aeb5-1cf55ee0228a {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:15:33 devstack sudo[87986]: pam_unix(sudo:session): session closed for user root
Apr 10 13:15:33 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-1310f784-e928-4a31-9ae2-55245e99d313 tempest-GroupSnapshotsV319Test-582040755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-bd6cb3c3-833b-42f9-b167-94db568edb7d.info" returned: 0 in 0.406s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:15:33 devstack cinder-volume[83345]: WARNING cinder.volume.drivers.remotefs [None req-1310f784-e928-4a31-9ae2-55245e99d313 tempest-GroupSnapshotsV319Test-582040755 None] /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-bd6cb3c3-833b-42f9-b167-94db568edb7d.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 10 13:15:33 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-1310f784-e928-4a31-9ae2-55245e99d313 tempest-GroupSnapshotsV319Test-582040755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-bd6cb3c3-833b-42f9-b167-94db568edb7d.info {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:15:33 devstack sudo[87991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-10eb703a-4bb2-49bb-aeb5-1cf55ee0228a
Apr 10 13:15:33 devstack sudo[87991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:15:33 devstack sudo[87992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-bd6cb3c3-833b-42f9-b167-94db568edb7d.info
Apr 10 13:15:33 devstack sudo[87992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:15:33 devstack sudo[87992]: pam_unix(sudo:session): session closed for user root
Apr 10 13:15:33 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-1310f784-e928-4a31-9ae2-55245e99d313 tempest-GroupSnapshotsV319Test-582040755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-bd6cb3c3-833b-42f9-b167-94db568edb7d.info" returned: 0 in 0.437s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:15:33 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-1310f784-e928-4a31-9ae2-55245e99d313 tempest-GroupSnapshotsV319Test-582040755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.839s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:15:33 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-5cf4070d-1043-402d-b9e5-629fb822a522 tempest-VolumesActionsTest-353155709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 3.921s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:15:33 devstack sudo[87991]: pam_unix(sudo:session): session closed for user root
Apr 10 13:15:33 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e675a2e-b859-4cfd-9c26-d9922be43c65]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:15:33 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-5cf4070d-1043-402d-b9e5-629fb822a522 tempest-VolumesActionsTest-353155709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-99a2ad7b-89ba-4314-8b09-0871e97a3712 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:15:33 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-d54c7eb1-81fc-4f71-adcb-4a9ab4cd8002 tempest-VolumesExtendTest-27412717 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-10eb703a-4bb2-49bb-aeb5-1cf55ee0228a" returned: 1 in 0.530s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:15:33 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-d54c7eb1-81fc-4f71-adcb-4a9ab4cd8002 tempest-VolumesExtendTest-27412717 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-10eb703a-4bb2-49bb-aeb5-1cf55ee0228a' failed. Not Retrying. {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 10 13:15:33 devstack cinder-volume[83345]: DEBUG cinder.volume.volume_utils [None req-d54c7eb1-81fc-4f71-adcb-4a9ab4cd8002 tempest-VolumesExtendTest-27412717 None] Downloaded image dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5 ((None, [{'url': 'file:///opt/stack/data/glance/images/dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5', 'metadata': {}}])) to volume 10eb703a-4bb2-49bb-aeb5-1cf55ee0228a successfully. {{(pid=83345) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 10 13:15:33 devstack cinder-volume[83345]: DEBUG cinder.image.image_utils [None req-d54c7eb1-81fc-4f71-adcb-4a9ab4cd8002 tempest-VolumesExtendTest-27412717 None] Temporary image dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5 for user 6d7be3aa913e4d759b4510d8ca9b9afc is deleted. {{(pid=83345) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 10 13:15:33 devstack cinder-volume[83345]: DEBUG cinder.volume.volume_utils [None req-d54c7eb1-81fc-4f71-adcb-4a9ab4cd8002 tempest-VolumesExtendTest-27412717 None] Marking volume 10eb703a-4bb2-49bb-aeb5-1cf55ee0228a as bootable. {{(pid=83345) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 10 13:15:33 devstack sudo[87999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-99a2ad7b-89ba-4314-8b09-0871e97a3712
Apr 10 13:15:33 devstack sudo[87999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:15:34 devstack sudo[87999]: pam_unix(sudo:session): session closed for user root
Apr 10 13:15:34 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-5cf4070d-1043-402d-b9e5-629fb822a522 tempest-VolumesActionsTest-353155709 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-99a2ad7b-89ba-4314-8b09-0871e97a3712" returned: 0 in 0.474s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:15:34 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb141623-1173-43a0-a012-d25c14653bb3]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:15:34 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-5cf4070d-1043-402d-b9e5-629fb822a522 tempest-VolumesActionsTest-353155709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-99a2ad7b-89ba-4314-8b09-0871e97a3712 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:15:34 devstack sudo[88004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-99a2ad7b-89ba-4314-8b09-0871e97a3712
Apr 10 13:15:34 devstack sudo[88004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:15:34 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-d54c7eb1-81fc-4f71-adcb-4a9ab4cd8002 tempest-VolumesExtendTest-27412717 None] Copying metadata from image dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5 to 10eb703a-4bb2-49bb-aeb5-1cf55ee0228a. {{(pid=83345) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 10 13:15:34 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-d54c7eb1-81fc-4f71-adcb-4a9ab4cd8002 tempest-VolumesExtendTest-27412717 None] Creating volume glance metadata for volume 10eb703a-4bb2-49bb-aeb5-1cf55ee0228a backed by image dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83345) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 10 13:15:34 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-d54c7eb1-81fc-4f71-adcb-4a9ab4cd8002 tempest-VolumesExtendTest-27412717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4b94f1e-7e07-4f57-bdc9-ed57c906f8ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10eb703a-4bb2-49bb-aeb5-1cf55ee0228a', 'volume_size': 1, 'image_id': 'dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8c498714b5e64042a43894acdb754f15', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5', 'created_at': datetime.datetime(2026, 4, 10, 11, 6, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 10, 11, 6, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f252b351120>}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:15:34 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-d54c7eb1-81fc-4f71-adcb-4a9ab4cd8002 tempest-VolumesExtendTest-27412717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea25e50a-2e64-43d6-b353-648e3c854752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:15:34 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-d54c7eb1-81fc-4f71-adcb-4a9ab4cd8002 tempest-VolumesExtendTest-27412717 None] Volume volume-10eb703a-4bb2-49bb-aeb5-1cf55ee0228a (10eb703a-4bb2-49bb-aeb5-1cf55ee0228a): created successfully
Apr 10 13:15:34 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-d54c7eb1-81fc-4f71-adcb-4a9ab4cd8002 tempest-VolumesExtendTest-27412717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea25e50a-2e64-43d6-b353-648e3c854752) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:15:34 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-d54c7eb1-81fc-4f71-adcb-4a9ab4cd8002 tempest-VolumesExtendTest-27412717 None] Flow 'volume_create_manager' (f2412799-3edc-4c0c-beee-7ea771f9c004) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:15:34 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-d54c7eb1-81fc-4f71-adcb-4a9ab4cd8002 tempest-VolumesExtendTest-27412717 None] Created volume successfully.
Apr 10 13:15:34 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-1310f784-e928-4a31-9ae2-55245e99d313 tempest-GroupSnapshotsV319Test-582040755 None] group_snapshot 39c17885-591e-40d0-9282-0a5482aba8f5: created successfully
Apr 10 13:15:34 devstack sudo[88004]: pam_unix(sudo:session): session closed for user root
Apr 10 13:15:34 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-5cf4070d-1043-402d-b9e5-629fb822a522 tempest-VolumesActionsTest-353155709 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-99a2ad7b-89ba-4314-8b09-0871e97a3712" returned: 0 in 0.488s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:15:34 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-5cf4070d-1043-402d-b9e5-629fb822a522 tempest-VolumesActionsTest-353155709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-99a2ad7b-89ba-4314-8b09-0871e97a3712 /opt/stack/data/cinder/conversion/99a2ad7b-89ba-4314-8b09-0871e97a3712.temp_image.499caaf2-b2b4-4644-9ad1-e9fae36cdf35ub_wg_2y.img {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:15:34 devstack sudo[88009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-99a2ad7b-89ba-4314-8b09-0871e97a3712 /opt/stack/data/cinder/conversion/99a2ad7b-89ba-4314-8b09-0871e97a3712.temp_image.499caaf2-b2b4-4644-9ad1-e9fae36cdf35ub_wg_2y.img
Apr 10 13:15:34 devstack sudo[88009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:15:34 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-7d4988b0-4b75-4129-a183-1382385c9264 tempest-VolumesExtendTest-27412717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:15:36 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-6d8def23-3901-4245-ae8d-e3ad85131c71 tempest-GroupSnapshotsV319Test-582040755 None] group_snapshot 39c17885-591e-40d0-9282-0a5482aba8f5: deleting
Apr 10 13:15:36 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-6d8def23-3901-4245-ae8d-e3ad85131c71 tempest-GroupSnapshotsV319Test-582040755 None] group_snapshot 39c17885-591e-40d0-9282-0a5482aba8f5: deleting {{(pid=83345) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 10 13:15:36 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-6d8def23-3901-4245-ae8d-e3ad85131c71 tempest-GroupSnapshotsV319Test-582040755 None] Acquiring lock "cinder-quobyte-bd6cb3c3-833b-42f9-b167-94db568edb7d" by "delete_snapshot" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:15:36 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-6d8def23-3901-4245-ae8d-e3ad85131c71 tempest-GroupSnapshotsV319Test-582040755 None] Lock "cinder-quobyte-bd6cb3c3-833b-42f9-b167-94db568edb7d" acquired by "delete_snapshot" :: waited 0.043s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:15:36 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-6d8def23-3901-4245-ae8d-e3ad85131c71 tempest-GroupSnapshotsV319Test-582040755 None] Acquiring lock "cinder-quobyte-98eaf222-6701-4231-be9e-fd0101952773" by "_delete_snapshot" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:15:36 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-6d8def23-3901-4245-ae8d-e3ad85131c71 tempest-GroupSnapshotsV319Test-582040755 None] Lock "cinder-quobyte-98eaf222-6701-4231-be9e-fd0101952773" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:15:36 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-6d8def23-3901-4245-ae8d-e3ad85131c71 tempest-GroupSnapshotsV319Test-582040755 None] Deleting offline snapshot 98eaf222-6701-4231-be9e-fd0101952773 of volume bd6cb3c3-833b-42f9-b167-94db568edb7d {{(pid=83345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 10 13:15:36 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-6d8def23-3901-4245-ae8d-e3ad85131c71 tempest-GroupSnapshotsV319Test-582040755 None] snapshot_file for this snap is: volume-bd6cb3c3-833b-42f9-b167-94db568edb7d.98eaf222-6701-4231-be9e-fd0101952773 {{(pid=83345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 10 13:15:36 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[66dc40fd-191c-42d7-882e-a35a0e47845a]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:15:36 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-6d8def23-3901-4245-ae8d-e3ad85131c71 tempest-GroupSnapshotsV319Test-582040755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-bd6cb3c3-833b-42f9-b167-94db568edb7d.98eaf222-6701-4231-be9e-fd0101952773 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:15:36 devstack sudo[88021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-bd6cb3c3-833b-42f9-b167-94db568edb7d.98eaf222-6701-4231-be9e-fd0101952773
Apr 10 13:15:36 devstack sudo[88021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:15:36 devstack sudo[88009]: pam_unix(sudo:session): session closed for user root
Apr 10 13:15:36 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-5cf4070d-1043-402d-b9e5-629fb822a522 tempest-VolumesActionsTest-353155709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-99a2ad7b-89ba-4314-8b09-0871e97a3712 /opt/stack/data/cinder/conversion/99a2ad7b-89ba-4314-8b09-0871e97a3712.temp_image.499caaf2-b2b4-4644-9ad1-e9fae36cdf35ub_wg_2y.img" returned: 0 in 1.938s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:15:36 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab57345-dd33-4e60-a3d2-bebbacdb2732]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:15:36 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-5cf4070d-1043-402d-b9e5-629fb822a522 tempest-VolumesActionsTest-353155709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-99a2ad7b-89ba-4314-8b09-0871e97a3712 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:15:36 devstack sudo[88023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-99a2ad7b-89ba-4314-8b09-0871e97a3712
Apr 10 13:15:36 devstack sudo[88023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:15:36 devstack sudo[88021]: pam_unix(sudo:session): session closed for user root
Apr 10 13:15:36 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-6d8def23-3901-4245-ae8d-e3ad85131c71 tempest-GroupSnapshotsV319Test-582040755 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-bd6cb3c3-833b-42f9-b167-94db568edb7d.98eaf222-6701-4231-be9e-fd0101952773" returned: 0 in 0.649s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:15:36 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-6d8def23-3901-4245-ae8d-e3ad85131c71 tempest-GroupSnapshotsV319Test-582040755 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd6cb3c3-833b-42f9-b167-94db568edb7d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 13:15:36 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[f565bfdf-8b64-49c3-b346-c1b75698b0c0]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:15:36 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-6d8def23-3901-4245-ae8d-e3ad85131c71 tempest-GroupSnapshotsV319Test-582040755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-bd6cb3c3-833b-42f9-b167-94db568edb7d {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:15:37 devstack sudo[88028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-bd6cb3c3-833b-42f9-b167-94db568edb7d
Apr 10 13:15:37 devstack sudo[88028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:15:37 devstack sudo[88023]: pam_unix(sudo:session): session closed for user root
Apr 10 13:15:37 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-5cf4070d-1043-402d-b9e5-629fb822a522 tempest-VolumesActionsTest-353155709 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-99a2ad7b-89ba-4314-8b09-0871e97a3712" returned: 0 in 0.607s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:15:37 devstack cinder-volume[83345]: DEBUG cinder.image.image_utils [None req-5cf4070d-1043-402d-b9e5-629fb822a522 tempest-VolumesActionsTest-353155709 None] Image conversion details: src /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-99a2ad7b-89ba-4314-8b09-0871e97a3712, size 1024.00 MB, duration 1.94 sec, destination /opt/stack/data/cinder/conversion/99a2ad7b-89ba-4314-8b09-0871e97a3712.temp_image.499caaf2-b2b4-4644-9ad1-e9fae36cdf35ub_wg_2y.img {{(pid=83345) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 10 13:15:37 devstack cinder-volume[83345]: INFO cinder.image.image_utils [None req-5cf4070d-1043-402d-b9e5-629fb822a522 tempest-VolumesActionsTest-353155709 None] Converted 1024.00 MB image at 528.07 MB/s
Apr 10 13:15:37 devstack cinder-volume[83345]: DEBUG cinder.image.image_utils [None req-5cf4070d-1043-402d-b9e5-629fb822a522 tempest-VolumesActionsTest-353155709 None] 499caaf2-b2b4-4644-9ad1-e9fae36cdf35 was raw, converting to qcow2 {{(pid=83345) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}}
Apr 10 13:15:37 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[607d43a6-1fd8-46a6-ae12-48ff9b4a84d9]: (4, 'raw') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:15:37 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-5cf4070d-1043-402d-b9e5-629fb822a522 tempest-VolumesActionsTest-353155709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/99a2ad7b-89ba-4314-8b09-0871e97a3712.temp_image.499caaf2-b2b4-4644-9ad1-e9fae36cdf35ub_wg_2y.img {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:15:37 devstack sudo[88033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/99a2ad7b-89ba-4314-8b09-0871e97a3712.temp_image.499caaf2-b2b4-4644-9ad1-e9fae36cdf35ub_wg_2y.img
Apr 10 13:15:37 devstack sudo[88033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:15:37 devstack sudo[88028]: pam_unix(sudo:session): session closed for user root
Apr 10 13:15:37 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-6d8def23-3901-4245-ae8d-e3ad85131c71 tempest-GroupSnapshotsV319Test-582040755 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-bd6cb3c3-833b-42f9-b167-94db568edb7d" returned: 0 in 0.489s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:15:37 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-6d8def23-3901-4245-ae8d-e3ad85131c71 tempest-GroupSnapshotsV319Test-582040755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-bd6cb3c3-833b-42f9-b167-94db568edb7d.98eaf222-6701-4231-be9e-fd0101952773 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:15:37 devstack sudo[88038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-bd6cb3c3-833b-42f9-b167-94db568edb7d.98eaf222-6701-4231-be9e-fd0101952773
Apr 10 13:15:37 devstack sudo[88038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:15:37 devstack sudo[88033]: pam_unix(sudo:session): session closed for user root
Apr 10 13:15:37 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-5cf4070d-1043-402d-b9e5-629fb822a522 tempest-VolumesActionsTest-353155709 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/99a2ad7b-89ba-4314-8b09-0871e97a3712.temp_image.499caaf2-b2b4-4644-9ad1-e9fae36cdf35ub_wg_2y.img" returned: 0 in 0.456s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:15:37 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-5cf4070d-1043-402d-b9e5-629fb822a522 tempest-VolumesActionsTest-353155709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/99a2ad7b-89ba-4314-8b09-0871e97a3712.temp_image.499caaf2-b2b4-4644-9ad1-e9fae36cdf35ub_wg_2y.img {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:15:37 devstack sudo[88042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/99a2ad7b-89ba-4314-8b09-0871e97a3712.temp_image.499caaf2-b2b4-4644-9ad1-e9fae36cdf35ub_wg_2y.img
Apr 10 13:15:37 devstack sudo[88042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:15:37 devstack sudo[88038]: pam_unix(sudo:session): session closed for user root
Apr 10 13:15:37 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-6d8def23-3901-4245-ae8d-e3ad85131c71 tempest-GroupSnapshotsV319Test-582040755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-bd6cb3c3-833b-42f9-b167-94db568edb7d.98eaf222-6701-4231-be9e-fd0101952773" returned: 0 in 0.442s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:15:37 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-6d8def23-3901-4245-ae8d-e3ad85131c71 tempest-GroupSnapshotsV319Test-582040755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-bd6cb3c3-833b-42f9-b167-94db568edb7d.98eaf222-6701-4231-be9e-fd0101952773 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:15:37 devstack sudo[88047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-bd6cb3c3-833b-42f9-b167-94db568edb7d.98eaf222-6701-4231-be9e-fd0101952773
Apr 10 13:15:37 devstack sudo[88047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:15:38 devstack sudo[88042]: pam_unix(sudo:session): session closed for user root
Apr 10 13:15:38 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-5cf4070d-1043-402d-b9e5-629fb822a522 tempest-VolumesActionsTest-353155709 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/99a2ad7b-89ba-4314-8b09-0871e97a3712.temp_image.499caaf2-b2b4-4644-9ad1-e9fae36cdf35ub_wg_2y.img" returned: 1 in 0.462s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:15:38 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-5cf4070d-1043-402d-b9e5-629fb822a522 tempest-VolumesActionsTest-353155709 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/99a2ad7b-89ba-4314-8b09-0871e97a3712.temp_image.499caaf2-b2b4-4644-9ad1-e9fae36cdf35ub_wg_2y.img' failed. Not Retrying. {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 10 13:15:38 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-5cf4070d-1043-402d-b9e5-629fb822a522 tempest-VolumesActionsTest-353155709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/99a2ad7b-89ba-4314-8b09-0871e97a3712.temp_image.499caaf2-b2b4-4644-9ad1-e9fae36cdf35ub_wg_2y.img /opt/stack/data/cinder/conversion/vol_upload_jsab4ozn {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:15:38 devstack sudo[88052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/99a2ad7b-89ba-4314-8b09-0871e97a3712.temp_image.499caaf2-b2b4-4644-9ad1-e9fae36cdf35ub_wg_2y.img /opt/stack/data/cinder/conversion/vol_upload_jsab4ozn
Apr 10 13:15:38 devstack sudo[88052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:15:38 devstack sudo[88047]: pam_unix(sudo:session): session closed for user root
Apr 10 13:15:38 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-6d8def23-3901-4245-ae8d-e3ad85131c71 tempest-GroupSnapshotsV319Test-582040755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-bd6cb3c3-833b-42f9-b167-94db568edb7d.98eaf222-6701-4231-be9e-fd0101952773" returned: 0 in 0.427s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:15:38 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-6d8def23-3901-4245-ae8d-e3ad85131c71 tempest-GroupSnapshotsV319Test-582040755 None] Lock "cinder-quobyte-98eaf222-6701-4231-be9e-fd0101952773" released by "_delete_snapshot" :: held 2.066s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:15:38 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-6d8def23-3901-4245-ae8d-e3ad85131c71 tempest-GroupSnapshotsV319Test-582040755 None] Lock "cinder-quobyte-bd6cb3c3-833b-42f9-b167-94db568edb7d" released by "delete_snapshot" :: held 2.100s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:15:38 devstack cinder-volume[83345]: WARNING cinder.quota [None req-6d8def23-3901-4245-ae8d-e3ad85131c71 tempest-GroupSnapshotsV319Test-582040755 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-2102420618 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-2102420618, it is now deprecated. Please use the default quota class for default quota.
Apr 10 13:15:38 devstack cinder-volume[83345]: WARNING cinder.quota [None req-6d8def23-3901-4245-ae8d-e3ad85131c71 tempest-GroupSnapshotsV319Test-582040755 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-2102420618 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-2102420618, it is now deprecated. Please use the default quota class for default quota.
Apr 10 13:15:38 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-6d8def23-3901-4245-ae8d-e3ad85131c71 tempest-GroupSnapshotsV319Test-582040755 None] Created reservations ['93790416-e50e-4e2b-af37-18519f84cd9e', 'd631602f-1df4-4bf2-b56f-eac991cf9084', '3ae5403d-db03-4917-aa7e-7b19314e2ee3', 'b1e202be-4049-4d49-bd37-5c732a781636'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:15:38 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-6d8def23-3901-4245-ae8d-e3ad85131c71 tempest-GroupSnapshotsV319Test-582040755 None] group_snapshot 39c17885-591e-40d0-9282-0a5482aba8f5: deleted successfully
Apr 10 13:15:38 devstack sudo[88052]: pam_unix(sudo:session): session closed for user root
Apr 10 13:15:38 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-5cf4070d-1043-402d-b9e5-629fb822a522 tempest-VolumesActionsTest-353155709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/99a2ad7b-89ba-4314-8b09-0871e97a3712.temp_image.499caaf2-b2b4-4644-9ad1-e9fae36cdf35ub_wg_2y.img /opt/stack/data/cinder/conversion/vol_upload_jsab4ozn" returned: 0 in 0.464s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:15:38 devstack cinder-volume[83345]: DEBUG cinder.image.image_utils [None req-5cf4070d-1043-402d-b9e5-629fb822a522 tempest-VolumesActionsTest-353155709 None] Image conversion details: src /opt/stack/data/cinder/conversion/99a2ad7b-89ba-4314-8b09-0871e97a3712.temp_image.499caaf2-b2b4-4644-9ad1-e9fae36cdf35ub_wg_2y.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_jsab4ozn {{(pid=83345) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 10 13:15:38 devstack cinder-volume[83345]: INFO cinder.image.image_utils [None req-5cf4070d-1043-402d-b9e5-629fb822a522 tempest-VolumesActionsTest-353155709 None] Converted 1024.00 MB image at 1024.00 MB/s
Apr 10 13:15:38 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[954ff4e0-58e0-44cc-b592-f08fc7180de5]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:15:38 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-5cf4070d-1043-402d-b9e5-629fb822a522 tempest-VolumesActionsTest-353155709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_jsab4ozn {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:15:38 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-73d2a93b-6d56-4b31-9947-e5763ab0c927 tempest-GroupSnapshotsV319Test-582040755 None] Acquiring lock "cinder-quobyte-bd6cb3c3-833b-42f9-b167-94db568edb7d" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:15:38 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-73d2a93b-6d56-4b31-9947-e5763ab0c927 tempest-GroupSnapshotsV319Test-582040755 None] Lock "cinder-quobyte-bd6cb3c3-833b-42f9-b167-94db568edb7d" acquired by "delete_volume" :: waited 0.010s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:15:38 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ced31ed-ccee-449b-888d-29ad3c9b92ea]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:15:38 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-73d2a93b-6d56-4b31-9947-e5763ab0c927 tempest-GroupSnapshotsV319Test-582040755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-bd6cb3c3-833b-42f9-b167-94db568edb7d {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:15:38 devstack sudo[88058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_jsab4ozn
Apr 10 13:15:38 devstack sudo[88058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:15:38 devstack sudo[88059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-bd6cb3c3-833b-42f9-b167-94db568edb7d
Apr 10 13:15:38 devstack sudo[88059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:15:39 devstack sudo[88058]: pam_unix(sudo:session): session closed for user root
Apr 10 13:15:39 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-5cf4070d-1043-402d-b9e5-629fb822a522 tempest-VolumesActionsTest-353155709 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_jsab4ozn" returned: 0 in 0.487s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:15:39 devstack sudo[88059]: pam_unix(sudo:session): session closed for user root
Apr 10 13:15:39 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-73d2a93b-6d56-4b31-9947-e5763ab0c927 tempest-GroupSnapshotsV319Test-582040755 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-bd6cb3c3-833b-42f9-b167-94db568edb7d" returned: 0 in 0.487s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:15:39 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-73d2a93b-6d56-4b31-9947-e5763ab0c927 tempest-GroupSnapshotsV319Test-582040755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-bd6cb3c3-833b-42f9-b167-94db568edb7d {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:15:39 devstack sudo[88068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-bd6cb3c3-833b-42f9-b167-94db568edb7d
Apr 10 13:15:39 devstack sudo[88068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:15:39 devstack sudo[88068]: pam_unix(sudo:session): session closed for user root
Apr 10 13:15:39 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-73d2a93b-6d56-4b31-9947-e5763ab0c927 tempest-GroupSnapshotsV319Test-582040755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-bd6cb3c3-833b-42f9-b167-94db568edb7d" returned: 0 in 0.425s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:15:39 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-73d2a93b-6d56-4b31-9947-e5763ab0c927 tempest-GroupSnapshotsV319Test-582040755 None] Lock "cinder-quobyte-bd6cb3c3-833b-42f9-b167-94db568edb7d" released by "delete_volume" :: held 0.945s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:15:39 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-73d2a93b-6d56-4b31-9947-e5763ab0c927 tempest-GroupSnapshotsV319Test-582040755 None] Created reservations ['acea7310-f6ad-46b4-b94f-8841add520e7'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:15:39 devstack cinder-volume[83345]: WARNING cinder.quota [None req-73d2a93b-6d56-4b31-9947-e5763ab0c927 tempest-GroupSnapshotsV319Test-582040755 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-2102420618 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-2102420618, it is now deprecated. Please use the default quota class for default quota.
Apr 10 13:15:39 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-73d2a93b-6d56-4b31-9947-e5763ab0c927 tempest-GroupSnapshotsV319Test-582040755 None] Created reservations ['0352dbe9-0756-4cc5-9233-bc398d12029b', 'a05693f7-78ff-4d67-9c5b-5db4f71bab4d', '1c55af17-1358-4d19-9d88-e76c17b8bf8a', 'de360684-5bc4-4686-b3b9-6a27fd11eb4a'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:15:39 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-73d2a93b-6d56-4b31-9947-e5763ab0c927 tempest-GroupSnapshotsV319Test-582040755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:15:39 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-73d2a93b-6d56-4b31-9947-e5763ab0c927 tempest-GroupSnapshotsV319Test-582040755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:15:39 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-73d2a93b-6d56-4b31-9947-e5763ab0c927 tempest-GroupSnapshotsV319Test-582040755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:15:39 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-73d2a93b-6d56-4b31-9947-e5763ab0c927 tempest-GroupSnapshotsV319Test-582040755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:15:39 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-73d2a93b-6d56-4b31-9947-e5763ab0c927 tempest-GroupSnapshotsV319Test-582040755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:15:39 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-73d2a93b-6d56-4b31-9947-e5763ab0c927 tempest-GroupSnapshotsV319Test-582040755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:15:39 devstack sudo[88071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:15:39 devstack sudo[88071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:15:39 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-5cf4070d-1043-402d-b9e5-629fb822a522 tempest-VolumesActionsTest-353155709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 6.329s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:15:39 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-5cf4070d-1043-402d-b9e5-629fb822a522 tempest-VolumesActionsTest-353155709 None] Uploaded volume to glance image-id: 499caaf2-b2b4-4644-9ad1-e9fae36cdf35. {{(pid=83345) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Apr 10 13:15:39 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-7bd393ac-d0ad-4b1b-8c6c-87f5ff15c723 tempest-VolumesGetTest-1325070593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.365s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:15:39 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-7bd393ac-d0ad-4b1b-8c6c-87f5ff15c723 tempest-VolumesGetTest-1325070593 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f252bf08b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:15:31Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1535948604',display_name='tempest-VolumesGetTest-Volume-1369598762',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10de490e-de9e-42fd-a7c7-9135b2ef73a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2164901a19c74ad5a7ac47fa92772df3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:15:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:15:32Z,use_quota=True,user_id='e6a465b820764bf78e3ec91bbb896b7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)}" {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 13:15:39 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-7bd393ac-d0ad-4b1b-8c6c-87f5ff15c723 tempest-VolumesGetTest-1325070593 None] Creating volume 10de490e-de9e-42fd-a7c7-9135b2ef73a8 {{(pid=83345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 13:15:39 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-7bd393ac-d0ad-4b1b-8c6c-87f5ff15c723 tempest-VolumesGetTest-1325070593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:15:39 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-7bd393ac-d0ad-4b1b-8c6c-87f5ff15c723 tempest-VolumesGetTest-1325070593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:15:39 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-7bd393ac-d0ad-4b1b-8c6c-87f5ff15c723 tempest-VolumesGetTest-1325070593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:15:40 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-7bd393ac-d0ad-4b1b-8c6c-87f5ff15c723 tempest-VolumesGetTest-1325070593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:15:40 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-7bd393ac-d0ad-4b1b-8c6c-87f5ff15c723 tempest-VolumesGetTest-1325070593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:15:40 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-7bd393ac-d0ad-4b1b-8c6c-87f5ff15c723 tempest-VolumesGetTest-1325070593 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:15:40 devstack cinder-volume[83345]: INFO cinder.volume.drivers.remotefs [None req-7bd393ac-d0ad-4b1b-8c6c-87f5ff15c723 tempest-VolumesGetTest-1325070593 None] casted to osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331
Apr 10 13:15:40 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-7bd393ac-d0ad-4b1b-8c6c-87f5ff15c723 tempest-VolumesGetTest-1325070593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-10de490e-de9e-42fd-a7c7-9135b2ef73a8 1073741824 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:15:40 devstack sudo[88073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-10de490e-de9e-42fd-a7c7-9135b2ef73a8 1073741824
Apr 10 13:15:40 devstack sudo[88073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:15:40 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-5cf4070d-1043-402d-b9e5-629fb822a522 tempest-VolumesActionsTest-353155709 None] Copy volume to image completed successfully.
Apr 10 13:15:40 devstack sudo[88071]: pam_unix(sudo:session): session closed for user root
Apr 10 13:15:40 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-73d2a93b-6d56-4b31-9947-e5763ab0c927 tempest-GroupSnapshotsV319Test-582040755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.477s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:15:40 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-73d2a93b-6d56-4b31-9947-e5763ab0c927 tempest-GroupSnapshotsV319Test-582040755 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:15:40 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-73d2a93b-6d56-4b31-9947-e5763ab0c927 tempest-GroupSnapshotsV319Test-582040755 None] Delete group completed successfully.
Apr 10 13:15:40 devstack sudo[88073]: pam_unix(sudo:session): session closed for user root
Apr 10 13:15:40 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-7bd393ac-d0ad-4b1b-8c6c-87f5ff15c723 tempest-VolumesGetTest-1325070593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-10de490e-de9e-42fd-a7c7-9135b2ef73a8 1073741824" returned: 0 in 0.466s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:15:40 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-7bd393ac-d0ad-4b1b-8c6c-87f5ff15c723 tempest-VolumesGetTest-1325070593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-10de490e-de9e-42fd-a7c7-9135b2ef73a8 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:15:40 devstack sudo[88079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-10de490e-de9e-42fd-a7c7-9135b2ef73a8
Apr 10 13:15:40 devstack sudo[88079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:15:40 devstack sudo[88079]: pam_unix(sudo:session): session closed for user root
Apr 10 13:15:40 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-7bd393ac-d0ad-4b1b-8c6c-87f5ff15c723 tempest-VolumesGetTest-1325070593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-10de490e-de9e-42fd-a7c7-9135b2ef73a8" returned: 0 in 0.414s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:15:40 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-7bd393ac-d0ad-4b1b-8c6c-87f5ff15c723 tempest-VolumesGetTest-1325070593 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'} {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 13:15:40 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-7bd393ac-d0ad-4b1b-8c6c-87f5ff15c723 tempest-VolumesGetTest-1325070593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:15:40 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-7d4988b0-4b75-4129-a183-1382385c9264 tempest-VolumesExtendTest-27412717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 6.107s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:15:40 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-7bd393ac-d0ad-4b1b-8c6c-87f5ff15c723 tempest-VolumesGetTest-1325070593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c08e427-31e6-4932-b9a9-57e5d634d583) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10de490e-de9e-42fd-a7c7-9135b2ef73a8', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:15:40 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-7bd393ac-d0ad-4b1b-8c6c-87f5ff15c723 tempest-VolumesGetTest-1325070593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76900fba-1f30-4e89-875b-d81891418cd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:15:40 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[9209a124-5068-4db6-8d70-8bb5d4821eb7]: (4, 'raw') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:15:40 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-7d4988b0-4b75-4129-a183-1382385c9264 tempest-VolumesExtendTest-27412717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-10eb703a-4bb2-49bb-aeb5-1cf55ee0228a {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:15:40 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-7bd393ac-d0ad-4b1b-8c6c-87f5ff15c723 tempest-VolumesGetTest-1325070593 None] Volume volume-10de490e-de9e-42fd-a7c7-9135b2ef73a8 (10de490e-de9e-42fd-a7c7-9135b2ef73a8): created successfully
Apr 10 13:15:40 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-7bd393ac-d0ad-4b1b-8c6c-87f5ff15c723 tempest-VolumesGetTest-1325070593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76900fba-1f30-4e89-875b-d81891418cd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:15:40 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-7bd393ac-d0ad-4b1b-8c6c-87f5ff15c723 tempest-VolumesGetTest-1325070593 None] Flow 'volume_create_manager' (47dd518f-7242-4543-9150-d48791c28169) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:15:40 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-7bd393ac-d0ad-4b1b-8c6c-87f5ff15c723 tempest-VolumesGetTest-1325070593 None] Created volume successfully.
Apr 10 13:15:41 devstack sudo[88082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-10eb703a-4bb2-49bb-aeb5-1cf55ee0228a
Apr 10 13:15:41 devstack sudo[88082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:15:41 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-01eea6bf-a2a4-4a27-9b2e-b5f20488222b tempest-VolumesGetTest-1325070593 None] Acquiring lock "cinder-10de490e-de9e-42fd-a7c7-9135b2ef73a8-delete_volume" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:15:41 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-01eea6bf-a2a4-4a27-9b2e-b5f20488222b tempest-VolumesGetTest-1325070593 None] Lock "cinder-10de490e-de9e-42fd-a7c7-9135b2ef73a8-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:15:41 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-01eea6bf-a2a4-4a27-9b2e-b5f20488222b tempest-VolumesGetTest-1325070593 None] Acquiring lock "cinder-quobyte-10de490e-de9e-42fd-a7c7-9135b2ef73a8" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:15:41 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-01eea6bf-a2a4-4a27-9b2e-b5f20488222b tempest-VolumesGetTest-1325070593 None] Lock "cinder-quobyte-10de490e-de9e-42fd-a7c7-9135b2ef73a8" acquired by "delete_volume" :: waited 0.007s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:15:41 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c698594-6203-4792-be86-074a36d67b66]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:15:41 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-01eea6bf-a2a4-4a27-9b2e-b5f20488222b tempest-VolumesGetTest-1325070593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-10de490e-de9e-42fd-a7c7-9135b2ef73a8 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:15:41 devstack sudo[88084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-10de490e-de9e-42fd-a7c7-9135b2ef73a8
Apr 10 13:15:41 devstack sudo[88084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:15:41 devstack sudo[88082]: pam_unix(sudo:session): session closed for user root
Apr 10 13:15:41 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-7d4988b0-4b75-4129-a183-1382385c9264 tempest-VolumesExtendTest-27412717 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-10eb703a-4bb2-49bb-aeb5-1cf55ee0228a" returned: 0 in 0.580s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:15:41 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-7d4988b0-4b75-4129-a183-1382385c9264 tempest-VolumesExtendTest-27412717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-10eb703a-4bb2-49bb-aeb5-1cf55ee0228a {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:15:41 devstack sudo[88089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-10eb703a-4bb2-49bb-aeb5-1cf55ee0228a
Apr 10 13:15:41 devstack sudo[88089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:15:41 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-c4a8ec00-db71-4539-8cab-a6e9cde8b7f7 tempest-VolumesActionsTest-353155709 None] Acquiring lock "cinder-99a2ad7b-89ba-4314-8b09-0871e97a3712-delete_volume" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:15:41 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-c4a8ec00-db71-4539-8cab-a6e9cde8b7f7 tempest-VolumesActionsTest-353155709 None] Lock "cinder-99a2ad7b-89ba-4314-8b09-0871e97a3712-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:15:41 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-c4a8ec00-db71-4539-8cab-a6e9cde8b7f7 tempest-VolumesActionsTest-353155709 None] Acquiring lock "cinder-quobyte-99a2ad7b-89ba-4314-8b09-0871e97a3712" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:15:41 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-c4a8ec00-db71-4539-8cab-a6e9cde8b7f7 tempest-VolumesActionsTest-353155709 None] Lock "cinder-quobyte-99a2ad7b-89ba-4314-8b09-0871e97a3712" acquired by "delete_volume" :: waited 0.006s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:15:41 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[7796960c-a542-4f2b-a259-2d4f75e5fa14]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:15:41 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-c4a8ec00-db71-4539-8cab-a6e9cde8b7f7 tempest-VolumesActionsTest-353155709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-99a2ad7b-89ba-4314-8b09-0871e97a3712 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:15:41 devstack sudo[88091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-99a2ad7b-89ba-4314-8b09-0871e97a3712
Apr 10 13:15:41 devstack sudo[88091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:15:41 devstack sudo[88084]: pam_unix(sudo:session): session closed for user root
Apr 10 13:15:41 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-01eea6bf-a2a4-4a27-9b2e-b5f20488222b tempest-VolumesGetTest-1325070593 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-10de490e-de9e-42fd-a7c7-9135b2ef73a8" returned: 0 in 0.639s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:15:41 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-01eea6bf-a2a4-4a27-9b2e-b5f20488222b tempest-VolumesGetTest-1325070593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-10de490e-de9e-42fd-a7c7-9135b2ef73a8 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:15:42 devstack sudo[88097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-10de490e-de9e-42fd-a7c7-9135b2ef73a8
Apr 10 13:15:42 devstack sudo[88097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:15:42 devstack sudo[88089]: pam_unix(sudo:session): session closed for user root
Apr 10 13:15:42 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-7d4988b0-4b75-4129-a183-1382385c9264 tempest-VolumesExtendTest-27412717 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-10eb703a-4bb2-49bb-aeb5-1cf55ee0228a" returned: 1 in 0.599s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:15:42 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-7d4988b0-4b75-4129-a183-1382385c9264 tempest-VolumesExtendTest-27412717 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-10eb703a-4bb2-49bb-aeb5-1cf55ee0228a' failed. Not Retrying. {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 10 13:15:42 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-7d4988b0-4b75-4129-a183-1382385c9264 tempest-VolumesExtendTest-27412717 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-10eb703a-4bb2-49bb-aeb5-1cf55ee0228a 2G {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:15:42 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-7d4988b0-4b75-4129-a183-1382385c9264 tempest-VolumesExtendTest-27412717 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-10eb703a-4bb2-49bb-aeb5-1cf55ee0228a 2G" returned: 0 in 0.051s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:15:42 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-7d4988b0-4b75-4129-a183-1382385c9264 tempest-VolumesExtendTest-27412717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.259s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:15:42 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-7d4988b0-4b75-4129-a183-1382385c9264 tempest-VolumesExtendTest-27412717 None] Extend volume completed successfully.
Apr 10 13:15:42 devstack sudo[88091]: pam_unix(sudo:session): session closed for user root
Apr 10 13:15:42 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-c4a8ec00-db71-4539-8cab-a6e9cde8b7f7 tempest-VolumesActionsTest-353155709 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-99a2ad7b-89ba-4314-8b09-0871e97a3712" returned: 0 in 0.644s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:15:42 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-c4a8ec00-db71-4539-8cab-a6e9cde8b7f7 tempest-VolumesActionsTest-353155709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-99a2ad7b-89ba-4314-8b09-0871e97a3712 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:15:42 devstack sudo[88108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-99a2ad7b-89ba-4314-8b09-0871e97a3712
Apr 10 13:15:42 devstack sudo[88108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:15:42 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-7aba46ae-d638-4602-a8d2-bb7a6908b34a tempest-VolumesExtendTest-27412717 None] Acquiring lock "cinder-10eb703a-4bb2-49bb-aeb5-1cf55ee0228a-delete_volume" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:15:42 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-7aba46ae-d638-4602-a8d2-bb7a6908b34a tempest-VolumesExtendTest-27412717 None] Lock "cinder-10eb703a-4bb2-49bb-aeb5-1cf55ee0228a-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:15:42 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-7aba46ae-d638-4602-a8d2-bb7a6908b34a tempest-VolumesExtendTest-27412717 None] Acquiring lock "cinder-quobyte-10eb703a-4bb2-49bb-aeb5-1cf55ee0228a" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:15:42 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-7aba46ae-d638-4602-a8d2-bb7a6908b34a tempest-VolumesExtendTest-27412717 None] Lock "cinder-quobyte-10eb703a-4bb2-49bb-aeb5-1cf55ee0228a" acquired by "delete_volume" :: waited 0.008s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:15:42 devstack sudo[88097]: pam_unix(sudo:session): session closed for user root
Apr 10 13:15:42 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-01eea6bf-a2a4-4a27-9b2e-b5f20488222b tempest-VolumesGetTest-1325070593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-10de490e-de9e-42fd-a7c7-9135b2ef73a8" returned: 0 in 0.557s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:15:42 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-01eea6bf-a2a4-4a27-9b2e-b5f20488222b tempest-VolumesGetTest-1325070593 None] Lock "cinder-quobyte-10de490e-de9e-42fd-a7c7-9135b2ef73a8" released by "delete_volume" :: held 1.225s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:15:42 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[31d68dd3-4f0e-4dce-81a7-3961cb4dc491]: (4, 'raw') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:15:42 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-7aba46ae-d638-4602-a8d2-bb7a6908b34a tempest-VolumesExtendTest-27412717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-10eb703a-4bb2-49bb-aeb5-1cf55ee0228a {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:15:42 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-01eea6bf-a2a4-4a27-9b2e-b5f20488222b tempest-VolumesGetTest-1325070593 None] Created reservations ['e422dc02-df25-4c8b-b83c-e0ccc11c3570', '54e55571-0093-4940-b24f-5055f2d1b080', 'e13db52c-52d4-49c3-94c0-484b05a76c91', '784bd6fa-060e-4819-883f-3404bdd59a31'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:15:42 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-01eea6bf-a2a4-4a27-9b2e-b5f20488222b tempest-VolumesGetTest-1325070593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:15:42 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-01eea6bf-a2a4-4a27-9b2e-b5f20488222b tempest-VolumesGetTest-1325070593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:15:42 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-01eea6bf-a2a4-4a27-9b2e-b5f20488222b tempest-VolumesGetTest-1325070593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:15:42 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-01eea6bf-a2a4-4a27-9b2e-b5f20488222b tempest-VolumesGetTest-1325070593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:15:42 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-01eea6bf-a2a4-4a27-9b2e-b5f20488222b tempest-VolumesGetTest-1325070593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:15:42 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-01eea6bf-a2a4-4a27-9b2e-b5f20488222b tempest-VolumesGetTest-1325070593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:15:42 devstack sudo[88111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-10eb703a-4bb2-49bb-aeb5-1cf55ee0228a
Apr 10 13:15:42 devstack sudo[88111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:15:42 devstack sudo[88112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:15:42 devstack sudo[88112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:15:42 devstack sudo[88108]: pam_unix(sudo:session): session closed for user root
Apr 10 13:15:42 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-c4a8ec00-db71-4539-8cab-a6e9cde8b7f7 tempest-VolumesActionsTest-353155709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-99a2ad7b-89ba-4314-8b09-0871e97a3712" returned: 0 in 0.527s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:15:42 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-c4a8ec00-db71-4539-8cab-a6e9cde8b7f7 tempest-VolumesActionsTest-353155709 None] Lock "cinder-quobyte-99a2ad7b-89ba-4314-8b09-0871e97a3712" released by "delete_volume" :: held 1.194s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:15:42 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-c4a8ec00-db71-4539-8cab-a6e9cde8b7f7 tempest-VolumesActionsTest-353155709 None] Created reservations ['8ac18db7-6b37-40a5-9502-f8dedc3e7ac4', '242da90a-e0af-442b-96e9-cbf0658465ba', '284798e8-17e3-4c03-9fce-597074110292', '94e9eff2-721c-4e14-af03-4df13a01ad15'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:15:42 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-c4a8ec00-db71-4539-8cab-a6e9cde8b7f7 tempest-VolumesActionsTest-353155709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:15:42 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-c4a8ec00-db71-4539-8cab-a6e9cde8b7f7 tempest-VolumesActionsTest-353155709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:15:42 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-c4a8ec00-db71-4539-8cab-a6e9cde8b7f7 tempest-VolumesActionsTest-353155709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:15:42 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-c4a8ec00-db71-4539-8cab-a6e9cde8b7f7 tempest-VolumesActionsTest-353155709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:15:42 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-c4a8ec00-db71-4539-8cab-a6e9cde8b7f7 tempest-VolumesActionsTest-353155709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:15:42 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-c4a8ec00-db71-4539-8cab-a6e9cde8b7f7 tempest-VolumesActionsTest-353155709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:15:42 devstack sudo[88116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:15:42 devstack sudo[88116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:15:43 devstack sudo[88111]: pam_unix(sudo:session): session closed for user root
Apr 10 13:15:43 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-7aba46ae-d638-4602-a8d2-bb7a6908b34a tempest-VolumesExtendTest-27412717 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-10eb703a-4bb2-49bb-aeb5-1cf55ee0228a" returned: 0 in 0.594s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:15:43 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-7aba46ae-d638-4602-a8d2-bb7a6908b34a tempest-VolumesExtendTest-27412717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-10eb703a-4bb2-49bb-aeb5-1cf55ee0228a {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:15:43 devstack sudo[88112]: pam_unix(sudo:session): session closed for user root
Apr 10 13:15:43 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-01eea6bf-a2a4-4a27-9b2e-b5f20488222b tempest-VolumesGetTest-1325070593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.573s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:15:43 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-01eea6bf-a2a4-4a27-9b2e-b5f20488222b tempest-VolumesGetTest-1325070593 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:15:43 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-01eea6bf-a2a4-4a27-9b2e-b5f20488222b tempest-VolumesGetTest-1325070593 None] Deleted volume successfully.
Apr 10 13:15:43 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-01eea6bf-a2a4-4a27-9b2e-b5f20488222b tempest-VolumesGetTest-1325070593 None] Lock "cinder-10de490e-de9e-42fd-a7c7-9135b2ef73a8-delete_volume" released by "delete_volume" :: held 1.961s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:15:43 devstack sudo[88121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-10eb703a-4bb2-49bb-aeb5-1cf55ee0228a
Apr 10 13:15:43 devstack sudo[88121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:15:43 devstack sudo[88116]: pam_unix(sudo:session): session closed for user root
Apr 10 13:15:43 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-c4a8ec00-db71-4539-8cab-a6e9cde8b7f7 tempest-VolumesActionsTest-353155709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.464s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:15:43 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-c4a8ec00-db71-4539-8cab-a6e9cde8b7f7 tempest-VolumesActionsTest-353155709 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:15:43 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-c4a8ec00-db71-4539-8cab-a6e9cde8b7f7 tempest-VolumesActionsTest-353155709 None] Deleted volume successfully.
Apr 10 13:15:43 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-c4a8ec00-db71-4539-8cab-a6e9cde8b7f7 tempest-VolumesActionsTest-353155709 None] Lock "cinder-99a2ad7b-89ba-4314-8b09-0871e97a3712-delete_volume" released by "delete_volume" :: held 1.772s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:15:43 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-3839efe7-3abe-46ff-bce7-adc8652488bd tempest-VolumesGetTest-1325070593 None] Acquiring lock "cinder-eb6e8bb5-c0d7-427e-aa31-981465227b55-delete_volume" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:15:43 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-3839efe7-3abe-46ff-bce7-adc8652488bd tempest-VolumesGetTest-1325070593 None] Lock "cinder-eb6e8bb5-c0d7-427e-aa31-981465227b55-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:15:43 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-3839efe7-3abe-46ff-bce7-adc8652488bd tempest-VolumesGetTest-1325070593 None] Acquiring lock "cinder-quobyte-eb6e8bb5-c0d7-427e-aa31-981465227b55" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:15:43 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-3839efe7-3abe-46ff-bce7-adc8652488bd tempest-VolumesGetTest-1325070593 None] Lock "cinder-quobyte-eb6e8bb5-c0d7-427e-aa31-981465227b55" acquired by "delete_volume" :: waited 0.012s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:15:43 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4138c0a-9dd9-431e-8807-8130b9c205a3]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:15:43 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-3839efe7-3abe-46ff-bce7-adc8652488bd tempest-VolumesGetTest-1325070593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-eb6e8bb5-c0d7-427e-aa31-981465227b55 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:15:43 devstack sudo[88124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-eb6e8bb5-c0d7-427e-aa31-981465227b55
Apr 10 13:15:43 devstack sudo[88124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:15:43 devstack sudo[88121]: pam_unix(sudo:session): session closed for user root
Apr 10 13:15:43 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-7aba46ae-d638-4602-a8d2-bb7a6908b34a tempest-VolumesExtendTest-27412717 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-10eb703a-4bb2-49bb-aeb5-1cf55ee0228a" returned: 1 in 0.558s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:15:43 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-7aba46ae-d638-4602-a8d2-bb7a6908b34a tempest-VolumesExtendTest-27412717 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-10eb703a-4bb2-49bb-aeb5-1cf55ee0228a' failed. Not Retrying. {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 10 13:15:43 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-7aba46ae-d638-4602-a8d2-bb7a6908b34a tempest-VolumesExtendTest-27412717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-10eb703a-4bb2-49bb-aeb5-1cf55ee0228a {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:15:43 devstack sudo[88129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-10eb703a-4bb2-49bb-aeb5-1cf55ee0228a
Apr 10 13:15:43 devstack sudo[88129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:15:44 devstack sudo[88124]: pam_unix(sudo:session): session closed for user root
Apr 10 13:15:44 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-3839efe7-3abe-46ff-bce7-adc8652488bd tempest-VolumesGetTest-1325070593 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-eb6e8bb5-c0d7-427e-aa31-981465227b55" returned: 0 in 0.507s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:15:44 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-3839efe7-3abe-46ff-bce7-adc8652488bd tempest-VolumesGetTest-1325070593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-eb6e8bb5-c0d7-427e-aa31-981465227b55 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:15:44 devstack sudo[88134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-eb6e8bb5-c0d7-427e-aa31-981465227b55
Apr 10 13:15:44 devstack sudo[88134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:15:44 devstack sudo[88129]: pam_unix(sudo:session): session closed for user root
Apr 10 13:15:44 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-7aba46ae-d638-4602-a8d2-bb7a6908b34a tempest-VolumesExtendTest-27412717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-10eb703a-4bb2-49bb-aeb5-1cf55ee0228a" returned: 0 in 0.647s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:15:44 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-7aba46ae-d638-4602-a8d2-bb7a6908b34a tempest-VolumesExtendTest-27412717 None] Lock "cinder-quobyte-10eb703a-4bb2-49bb-aeb5-1cf55ee0228a" released by "delete_volume" :: held 1.851s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:15:44 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-7aba46ae-d638-4602-a8d2-bb7a6908b34a tempest-VolumesExtendTest-27412717 None] Created reservations ['2b1a625c-08eb-4829-b444-a00fc9685a84', '19459251-9fe4-47ab-acb8-f213804b7747', '2033e924-dbaa-44eb-ab0d-0a02bb260735', 'e11ebb87-110c-4337-bd10-8ffd92e11ae4'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:15:44 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-7aba46ae-d638-4602-a8d2-bb7a6908b34a tempest-VolumesExtendTest-27412717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:15:44 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-7aba46ae-d638-4602-a8d2-bb7a6908b34a tempest-VolumesExtendTest-27412717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:15:44 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-7aba46ae-d638-4602-a8d2-bb7a6908b34a tempest-VolumesExtendTest-27412717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:15:44 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-7aba46ae-d638-4602-a8d2-bb7a6908b34a tempest-VolumesExtendTest-27412717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:15:44 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-7aba46ae-d638-4602-a8d2-bb7a6908b34a tempest-VolumesExtendTest-27412717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:15:44 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-7aba46ae-d638-4602-a8d2-bb7a6908b34a tempest-VolumesExtendTest-27412717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:15:44 devstack sudo[88137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:15:44 devstack sudo[88137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:15:44 devstack sudo[88134]: pam_unix(sudo:session): session closed for user root
Apr 10 13:15:44 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-3839efe7-3abe-46ff-bce7-adc8652488bd tempest-VolumesGetTest-1325070593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-eb6e8bb5-c0d7-427e-aa31-981465227b55" returned: 0 in 0.575s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:15:44 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-3839efe7-3abe-46ff-bce7-adc8652488bd tempest-VolumesGetTest-1325070593 None] Lock "cinder-quobyte-eb6e8bb5-c0d7-427e-aa31-981465227b55" released by "delete_volume" :: held 1.105s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:15:44 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-3839efe7-3abe-46ff-bce7-adc8652488bd tempest-VolumesGetTest-1325070593 None] Created reservations ['812cf836-1ef3-4450-bf3c-483390028f1c', 'dec492a2-07aa-4f20-99e5-84368665f3e1', 'b2200ebd-857e-4e48-9167-8880fc9bebfb', '092ca657-3dda-4332-9dfb-588d53adff78'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:15:44 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-3839efe7-3abe-46ff-bce7-adc8652488bd tempest-VolumesGetTest-1325070593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:15:44 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-3839efe7-3abe-46ff-bce7-adc8652488bd tempest-VolumesGetTest-1325070593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:15:44 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-3839efe7-3abe-46ff-bce7-adc8652488bd tempest-VolumesGetTest-1325070593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:15:44 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-3839efe7-3abe-46ff-bce7-adc8652488bd tempest-VolumesGetTest-1325070593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:15:44 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-3839efe7-3abe-46ff-bce7-adc8652488bd tempest-VolumesGetTest-1325070593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:15:44 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-3839efe7-3abe-46ff-bce7-adc8652488bd tempest-VolumesGetTest-1325070593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:15:44 devstack sudo[88140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:15:44 devstack sudo[88140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:15:45 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-41254bf6-9829-4c95-912e-1eb147f5064c tempest-VolumesExtendTest-27412717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:15:45 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-41254bf6-9829-4c95-912e-1eb147f5064c tempest-VolumesExtendTest-27412717 None] Flow 'volume_create_manager' (e88cc24d-c122-4462-9afe-e43d0f77b99d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:15:45 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-41254bf6-9829-4c95-912e-1eb147f5064c tempest-VolumesExtendTest-27412717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2f668ea-9b10-4f28-80e5-78123b07dcc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:15:45 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-41254bf6-9829-4c95-912e-1eb147f5064c tempest-VolumesExtendTest-27412717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2f668ea-9b10-4f28-80e5-78123b07dcc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:15:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1187116649',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94794e9e-8a79-46ba-9fb4-20681ce1fc3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b1f9e5fee4247619ddbed34edbd16eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:15:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:15:45Z,use_quota=True,user_id='6d7be3aa913e4d759b4510d8ca9b9afc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:15:45 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-41254bf6-9829-4c95-912e-1eb147f5064c tempest-VolumesExtendTest-27412717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e013c5da-3bf9-4a0a-bb75-365ba7c37d93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:15:45 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-41254bf6-9829-4c95-912e-1eb147f5064c tempest-VolumesExtendTest-27412717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e013c5da-3bf9-4a0a-bb75-365ba7c37d93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:15:45 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-41254bf6-9829-4c95-912e-1eb147f5064c tempest-VolumesExtendTest-27412717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daaead42-6ad4-46da-8e00-1e97bf6ff958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:15:45 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-41254bf6-9829-4c95-912e-1eb147f5064c tempest-VolumesExtendTest-27412717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daaead42-6ad4-46da-8e00-1e97bf6ff958) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94794e9e-8a79-46ba-9fb4-20681ce1fc3d', 'volume_name': 'volume-94794e9e-8a79-46ba-9fb4-20681ce1fc3d', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:15:45 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-41254bf6-9829-4c95-912e-1eb147f5064c tempest-VolumesExtendTest-27412717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d833143d-f9a6-4447-ab7d-224cdf9a0ecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:15:45 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-41254bf6-9829-4c95-912e-1eb147f5064c tempest-VolumesExtendTest-27412717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d833143d-f9a6-4447-ab7d-224cdf9a0ecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:15:45 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-41254bf6-9829-4c95-912e-1eb147f5064c tempest-VolumesExtendTest-27412717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffff2948-8f28-430e-9dc6-5a44405f293a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:15:45 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-41254bf6-9829-4c95-912e-1eb147f5064c tempest-VolumesExtendTest-27412717 None] Volume 94794e9e-8a79-46ba-9fb4-20681ce1fc3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94794e9e-8a79-46ba-9fb4-20681ce1fc3d', 'volume_size': 1}
Apr 10 13:15:45 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-41254bf6-9829-4c95-912e-1eb147f5064c tempest-VolumesExtendTest-27412717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:15:45 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-41254bf6-9829-4c95-912e-1eb147f5064c tempest-VolumesExtendTest-27412717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:15:45 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-41254bf6-9829-4c95-912e-1eb147f5064c tempest-VolumesExtendTest-27412717 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f252bf08b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:15:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1187116649',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94794e9e-8a79-46ba-9fb4-20681ce1fc3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b1f9e5fee4247619ddbed34edbd16eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:15:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:15:45Z,use_quota=True,user_id='6d7be3aa913e4d759b4510d8ca9b9afc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)}" {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 13:15:45 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-41254bf6-9829-4c95-912e-1eb147f5064c tempest-VolumesExtendTest-27412717 None] Creating volume 94794e9e-8a79-46ba-9fb4-20681ce1fc3d {{(pid=83345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 13:15:45 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-41254bf6-9829-4c95-912e-1eb147f5064c tempest-VolumesExtendTest-27412717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:15:45 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-41254bf6-9829-4c95-912e-1eb147f5064c tempest-VolumesExtendTest-27412717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:15:45 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-41254bf6-9829-4c95-912e-1eb147f5064c tempest-VolumesExtendTest-27412717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:15:45 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-41254bf6-9829-4c95-912e-1eb147f5064c tempest-VolumesExtendTest-27412717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:15:45 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-41254bf6-9829-4c95-912e-1eb147f5064c tempest-VolumesExtendTest-27412717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:15:45 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-41254bf6-9829-4c95-912e-1eb147f5064c tempest-VolumesExtendTest-27412717 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:15:45 devstack cinder-volume[83345]: INFO cinder.volume.drivers.remotefs [None req-41254bf6-9829-4c95-912e-1eb147f5064c tempest-VolumesExtendTest-27412717 None] casted to osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331
Apr 10 13:15:45 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-41254bf6-9829-4c95-912e-1eb147f5064c tempest-VolumesExtendTest-27412717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-94794e9e-8a79-46ba-9fb4-20681ce1fc3d 1073741824 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:15:45 devstack sudo[88144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-94794e9e-8a79-46ba-9fb4-20681ce1fc3d 1073741824
Apr 10 13:15:45 devstack sudo[88144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:15:45 devstack sudo[88137]: pam_unix(sudo:session): session closed for user root
Apr 10 13:15:45 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-7aba46ae-d638-4602-a8d2-bb7a6908b34a tempest-VolumesExtendTest-27412717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.745s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:15:45 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-7aba46ae-d638-4602-a8d2-bb7a6908b34a tempest-VolumesExtendTest-27412717 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:15:45 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-7aba46ae-d638-4602-a8d2-bb7a6908b34a tempest-VolumesExtendTest-27412717 None] Deleted volume successfully.
Apr 10 13:15:45 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-7aba46ae-d638-4602-a8d2-bb7a6908b34a tempest-VolumesExtendTest-27412717 None] Lock "cinder-10eb703a-4bb2-49bb-aeb5-1cf55ee0228a-delete_volume" released by "delete_volume" :: held 2.762s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:15:45 devstack sudo[88140]: pam_unix(sudo:session): session closed for user root
Apr 10 13:15:45 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-3839efe7-3abe-46ff-bce7-adc8652488bd tempest-VolumesGetTest-1325070593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.610s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:15:45 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-3839efe7-3abe-46ff-bce7-adc8652488bd tempest-VolumesGetTest-1325070593 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:15:45 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-3839efe7-3abe-46ff-bce7-adc8652488bd tempest-VolumesGetTest-1325070593 None] Deleted volume successfully.
Apr 10 13:15:45 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-3839efe7-3abe-46ff-bce7-adc8652488bd tempest-VolumesGetTest-1325070593 None] Lock "cinder-eb6e8bb5-c0d7-427e-aa31-981465227b55-delete_volume" released by "delete_volume" :: held 1.944s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:15:45 devstack sudo[88144]: pam_unix(sudo:session): session closed for user root
Apr 10 13:15:45 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-41254bf6-9829-4c95-912e-1eb147f5064c tempest-VolumesExtendTest-27412717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-94794e9e-8a79-46ba-9fb4-20681ce1fc3d 1073741824" returned: 0 in 0.762s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:15:45 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-41254bf6-9829-4c95-912e-1eb147f5064c tempest-VolumesExtendTest-27412717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-94794e9e-8a79-46ba-9fb4-20681ce1fc3d {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:15:46 devstack sudo[88150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-94794e9e-8a79-46ba-9fb4-20681ce1fc3d
Apr 10 13:15:46 devstack sudo[88150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:15:46 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef9fa30a-61e1-412a-95c7-8c95f896e1fb tempest-VolumesGetTest-1325070593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:15:46 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ef9fa30a-61e1-412a-95c7-8c95f896e1fb tempest-VolumesGetTest-1325070593 None] Flow 'volume_create_manager' (e77e19a8-ce0b-4877-b0ec-c9c2be5b6071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:15:46 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ef9fa30a-61e1-412a-95c7-8c95f896e1fb tempest-VolumesGetTest-1325070593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56e35769-e6f7-4f10-8bbf-63707aac7801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:15:46 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ef9fa30a-61e1-412a-95c7-8c95f896e1fb tempest-VolumesGetTest-1325070593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56e35769-e6f7-4f10-8bbf-63707aac7801) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:15:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1298165166',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3c57b6e-ddf6-4382-9d46-8a8c9722c588,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2164901a19c74ad5a7ac47fa92772df3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:15:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:15:46Z,use_quota=True,user_id='e6a465b820764bf78e3ec91bbb896b7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:15:46 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ef9fa30a-61e1-412a-95c7-8c95f896e1fb tempest-VolumesGetTest-1325070593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6c38c27-3aac-48dc-8277-b8118d4caaea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:15:46 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ef9fa30a-61e1-412a-95c7-8c95f896e1fb tempest-VolumesGetTest-1325070593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6c38c27-3aac-48dc-8277-b8118d4caaea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:15:46 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ef9fa30a-61e1-412a-95c7-8c95f896e1fb tempest-VolumesGetTest-1325070593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1390e3a-60c5-440d-a47d-4949b6f25639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:15:46 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ef9fa30a-61e1-412a-95c7-8c95f896e1fb tempest-VolumesGetTest-1325070593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1390e3a-60c5-440d-a47d-4949b6f25639) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3c57b6e-ddf6-4382-9d46-8a8c9722c588', 'volume_name': 'volume-e3c57b6e-ddf6-4382-9d46-8a8c9722c588', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:15:46 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ef9fa30a-61e1-412a-95c7-8c95f896e1fb tempest-VolumesGetTest-1325070593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70ee1bd0-9d8e-4326-8aee-d47d4fd8dc27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:15:46 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ef9fa30a-61e1-412a-95c7-8c95f896e1fb tempest-VolumesGetTest-1325070593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70ee1bd0-9d8e-4326-8aee-d47d4fd8dc27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:15:46 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ef9fa30a-61e1-412a-95c7-8c95f896e1fb tempest-VolumesGetTest-1325070593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27dd53c6-fc47-45b9-b1f2-0bc92a3471d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:15:46 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-ef9fa30a-61e1-412a-95c7-8c95f896e1fb tempest-VolumesGetTest-1325070593 None] Volume e3c57b6e-ddf6-4382-9d46-8a8c9722c588: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3c57b6e-ddf6-4382-9d46-8a8c9722c588', 'volume_size': 1}
Apr 10 13:15:46 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-ef9fa30a-61e1-412a-95c7-8c95f896e1fb tempest-VolumesGetTest-1325070593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:15:46 devstack sudo[88150]: pam_unix(sudo:session): session closed for user root
Apr 10 13:15:46 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-41254bf6-9829-4c95-912e-1eb147f5064c tempest-VolumesExtendTest-27412717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-94794e9e-8a79-46ba-9fb4-20681ce1fc3d" returned: 0 in 0.515s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:15:46 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-41254bf6-9829-4c95-912e-1eb147f5064c tempest-VolumesExtendTest-27412717 None] <== create_volume: return (1327ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'} {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 13:15:46 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-41254bf6-9829-4c95-912e-1eb147f5064c tempest-VolumesExtendTest-27412717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.329s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:15:46 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-ef9fa30a-61e1-412a-95c7-8c95f896e1fb tempest-VolumesGetTest-1325070593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.327s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:15:46 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-ef9fa30a-61e1-412a-95c7-8c95f896e1fb tempest-VolumesGetTest-1325070593 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f252bf08b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:15:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1298165166',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3c57b6e-ddf6-4382-9d46-8a8c9722c588,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2164901a19c74ad5a7ac47fa92772df3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:15:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:15:46Z,use_quota=True,user_id='e6a465b820764bf78e3ec91bbb896b7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)}" {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 13:15:46 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-ef9fa30a-61e1-412a-95c7-8c95f896e1fb tempest-VolumesGetTest-1325070593 None] Creating volume e3c57b6e-ddf6-4382-9d46-8a8c9722c588 {{(pid=83345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 13:15:46 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-ef9fa30a-61e1-412a-95c7-8c95f896e1fb tempest-VolumesGetTest-1325070593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:15:46 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-ef9fa30a-61e1-412a-95c7-8c95f896e1fb tempest-VolumesGetTest-1325070593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:15:46 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-ef9fa30a-61e1-412a-95c7-8c95f896e1fb tempest-VolumesGetTest-1325070593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:15:46 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-ef9fa30a-61e1-412a-95c7-8c95f896e1fb tempest-VolumesGetTest-1325070593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:15:46 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-ef9fa30a-61e1-412a-95c7-8c95f896e1fb tempest-VolumesGetTest-1325070593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:15:46 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-ef9fa30a-61e1-412a-95c7-8c95f896e1fb tempest-VolumesGetTest-1325070593 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:15:46 devstack cinder-volume[83345]: INFO cinder.volume.drivers.remotefs [None req-ef9fa30a-61e1-412a-95c7-8c95f896e1fb tempest-VolumesGetTest-1325070593 None] casted to osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331
Apr 10 13:15:46 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ef9fa30a-61e1-412a-95c7-8c95f896e1fb tempest-VolumesGetTest-1325070593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e3c57b6e-ddf6-4382-9d46-8a8c9722c588 1073741824 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:15:46 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-41254bf6-9829-4c95-912e-1eb147f5064c tempest-VolumesExtendTest-27412717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffff2948-8f28-430e-9dc6-5a44405f293a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94794e9e-8a79-46ba-9fb4-20681ce1fc3d', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:15:46 devstack sudo[88153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e3c57b6e-ddf6-4382-9d46-8a8c9722c588 1073741824
Apr 10 13:15:46 devstack sudo[88153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:15:46 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-41254bf6-9829-4c95-912e-1eb147f5064c tempest-VolumesExtendTest-27412717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59d619fd-8916-4441-99da-11a66a3b2db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:15:46 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-41254bf6-9829-4c95-912e-1eb147f5064c tempest-VolumesExtendTest-27412717 None] Volume volume-94794e9e-8a79-46ba-9fb4-20681ce1fc3d (94794e9e-8a79-46ba-9fb4-20681ce1fc3d): created successfully
Apr 10 13:15:46 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-41254bf6-9829-4c95-912e-1eb147f5064c tempest-VolumesExtendTest-27412717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59d619fd-8916-4441-99da-11a66a3b2db0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:15:46 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-41254bf6-9829-4c95-912e-1eb147f5064c tempest-VolumesExtendTest-27412717 None] Flow 'volume_create_manager' (e88cc24d-c122-4462-9afe-e43d0f77b99d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:15:46 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-41254bf6-9829-4c95-912e-1eb147f5064c tempest-VolumesExtendTest-27412717 None] Created volume successfully.
Apr 10 13:15:47 devstack sudo[88153]: pam_unix(sudo:session): session closed for user root
Apr 10 13:15:47 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ef9fa30a-61e1-412a-95c7-8c95f896e1fb tempest-VolumesGetTest-1325070593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e3c57b6e-ddf6-4382-9d46-8a8c9722c588 1073741824" returned: 0 in 0.613s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:15:47 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ef9fa30a-61e1-412a-95c7-8c95f896e1fb tempest-VolumesGetTest-1325070593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e3c57b6e-ddf6-4382-9d46-8a8c9722c588 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:15:47 devstack sudo[88161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e3c57b6e-ddf6-4382-9d46-8a8c9722c588
Apr 10 13:15:47 devstack sudo[88161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:15:47 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-a41f0770-f5f2-45e0-948c-55b7b95472f1 tempest-VolumesExtendTest-27412717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:15:47 devstack sudo[88161]: pam_unix(sudo:session): session closed for user root
Apr 10 13:15:47 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ef9fa30a-61e1-412a-95c7-8c95f896e1fb tempest-VolumesGetTest-1325070593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e3c57b6e-ddf6-4382-9d46-8a8c9722c588" returned: 0 in 0.537s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:15:47 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-ef9fa30a-61e1-412a-95c7-8c95f896e1fb tempest-VolumesGetTest-1325070593 None] <== create_volume: return (1196ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'} {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 13:15:47 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-ef9fa30a-61e1-412a-95c7-8c95f896e1fb tempest-VolumesGetTest-1325070593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.200s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:15:47 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-a41f0770-f5f2-45e0-948c-55b7b95472f1 tempest-VolumesExtendTest-27412717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.354s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:15:47 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-a41f0770-f5f2-45e0-948c-55b7b95472f1 tempest-VolumesExtendTest-27412717 None] Creating offline snapshot 038018d5-a984-4954-9747-6055d05befa7 of volume 94794e9e-8a79-46ba-9fb4-20681ce1fc3d {{(pid=83345) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 10 13:15:47 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ef9fa30a-61e1-412a-95c7-8c95f896e1fb tempest-VolumesGetTest-1325070593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27dd53c6-fc47-45b9-b1f2-0bc92a3471d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3c57b6e-ddf6-4382-9d46-8a8c9722c588', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:15:47 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ef9fa30a-61e1-412a-95c7-8c95f896e1fb tempest-VolumesGetTest-1325070593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a731b10-7d9c-426f-aa3f-3d7ba1560ffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:15:47 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[b32c0a3b-a940-4ec2-8954-8cda1ce7d128]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:15:47 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-a41f0770-f5f2-45e0-948c-55b7b95472f1 tempest-VolumesExtendTest-27412717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-94794e9e-8a79-46ba-9fb4-20681ce1fc3d {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:15:47 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-ef9fa30a-61e1-412a-95c7-8c95f896e1fb tempest-VolumesGetTest-1325070593 None] Volume volume-e3c57b6e-ddf6-4382-9d46-8a8c9722c588 (e3c57b6e-ddf6-4382-9d46-8a8c9722c588): created successfully
Apr 10 13:15:47 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ef9fa30a-61e1-412a-95c7-8c95f896e1fb tempest-VolumesGetTest-1325070593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a731b10-7d9c-426f-aa3f-3d7ba1560ffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:15:47 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ef9fa30a-61e1-412a-95c7-8c95f896e1fb tempest-VolumesGetTest-1325070593 None] Flow 'volume_create_manager' (e77e19a8-ce0b-4877-b0ec-c9c2be5b6071) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:15:47 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-ef9fa30a-61e1-412a-95c7-8c95f896e1fb tempest-VolumesGetTest-1325070593 None] Created volume successfully.
Apr 10 13:15:47 devstack sudo[88164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-94794e9e-8a79-46ba-9fb4-20681ce1fc3d
Apr 10 13:15:47 devstack sudo[88164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:15:48 devstack sudo[88164]: pam_unix(sudo:session): session closed for user root
Apr 10 13:15:48 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-a41f0770-f5f2-45e0-948c-55b7b95472f1 tempest-VolumesExtendTest-27412717 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-94794e9e-8a79-46ba-9fb4-20681ce1fc3d" returned: 0 in 0.536s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:15:48 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-a41f0770-f5f2-45e0-948c-55b7b95472f1 tempest-VolumesExtendTest-27412717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-94794e9e-8a79-46ba-9fb4-20681ce1fc3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-94794e9e-8a79-46ba-9fb4-20681ce1fc3d.038018d5-a984-4954-9747-6055d05befa7 1G {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:15:48 devstack sudo[88169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-94794e9e-8a79-46ba-9fb4-20681ce1fc3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-94794e9e-8a79-46ba-9fb4-20681ce1fc3d.038018d5-a984-4954-9747-6055d05befa7 1G
Apr 10 13:15:48 devstack sudo[88169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:15:48 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-d901c29d-c329-4075-8594-7ab6898a9ee1 tempest-VolumesCloneTest-1104349490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:15:48 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-d901c29d-c329-4075-8594-7ab6898a9ee1 tempest-VolumesCloneTest-1104349490 None] Flow 'volume_create_manager' (77d4de6a-5163-4e55-8fc8-930bdb610384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:15:48 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-d901c29d-c329-4075-8594-7ab6898a9ee1 tempest-VolumesCloneTest-1104349490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43e040cf-dd17-429b-a7b6-af4453fb96ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:15:48 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-d901c29d-c329-4075-8594-7ab6898a9ee1 tempest-VolumesCloneTest-1104349490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43e040cf-dd17-429b-a7b6-af4453fb96ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:15:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1920678671',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bca8a6fd-bb57-4f99-9236-8905ba89a16a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='469155f955b74b5788576f6ac8e8fa7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:15:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:15:48Z,use_quota=True,user_id='6d33274b50c044e39b1d72fd757b6583',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:15:48 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-d901c29d-c329-4075-8594-7ab6898a9ee1 tempest-VolumesCloneTest-1104349490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f35a228-a5cc-4d83-a64b-15b92091bc0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:15:48 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-d901c29d-c329-4075-8594-7ab6898a9ee1 tempest-VolumesCloneTest-1104349490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f35a228-a5cc-4d83-a64b-15b92091bc0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:15:48 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-d901c29d-c329-4075-8594-7ab6898a9ee1 tempest-VolumesCloneTest-1104349490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c3b05c9-cd2e-4c7c-806f-b73343319c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:15:48 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-d901c29d-c329-4075-8594-7ab6898a9ee1 tempest-VolumesCloneTest-1104349490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c3b05c9-cd2e-4c7c-806f-b73343319c79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bca8a6fd-bb57-4f99-9236-8905ba89a16a', 'volume_name': 'volume-bca8a6fd-bb57-4f99-9236-8905ba89a16a', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:15:48 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-d901c29d-c329-4075-8594-7ab6898a9ee1 tempest-VolumesCloneTest-1104349490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6dac4cf-4e63-4fff-8a49-0070f065fe7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:15:48 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-d901c29d-c329-4075-8594-7ab6898a9ee1 tempest-VolumesCloneTest-1104349490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6dac4cf-4e63-4fff-8a49-0070f065fe7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:15:48 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-d901c29d-c329-4075-8594-7ab6898a9ee1 tempest-VolumesCloneTest-1104349490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ae57b14-5820-470a-a93f-93668890b9ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:15:48 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-d901c29d-c329-4075-8594-7ab6898a9ee1 tempest-VolumesCloneTest-1104349490 None] Volume bca8a6fd-bb57-4f99-9236-8905ba89a16a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bca8a6fd-bb57-4f99-9236-8905ba89a16a', 'volume_size': 1}
Apr 10 13:15:48 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-d901c29d-c329-4075-8594-7ab6898a9ee1 tempest-VolumesCloneTest-1104349490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:15:48 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-df2e3194-f6cd-4fcc-9b5a-0d5c54e0827e tempest-VolumesGetTest-1325070593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:15:48 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-df2e3194-f6cd-4fcc-9b5a-0d5c54e0827e tempest-VolumesGetTest-1325070593 None] Flow 'volume_create_manager' (0fb781fe-469c-44bf-b603-eb00eaf4fee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:15:48 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-df2e3194-f6cd-4fcc-9b5a-0d5c54e0827e tempest-VolumesGetTest-1325070593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9239dd5c-5dbe-4290-85ad-a2e455545cea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:15:48 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-df2e3194-f6cd-4fcc-9b5a-0d5c54e0827e tempest-VolumesGetTest-1325070593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9239dd5c-5dbe-4290-85ad-a2e455545cea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:15:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1903710346',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1542b8a-a5fe-4e27-ba4a-74abacec48a4,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='2164901a19c74ad5a7ac47fa92772df3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:15:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=e3c57b6e-ddf6-4382-9d46-8a8c9722c588,status='creating',terminated_at=None,updated_at=2026-04-10T11:15:49Z,use_quota=True,user_id='e6a465b820764bf78e3ec91bbb896b7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:15:48 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-df2e3194-f6cd-4fcc-9b5a-0d5c54e0827e tempest-VolumesGetTest-1325070593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b368b84c-432c-40c2-b02a-40883e534153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:15:48 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-df2e3194-f6cd-4fcc-9b5a-0d5c54e0827e tempest-VolumesGetTest-1325070593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b368b84c-432c-40c2-b02a-40883e534153) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:15:48 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-df2e3194-f6cd-4fcc-9b5a-0d5c54e0827e tempest-VolumesGetTest-1325070593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad9b7c55-05c9-4f41-9a15-a0a1f1654e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:15:48 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-df2e3194-f6cd-4fcc-9b5a-0d5c54e0827e tempest-VolumesGetTest-1325070593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad9b7c55-05c9-4f41-9a15-a0a1f1654e7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'e1542b8a-a5fe-4e27-ba4a-74abacec48a4', 'volume_name': 'volume-e1542b8a-a5fe-4e27-ba4a-74abacec48a4', 'volume_size': 1, 'source_volid': 'e3c57b6e-ddf6-4382-9d46-8a8c9722c588', 'source_volstatus': 'available'}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:15:48 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-df2e3194-f6cd-4fcc-9b5a-0d5c54e0827e tempest-VolumesGetTest-1325070593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e3dc259-01d8-4a8e-8694-2f7b56408fe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:15:48 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-df2e3194-f6cd-4fcc-9b5a-0d5c54e0827e tempest-VolumesGetTest-1325070593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e3dc259-01d8-4a8e-8694-2f7b56408fe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:15:48 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-df2e3194-f6cd-4fcc-9b5a-0d5c54e0827e tempest-VolumesGetTest-1325070593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42d4077b-d338-4146-87a0-6c975a87b381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:15:48 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-df2e3194-f6cd-4fcc-9b5a-0d5c54e0827e tempest-VolumesGetTest-1325070593 None] Volume e1542b8a-a5fe-4e27-ba4a-74abacec48a4: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-e1542b8a-a5fe-4e27-ba4a-74abacec48a4', 'volume_size': 1, 'source_volid': 'e3c57b6e-ddf6-4382-9d46-8a8c9722c588', 'source_volstatus': 'available'}
Apr 10 13:15:48 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-df2e3194-f6cd-4fcc-9b5a-0d5c54e0827e tempest-VolumesGetTest-1325070593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:15:48 devstack sudo[88169]: pam_unix(sudo:session): session closed for user root
Apr 10 13:15:48 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-a41f0770-f5f2-45e0-948c-55b7b95472f1 tempest-VolumesExtendTest-27412717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-94794e9e-8a79-46ba-9fb4-20681ce1fc3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-94794e9e-8a79-46ba-9fb4-20681ce1fc3d.038018d5-a984-4954-9747-6055d05befa7 1G" returned: 0 in 0.579s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:15:48 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-a41f0770-f5f2-45e0-948c-55b7b95472f1 tempest-VolumesExtendTest-27412717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94794e9e-8a79-46ba-9fb4-20681ce1fc3d -F qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-94794e9e-8a79-46ba-9fb4-20681ce1fc3d.038018d5-a984-4954-9747-6055d05befa7 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:15:48 devstack sudo[88174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94794e9e-8a79-46ba-9fb4-20681ce1fc3d -F qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-94794e9e-8a79-46ba-9fb4-20681ce1fc3d.038018d5-a984-4954-9747-6055d05befa7
Apr 10 13:15:48 devstack sudo[88174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:15:49 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5d7d42d-7d1f-4eaf-8d9e-489abe8aad12 tempest-SnapshotsActionsTest-802738678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:15:49 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-f5d7d42d-7d1f-4eaf-8d9e-489abe8aad12 tempest-SnapshotsActionsTest-802738678 None] Flow 'volume_create_manager' (3a201aea-a84f-4278-8ff7-1d1c2e630772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:15:49 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-f5d7d42d-7d1f-4eaf-8d9e-489abe8aad12 tempest-SnapshotsActionsTest-802738678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ada2c08e-85b8-4328-800d-7a7b6fa48ae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:15:49 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-f5d7d42d-7d1f-4eaf-8d9e-489abe8aad12 tempest-SnapshotsActionsTest-802738678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ada2c08e-85b8-4328-800d-7a7b6fa48ae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:15:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-486824048',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f013013-ffcb-4dd4-8e73-3e004e4c6f11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3111be95c7dd4de09d4c81f5d62d6a34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:15:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:15:49Z,use_quota=True,user_id='07411b8f4620475ca3bdaab75d4d16b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:15:49 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-f5d7d42d-7d1f-4eaf-8d9e-489abe8aad12 tempest-SnapshotsActionsTest-802738678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdedf37b-00ae-4d8b-9b0b-6c2ad24841ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:15:49 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-f5d7d42d-7d1f-4eaf-8d9e-489abe8aad12 tempest-SnapshotsActionsTest-802738678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdedf37b-00ae-4d8b-9b0b-6c2ad24841ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:15:49 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-f5d7d42d-7d1f-4eaf-8d9e-489abe8aad12 tempest-SnapshotsActionsTest-802738678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24cfcda9-a078-4732-ba1a-a5a976680954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:15:49 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-f5d7d42d-7d1f-4eaf-8d9e-489abe8aad12 tempest-SnapshotsActionsTest-802738678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24cfcda9-a078-4732-ba1a-a5a976680954) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f013013-ffcb-4dd4-8e73-3e004e4c6f11', 'volume_name': 'volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:15:49 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-f5d7d42d-7d1f-4eaf-8d9e-489abe8aad12 tempest-SnapshotsActionsTest-802738678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2ec8079-af97-4ef4-95e4-dd6acd12c1ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:15:49 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-f5d7d42d-7d1f-4eaf-8d9e-489abe8aad12 tempest-SnapshotsActionsTest-802738678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2ec8079-af97-4ef4-95e4-dd6acd12c1ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:15:49 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-f5d7d42d-7d1f-4eaf-8d9e-489abe8aad12 tempest-SnapshotsActionsTest-802738678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5061ee15-180c-4d6c-a946-ac1ff7aac677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:15:49 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-f5d7d42d-7d1f-4eaf-8d9e-489abe8aad12 tempest-SnapshotsActionsTest-802738678 None] Volume 4f013013-ffcb-4dd4-8e73-3e004e4c6f11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11', 'volume_size': 1}
Apr 10 13:15:49 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-f5d7d42d-7d1f-4eaf-8d9e-489abe8aad12 tempest-SnapshotsActionsTest-802738678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:15:49 devstack sudo[88174]: pam_unix(sudo:session): session closed for user root
Apr 10 13:15:49 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-a41f0770-f5f2-45e0-948c-55b7b95472f1 tempest-VolumesExtendTest-27412717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94794e9e-8a79-46ba-9fb4-20681ce1fc3d -F qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-94794e9e-8a79-46ba-9fb4-20681ce1fc3d.038018d5-a984-4954-9747-6055d05befa7" returned: 0 in 0.451s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:15:49 devstack cinder-volume[83345]: WARNING cinder.volume.drivers.remotefs [None req-a41f0770-f5f2-45e0-948c-55b7b95472f1 tempest-VolumesExtendTest-27412717 None] /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-94794e9e-8a79-46ba-9fb4-20681ce1fc3d.038018d5-a984-4954-9747-6055d05befa7 is being set with open permissions: ugo+rw
Apr 10 13:15:49 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-a41f0770-f5f2-45e0-948c-55b7b95472f1 tempest-VolumesExtendTest-27412717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-94794e9e-8a79-46ba-9fb4-20681ce1fc3d.038018d5-a984-4954-9747-6055d05befa7 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:15:49 devstack sudo[88179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-94794e9e-8a79-46ba-9fb4-20681ce1fc3d.038018d5-a984-4954-9747-6055d05befa7
Apr 10 13:15:49 devstack sudo[88179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:15:49 devstack sudo[88179]: pam_unix(sudo:session): session closed for user root
Apr 10 13:15:49 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-a41f0770-f5f2-45e0-948c-55b7b95472f1 tempest-VolumesExtendTest-27412717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-94794e9e-8a79-46ba-9fb4-20681ce1fc3d.038018d5-a984-4954-9747-6055d05befa7" returned: 0 in 0.403s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:15:49 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-a41f0770-f5f2-45e0-948c-55b7b95472f1 tempest-VolumesExtendTest-27412717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-94794e9e-8a79-46ba-9fb4-20681ce1fc3d.info {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:15:49 devstack sudo[88182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-94794e9e-8a79-46ba-9fb4-20681ce1fc3d.info
Apr 10 13:15:49 devstack sudo[88182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:15:50 devstack sudo[88182]: pam_unix(sudo:session): session closed for user root
Apr 10 13:15:50 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-a41f0770-f5f2-45e0-948c-55b7b95472f1 tempest-VolumesExtendTest-27412717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-94794e9e-8a79-46ba-9fb4-20681ce1fc3d.info" returned: 0 in 0.405s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:15:50 devstack cinder-volume[83345]: WARNING cinder.volume.drivers.remotefs [None req-a41f0770-f5f2-45e0-948c-55b7b95472f1 tempest-VolumesExtendTest-27412717 None] /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-94794e9e-8a79-46ba-9fb4-20681ce1fc3d.info is being set with open permissions: ugo+rw
Apr 10 13:15:50 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-a41f0770-f5f2-45e0-948c-55b7b95472f1 tempest-VolumesExtendTest-27412717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-94794e9e-8a79-46ba-9fb4-20681ce1fc3d.info {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:15:50 devstack sudo[88185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-94794e9e-8a79-46ba-9fb4-20681ce1fc3d.info
Apr 10 13:15:50 devstack sudo[88185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:15:50 devstack sudo[88185]: pam_unix(sudo:session): session closed for user root
Apr 10 13:15:50 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-a41f0770-f5f2-45e0-948c-55b7b95472f1 tempest-VolumesExtendTest-27412717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-94794e9e-8a79-46ba-9fb4-20681ce1fc3d.info" returned: 0 in 0.399s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:15:50 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-a41f0770-f5f2-45e0-948c-55b7b95472f1 tempest-VolumesExtendTest-27412717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.851s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:15:50 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-d901c29d-c329-4075-8594-7ab6898a9ee1 tempest-VolumesCloneTest-1104349490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.157s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:15:50 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-d901c29d-c329-4075-8594-7ab6898a9ee1 tempest-VolumesCloneTest-1104349490 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f252bf08b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:15:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1920678671',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bca8a6fd-bb57-4f99-9236-8905ba89a16a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='469155f955b74b5788576f6ac8e8fa7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:15:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:15:48Z,use_quota=True,user_id='6d33274b50c044e39b1d72fd757b6583',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)}" {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 13:15:50 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-d901c29d-c329-4075-8594-7ab6898a9ee1 tempest-VolumesCloneTest-1104349490 None] Creating volume bca8a6fd-bb57-4f99-9236-8905ba89a16a {{(pid=83345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 13:15:50 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-d901c29d-c329-4075-8594-7ab6898a9ee1 tempest-VolumesCloneTest-1104349490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:15:50 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-d901c29d-c329-4075-8594-7ab6898a9ee1 tempest-VolumesCloneTest-1104349490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:15:50 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-d901c29d-c329-4075-8594-7ab6898a9ee1 tempest-VolumesCloneTest-1104349490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:15:50 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-d901c29d-c329-4075-8594-7ab6898a9ee1 tempest-VolumesCloneTest-1104349490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:15:50 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-d901c29d-c329-4075-8594-7ab6898a9ee1 tempest-VolumesCloneTest-1104349490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:15:50 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-d901c29d-c329-4075-8594-7ab6898a9ee1 tempest-VolumesCloneTest-1104349490 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:15:50 devstack cinder-volume[83345]: INFO cinder.volume.drivers.remotefs [None req-d901c29d-c329-4075-8594-7ab6898a9ee1 tempest-VolumesCloneTest-1104349490 None] casted to osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331
Apr 10 13:15:50 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-d901c29d-c329-4075-8594-7ab6898a9ee1 tempest-VolumesCloneTest-1104349490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-bca8a6fd-bb57-4f99-9236-8905ba89a16a 1073741824 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:15:50 devstack sudo[88188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-bca8a6fd-bb57-4f99-9236-8905ba89a16a 1073741824
Apr 10 13:15:50 devstack sudo[88188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:15:50 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-a41f0770-f5f2-45e0-948c-55b7b95472f1 tempest-VolumesExtendTest-27412717 None] Create snapshot completed successfully
Apr 10 13:15:51 devstack sudo[88188]: pam_unix(sudo:session): session closed for user root
Apr 10 13:15:51 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-d901c29d-c329-4075-8594-7ab6898a9ee1 tempest-VolumesCloneTest-1104349490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-bca8a6fd-bb57-4f99-9236-8905ba89a16a 1073741824" returned: 0 in 0.466s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:15:51 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-d901c29d-c329-4075-8594-7ab6898a9ee1 tempest-VolumesCloneTest-1104349490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-bca8a6fd-bb57-4f99-9236-8905ba89a16a {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:15:51 devstack sudo[88193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-bca8a6fd-bb57-4f99-9236-8905ba89a16a
Apr 10 13:15:51 devstack sudo[88193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:15:51 devstack sudo[88193]: pam_unix(sudo:session): session closed for user root
Apr 10 13:15:51 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-d901c29d-c329-4075-8594-7ab6898a9ee1 tempest-VolumesCloneTest-1104349490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-bca8a6fd-bb57-4f99-9236-8905ba89a16a" returned: 0 in 0.414s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:15:51 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-d901c29d-c329-4075-8594-7ab6898a9ee1 tempest-VolumesCloneTest-1104349490 None] <== create_volume: return (901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'} {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 13:15:51 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-d901c29d-c329-4075-8594-7ab6898a9ee1 tempest-VolumesCloneTest-1104349490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:15:51 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-df2e3194-f6cd-4fcc-9b5a-0d5c54e0827e tempest-VolumesGetTest-1325070593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 2.798s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:15:51 devstack cinder-volume[83345]: INFO cinder.volume.drivers.remotefs [None req-df2e3194-f6cd-4fcc-9b5a-0d5c54e0827e tempest-VolumesGetTest-1325070593 None] Cloning volume e3c57b6e-ddf6-4382-9d46-8a8c9722c588 to volume e1542b8a-a5fe-4e27-ba4a-74abacec48a4
Apr 10 13:15:51 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-d901c29d-c329-4075-8594-7ab6898a9ee1 tempest-VolumesCloneTest-1104349490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ae57b14-5820-470a-a93f-93668890b9ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bca8a6fd-bb57-4f99-9236-8905ba89a16a', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:15:51 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-d901c29d-c329-4075-8594-7ab6898a9ee1 tempest-VolumesCloneTest-1104349490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7cda071-cc67-4652-9ee1-320b24a1332e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:15:51 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-d901c29d-c329-4075-8594-7ab6898a9ee1 tempest-VolumesCloneTest-1104349490 None] Volume volume-bca8a6fd-bb57-4f99-9236-8905ba89a16a (bca8a6fd-bb57-4f99-9236-8905ba89a16a): created successfully
Apr 10 13:15:51 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-d901c29d-c329-4075-8594-7ab6898a9ee1 tempest-VolumesCloneTest-1104349490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7cda071-cc67-4652-9ee1-320b24a1332e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:15:51 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-d901c29d-c329-4075-8594-7ab6898a9ee1 tempest-VolumesCloneTest-1104349490 None] Flow 'volume_create_manager' (77d4de6a-5163-4e55-8fc8-930bdb610384) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:15:51 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-d901c29d-c329-4075-8594-7ab6898a9ee1 tempest-VolumesCloneTest-1104349490 None] Created volume successfully.
Apr 10 13:15:51 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-af90e113-3a20-415c-b0d6-5273dc44e9cf tempest-VolumesExtendTest-27412717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:15:51 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-df2e3194-f6cd-4fcc-9b5a-0d5c54e0827e tempest-VolumesGetTest-1325070593 None] Creating offline snapshot 99107aa1-e950-4bfb-a543-b62d9fd5329a of volume e3c57b6e-ddf6-4382-9d46-8a8c9722c588 {{(pid=83345) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 10 13:15:51 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[93715194-1854-4730-b75d-0dbe86cc3111]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:15:51 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-df2e3194-f6cd-4fcc-9b5a-0d5c54e0827e tempest-VolumesGetTest-1325070593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e3c57b6e-ddf6-4382-9d46-8a8c9722c588 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:15:51 devstack sudo[88197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e3c57b6e-ddf6-4382-9d46-8a8c9722c588
Apr 10 13:15:51 devstack sudo[88197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:15:52 devstack sudo[88197]: pam_unix(sudo:session): session closed for user root
Apr 10 13:15:52 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-df2e3194-f6cd-4fcc-9b5a-0d5c54e0827e tempest-VolumesGetTest-1325070593 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e3c57b6e-ddf6-4382-9d46-8a8c9722c588" returned: 0 in 0.458s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:15:52 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-df2e3194-f6cd-4fcc-9b5a-0d5c54e0827e tempest-VolumesGetTest-1325070593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e3c57b6e-ddf6-4382-9d46-8a8c9722c588,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e3c57b6e-ddf6-4382-9d46-8a8c9722c588.99107aa1-e950-4bfb-a543-b62d9fd5329a 1G {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:15:52 devstack sudo[88202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e3c57b6e-ddf6-4382-9d46-8a8c9722c588,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e3c57b6e-ddf6-4382-9d46-8a8c9722c588.99107aa1-e950-4bfb-a543-b62d9fd5329a 1G
Apr 10 13:15:52 devstack sudo[88202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:15:52 devstack sudo[88202]: pam_unix(sudo:session): session closed for user root
Apr 10 13:15:52 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-df2e3194-f6cd-4fcc-9b5a-0d5c54e0827e tempest-VolumesGetTest-1325070593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e3c57b6e-ddf6-4382-9d46-8a8c9722c588,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e3c57b6e-ddf6-4382-9d46-8a8c9722c588.99107aa1-e950-4bfb-a543-b62d9fd5329a 1G" returned: 0 in 0.488s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:15:52 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-df2e3194-f6cd-4fcc-9b5a-0d5c54e0827e tempest-VolumesGetTest-1325070593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3c57b6e-ddf6-4382-9d46-8a8c9722c588 -F qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e3c57b6e-ddf6-4382-9d46-8a8c9722c588.99107aa1-e950-4bfb-a543-b62d9fd5329a {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:15:52 devstack sudo[88207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3c57b6e-ddf6-4382-9d46-8a8c9722c588 -F qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e3c57b6e-ddf6-4382-9d46-8a8c9722c588.99107aa1-e950-4bfb-a543-b62d9fd5329a
Apr 10 13:15:52 devstack sudo[88207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:15:52 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac6f04e7-e0ee-458e-a6fc-e3e4094ec2a3 tempest-VolumesCloneTest-1104349490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:15:52 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ac6f04e7-e0ee-458e-a6fc-e3e4094ec2a3 tempest-VolumesCloneTest-1104349490 None] Flow 'volume_create_manager' (5a246e72-c429-4e81-b1c1-6efc991c6c5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:15:52 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ac6f04e7-e0ee-458e-a6fc-e3e4094ec2a3 tempest-VolumesCloneTest-1104349490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7501fc53-e6f4-435a-912d-1d53bbe9f7a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:15:52 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ac6f04e7-e0ee-458e-a6fc-e3e4094ec2a3 tempest-VolumesCloneTest-1104349490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7501fc53-e6f4-435a-912d-1d53bbe9f7a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:15:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1707702416',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14f83146-2b5b-4643-960c-d9812b29d4ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='469155f955b74b5788576f6ac8e8fa7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:15:53Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=bca8a6fd-bb57-4f99-9236-8905ba89a16a,status='creating',terminated_at=None,updated_at=2026-04-10T11:15:53Z,use_quota=True,user_id='6d33274b50c044e39b1d72fd757b6583',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:15:52 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ac6f04e7-e0ee-458e-a6fc-e3e4094ec2a3 tempest-VolumesCloneTest-1104349490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9abff3a-5ebc-4960-b1e3-9ab2cc025a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:15:52 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ac6f04e7-e0ee-458e-a6fc-e3e4094ec2a3 tempest-VolumesCloneTest-1104349490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9abff3a-5ebc-4960-b1e3-9ab2cc025a9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:15:52 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ac6f04e7-e0ee-458e-a6fc-e3e4094ec2a3 tempest-VolumesCloneTest-1104349490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f661d3f-bca0-4419-bd0a-986dc632bb02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:15:52 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ac6f04e7-e0ee-458e-a6fc-e3e4094ec2a3 tempest-VolumesCloneTest-1104349490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f661d3f-bca0-4419-bd0a-986dc632bb02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '14f83146-2b5b-4643-960c-d9812b29d4ac', 'volume_name': 'volume-14f83146-2b5b-4643-960c-d9812b29d4ac', 'volume_size': 2, 'source_volid': 'bca8a6fd-bb57-4f99-9236-8905ba89a16a', 'source_volstatus': 'available'}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:15:52 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ac6f04e7-e0ee-458e-a6fc-e3e4094ec2a3 tempest-VolumesCloneTest-1104349490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29823c87-ad16-4392-93c0-a0bcc38883bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:15:52 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ac6f04e7-e0ee-458e-a6fc-e3e4094ec2a3 tempest-VolumesCloneTest-1104349490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29823c87-ad16-4392-93c0-a0bcc38883bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:15:52 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ac6f04e7-e0ee-458e-a6fc-e3e4094ec2a3 tempest-VolumesCloneTest-1104349490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (887a8e33-5542-431f-ba8b-39255e3a41cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:15:52 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-ac6f04e7-e0ee-458e-a6fc-e3e4094ec2a3 tempest-VolumesCloneTest-1104349490 None] Volume 14f83146-2b5b-4643-960c-d9812b29d4ac: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-14f83146-2b5b-4643-960c-d9812b29d4ac', 'volume_size': 2, 'source_volid': 'bca8a6fd-bb57-4f99-9236-8905ba89a16a', 'source_volstatus': 'available'}
Apr 10 13:15:52 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-ac6f04e7-e0ee-458e-a6fc-e3e4094ec2a3 tempest-VolumesCloneTest-1104349490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:15:52 devstack sudo[88207]: pam_unix(sudo:session): session closed for user root
Apr 10 13:15:52 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-df2e3194-f6cd-4fcc-9b5a-0d5c54e0827e tempest-VolumesGetTest-1325070593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3c57b6e-ddf6-4382-9d46-8a8c9722c588 -F qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e3c57b6e-ddf6-4382-9d46-8a8c9722c588.99107aa1-e950-4bfb-a543-b62d9fd5329a" returned: 0 in 0.459s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:15:52 devstack cinder-volume[83345]: WARNING cinder.volume.drivers.remotefs [None req-df2e3194-f6cd-4fcc-9b5a-0d5c54e0827e tempest-VolumesGetTest-1325070593 None] /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e3c57b6e-ddf6-4382-9d46-8a8c9722c588.99107aa1-e950-4bfb-a543-b62d9fd5329a is being set with open permissions: ugo+rw
Apr 10 13:15:52 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-df2e3194-f6cd-4fcc-9b5a-0d5c54e0827e tempest-VolumesGetTest-1325070593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e3c57b6e-ddf6-4382-9d46-8a8c9722c588.99107aa1-e950-4bfb-a543-b62d9fd5329a {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:15:52 devstack sudo[88212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e3c57b6e-ddf6-4382-9d46-8a8c9722c588.99107aa1-e950-4bfb-a543-b62d9fd5329a
Apr 10 13:15:52 devstack sudo[88212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:15:53 devstack sudo[88212]: pam_unix(sudo:session): session closed for user root
Apr 10 13:15:53 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-df2e3194-f6cd-4fcc-9b5a-0d5c54e0827e tempest-VolumesGetTest-1325070593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e3c57b6e-ddf6-4382-9d46-8a8c9722c588.99107aa1-e950-4bfb-a543-b62d9fd5329a" returned: 0 in 0.402s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:15:53 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-df2e3194-f6cd-4fcc-9b5a-0d5c54e0827e tempest-VolumesGetTest-1325070593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e3c57b6e-ddf6-4382-9d46-8a8c9722c588.info {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:15:53 devstack sudo[88215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e3c57b6e-ddf6-4382-9d46-8a8c9722c588.info
Apr 10 13:15:53 devstack sudo[88215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:15:53 devstack cinder-volume[83345]: DEBUG oslo_service.periodic_task [None req-c3f44832-ad7f-424b-a850-32c7352a19c5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83345) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 10 13:15:53 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-c3f44832-ad7f-424b-a850-32c7352a19c5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:15:53 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-c3f44832-ad7f-424b-a850-32c7352a19c5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:15:53 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-c3f44832-ad7f-424b-a850-32c7352a19c5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:15:53 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-c3f44832-ad7f-424b-a850-32c7352a19c5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:15:53 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-c3f44832-ad7f-424b-a850-32c7352a19c5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:15:53 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-c3f44832-ad7f-424b-a850-32c7352a19c5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:15:53 devstack sudo[88217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:15:53 devstack sudo[88217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:15:53 devstack sudo[88215]: pam_unix(sudo:session): session closed for user root
Apr 10 13:15:53 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-df2e3194-f6cd-4fcc-9b5a-0d5c54e0827e tempest-VolumesGetTest-1325070593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e3c57b6e-ddf6-4382-9d46-8a8c9722c588.info" returned: 0 in 0.430s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:15:53 devstack cinder-volume[83345]: WARNING cinder.volume.drivers.remotefs [None req-df2e3194-f6cd-4fcc-9b5a-0d5c54e0827e tempest-VolumesGetTest-1325070593 None] /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e3c57b6e-ddf6-4382-9d46-8a8c9722c588.info is being set with open permissions: ugo+rw
Apr 10 13:15:53 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-df2e3194-f6cd-4fcc-9b5a-0d5c54e0827e tempest-VolumesGetTest-1325070593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e3c57b6e-ddf6-4382-9d46-8a8c9722c588.info {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:15:53 devstack sudo[88220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e3c57b6e-ddf6-4382-9d46-8a8c9722c588.info
Apr 10 13:15:53 devstack sudo[88220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:15:53 devstack sudo[88217]: pam_unix(sudo:session): session closed for user root
Apr 10 13:15:53 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-c3f44832-ad7f-424b-a850-32c7352a19c5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.425s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:15:53 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-c3f44832-ad7f-424b-a850-32c7352a19c5 None None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:15:54 devstack sudo[88220]: pam_unix(sudo:session): session closed for user root
Apr 10 13:15:54 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-df2e3194-f6cd-4fcc-9b5a-0d5c54e0827e tempest-VolumesGetTest-1325070593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e3c57b6e-ddf6-4382-9d46-8a8c9722c588.info" returned: 0 in 0.395s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:15:54 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-df2e3194-f6cd-4fcc-9b5a-0d5c54e0827e tempest-VolumesGetTest-1325070593 None] Acquiring lock "cinder-quobyte-e1542b8a-a5fe-4e27-ba4a-74abacec48a4" by "_copy_volume_from_snapshot" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:15:54 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-df2e3194-f6cd-4fcc-9b5a-0d5c54e0827e tempest-VolumesGetTest-1325070593 None] Lock "cinder-quobyte-e1542b8a-a5fe-4e27-ba4a-74abacec48a4" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:15:54 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-df2e3194-f6cd-4fcc-9b5a-0d5c54e0827e tempest-VolumesGetTest-1325070593 None] snapshot: 99107aa1-e950-4bfb-a543-b62d9fd5329a, volume: e1542b8a-a5fe-4e27-ba4a-74abacec48a4,  {{(pid=83345) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 10 13:15:54 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-df2e3194-f6cd-4fcc-9b5a-0d5c54e0827e tempest-VolumesGetTest-1325070593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:15:54 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-df2e3194-f6cd-4fcc-9b5a-0d5c54e0827e tempest-VolumesGetTest-1325070593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:15:54 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-df2e3194-f6cd-4fcc-9b5a-0d5c54e0827e tempest-VolumesGetTest-1325070593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:15:54 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-df2e3194-f6cd-4fcc-9b5a-0d5c54e0827e tempest-VolumesGetTest-1325070593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:15:54 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-df2e3194-f6cd-4fcc-9b5a-0d5c54e0827e tempest-VolumesGetTest-1325070593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:15:54 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3140f6d-1858-40af-8478-13cbdde6e3dc]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:15:54 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-df2e3194-f6cd-4fcc-9b5a-0d5c54e0827e tempest-VolumesGetTest-1325070593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e3c57b6e-ddf6-4382-9d46-8a8c9722c588.99107aa1-e950-4bfb-a543-b62d9fd5329a {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:15:54 devstack sudo[88226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e3c57b6e-ddf6-4382-9d46-8a8c9722c588.99107aa1-e950-4bfb-a543-b62d9fd5329a
Apr 10 13:15:54 devstack sudo[88226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:15:54 devstack sudo[88226]: pam_unix(sudo:session): session closed for user root
Apr 10 13:15:54 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-df2e3194-f6cd-4fcc-9b5a-0d5c54e0827e tempest-VolumesGetTest-1325070593 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e3c57b6e-ddf6-4382-9d46-8a8c9722c588.99107aa1-e950-4bfb-a543-b62d9fd5329a" returned: 0 in 0.476s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:15:54 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-df2e3194-f6cd-4fcc-9b5a-0d5c54e0827e tempest-VolumesGetTest-1325070593 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e3c57b6e-ddf6-4382-9d46-8a8c9722c588(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 13:15:54 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-df2e3194-f6cd-4fcc-9b5a-0d5c54e0827e tempest-VolumesGetTest-1325070593 None] will copy from snapshot at /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e3c57b6e-ddf6-4382-9d46-8a8c9722c588 {{(pid=83345) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 10 13:15:54 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-df2e3194-f6cd-4fcc-9b5a-0d5c54e0827e tempest-VolumesGetTest-1325070593 None] Creating direct copy from snapshot {{(pid=83345) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 10 13:15:54 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[23e33f45-36c8-4510-b21e-892c4c20a0b6]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:15:54 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-df2e3194-f6cd-4fcc-9b5a-0d5c54e0827e tempest-VolumesGetTest-1325070593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e3c57b6e-ddf6-4382-9d46-8a8c9722c588 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:15:54 devstack sudo[88231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e3c57b6e-ddf6-4382-9d46-8a8c9722c588
Apr 10 13:15:54 devstack sudo[88231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:15:55 devstack sudo[88231]: pam_unix(sudo:session): session closed for user root
Apr 10 13:15:55 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-df2e3194-f6cd-4fcc-9b5a-0d5c54e0827e tempest-VolumesGetTest-1325070593 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e3c57b6e-ddf6-4382-9d46-8a8c9722c588" returned: 0 in 0.460s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:15:55 devstack cinder-volume[83345]: DEBUG cinder.utils [None req-df2e3194-f6cd-4fcc-9b5a-0d5c54e0827e tempest-VolumesGetTest-1325070593 None] Path /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e1542b8a-a5fe-4e27-ba4a-74abacec48a4 not found in is_blk_device check {{(pid=83345) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 10 13:15:55 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-df2e3194-f6cd-4fcc-9b5a-0d5c54e0827e tempest-VolumesGetTest-1325070593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e3c57b6e-ddf6-4382-9d46-8a8c9722c588 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e1542b8a-a5fe-4e27-ba4a-74abacec48a4 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:15:55 devstack sudo[88236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e3c57b6e-ddf6-4382-9d46-8a8c9722c588 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e1542b8a-a5fe-4e27-ba4a-74abacec48a4
Apr 10 13:15:55 devstack sudo[88236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:15:57 devstack sudo[88236]: pam_unix(sudo:session): session closed for user root
Apr 10 13:15:57 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-df2e3194-f6cd-4fcc-9b5a-0d5c54e0827e tempest-VolumesGetTest-1325070593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e3c57b6e-ddf6-4382-9d46-8a8c9722c588 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e1542b8a-a5fe-4e27-ba4a-74abacec48a4" returned: 0 in 2.036s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:15:57 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[888c8d96-2174-40ba-8a37-bb412aeabf58]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:15:57 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-df2e3194-f6cd-4fcc-9b5a-0d5c54e0827e tempest-VolumesGetTest-1325070593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e3c57b6e-ddf6-4382-9d46-8a8c9722c588 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:15:57 devstack sudo[88248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e3c57b6e-ddf6-4382-9d46-8a8c9722c588
Apr 10 13:15:57 devstack sudo[88248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:15:57 devstack sudo[88248]: pam_unix(sudo:session): session closed for user root
Apr 10 13:15:57 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-df2e3194-f6cd-4fcc-9b5a-0d5c54e0827e tempest-VolumesGetTest-1325070593 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e3c57b6e-ddf6-4382-9d46-8a8c9722c588" returned: 0 in 0.583s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:15:57 devstack cinder-volume[83345]: DEBUG cinder.image.image_utils [None req-df2e3194-f6cd-4fcc-9b5a-0d5c54e0827e tempest-VolumesGetTest-1325070593 None] Image conversion details: src /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e3c57b6e-ddf6-4382-9d46-8a8c9722c588, size 1024.00 MB, duration 2.04 sec, destination /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e1542b8a-a5fe-4e27-ba4a-74abacec48a4 {{(pid=83345) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 10 13:15:57 devstack cinder-volume[83345]: INFO cinder.image.image_utils [None req-df2e3194-f6cd-4fcc-9b5a-0d5c54e0827e tempest-VolumesGetTest-1325070593 None] Converted 1024.00 MB image at 502.43 MB/s
Apr 10 13:15:57 devstack cinder-volume[83345]: WARNING cinder.volume.drivers.remotefs [None req-df2e3194-f6cd-4fcc-9b5a-0d5c54e0827e tempest-VolumesGetTest-1325070593 None] /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e1542b8a-a5fe-4e27-ba4a-74abacec48a4 is being set with open permissions: ugo+rw
Apr 10 13:15:57 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-df2e3194-f6cd-4fcc-9b5a-0d5c54e0827e tempest-VolumesGetTest-1325070593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e1542b8a-a5fe-4e27-ba4a-74abacec48a4 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:15:57 devstack sudo[88253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e1542b8a-a5fe-4e27-ba4a-74abacec48a4
Apr 10 13:15:57 devstack sudo[88253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:15:58 devstack sudo[88253]: pam_unix(sudo:session): session closed for user root
Apr 10 13:15:58 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-df2e3194-f6cd-4fcc-9b5a-0d5c54e0827e tempest-VolumesGetTest-1325070593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e1542b8a-a5fe-4e27-ba4a-74abacec48a4" returned: 0 in 0.417s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:15:58 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-df2e3194-f6cd-4fcc-9b5a-0d5c54e0827e tempest-VolumesGetTest-1325070593 None] Lock "cinder-quobyte-e1542b8a-a5fe-4e27-ba4a-74abacec48a4" released by "_copy_volume_from_snapshot" :: held 4.026s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:15:58 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-df2e3194-f6cd-4fcc-9b5a-0d5c54e0827e tempest-VolumesGetTest-1325070593 None] Acquiring lock "cinder-quobyte-99107aa1-e950-4bfb-a543-b62d9fd5329a" by "_delete_snapshot" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:15:58 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-df2e3194-f6cd-4fcc-9b5a-0d5c54e0827e tempest-VolumesGetTest-1325070593 None] Lock "cinder-quobyte-99107aa1-e950-4bfb-a543-b62d9fd5329a" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:15:58 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-df2e3194-f6cd-4fcc-9b5a-0d5c54e0827e tempest-VolumesGetTest-1325070593 None] Deleting offline snapshot 99107aa1-e950-4bfb-a543-b62d9fd5329a of volume e3c57b6e-ddf6-4382-9d46-8a8c9722c588 {{(pid=83345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 10 13:15:58 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-df2e3194-f6cd-4fcc-9b5a-0d5c54e0827e tempest-VolumesGetTest-1325070593 None] snapshot_file for this snap is: volume-e3c57b6e-ddf6-4382-9d46-8a8c9722c588.99107aa1-e950-4bfb-a543-b62d9fd5329a {{(pid=83345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 10 13:15:58 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[582a60d3-a0d1-43f4-87a8-3b5946e6f477]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:15:58 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-df2e3194-f6cd-4fcc-9b5a-0d5c54e0827e tempest-VolumesGetTest-1325070593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e3c57b6e-ddf6-4382-9d46-8a8c9722c588.99107aa1-e950-4bfb-a543-b62d9fd5329a {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:15:58 devstack sudo[88256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e3c57b6e-ddf6-4382-9d46-8a8c9722c588.99107aa1-e950-4bfb-a543-b62d9fd5329a
Apr 10 13:15:58 devstack sudo[88256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:15:58 devstack sudo[88256]: pam_unix(sudo:session): session closed for user root
Apr 10 13:15:58 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-df2e3194-f6cd-4fcc-9b5a-0d5c54e0827e tempest-VolumesGetTest-1325070593 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e3c57b6e-ddf6-4382-9d46-8a8c9722c588.99107aa1-e950-4bfb-a543-b62d9fd5329a" returned: 0 in 0.470s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:15:58 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-df2e3194-f6cd-4fcc-9b5a-0d5c54e0827e tempest-VolumesGetTest-1325070593 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e3c57b6e-ddf6-4382-9d46-8a8c9722c588(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 13:15:58 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[2682336a-0441-45ca-9efa-aed94c8306c8]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:15:58 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-df2e3194-f6cd-4fcc-9b5a-0d5c54e0827e tempest-VolumesGetTest-1325070593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e3c57b6e-ddf6-4382-9d46-8a8c9722c588 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:15:58 devstack sudo[88261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e3c57b6e-ddf6-4382-9d46-8a8c9722c588
Apr 10 13:15:58 devstack sudo[88261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:15:59 devstack sudo[88261]: pam_unix(sudo:session): session closed for user root
Apr 10 13:15:59 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-df2e3194-f6cd-4fcc-9b5a-0d5c54e0827e tempest-VolumesGetTest-1325070593 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e3c57b6e-ddf6-4382-9d46-8a8c9722c588" returned: 0 in 0.473s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:15:59 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-df2e3194-f6cd-4fcc-9b5a-0d5c54e0827e tempest-VolumesGetTest-1325070593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e3c57b6e-ddf6-4382-9d46-8a8c9722c588.99107aa1-e950-4bfb-a543-b62d9fd5329a {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:15:59 devstack sudo[88266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e3c57b6e-ddf6-4382-9d46-8a8c9722c588.99107aa1-e950-4bfb-a543-b62d9fd5329a
Apr 10 13:15:59 devstack sudo[88266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:15:59 devstack sudo[88266]: pam_unix(sudo:session): session closed for user root
Apr 10 13:15:59 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-df2e3194-f6cd-4fcc-9b5a-0d5c54e0827e tempest-VolumesGetTest-1325070593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e3c57b6e-ddf6-4382-9d46-8a8c9722c588.99107aa1-e950-4bfb-a543-b62d9fd5329a" returned: 0 in 0.440s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:15:59 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-df2e3194-f6cd-4fcc-9b5a-0d5c54e0827e tempest-VolumesGetTest-1325070593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e3c57b6e-ddf6-4382-9d46-8a8c9722c588.99107aa1-e950-4bfb-a543-b62d9fd5329a {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:15:59 devstack sudo[88271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e3c57b6e-ddf6-4382-9d46-8a8c9722c588.99107aa1-e950-4bfb-a543-b62d9fd5329a
Apr 10 13:15:59 devstack sudo[88271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:00 devstack sudo[88271]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:00 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-df2e3194-f6cd-4fcc-9b5a-0d5c54e0827e tempest-VolumesGetTest-1325070593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e3c57b6e-ddf6-4382-9d46-8a8c9722c588.99107aa1-e950-4bfb-a543-b62d9fd5329a" returned: 0 in 0.403s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:00 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-df2e3194-f6cd-4fcc-9b5a-0d5c54e0827e tempest-VolumesGetTest-1325070593 None] Lock "cinder-quobyte-99107aa1-e950-4bfb-a543-b62d9fd5329a" released by "_delete_snapshot" :: held 1.833s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:16:00 devstack cinder-volume[83345]: DEBUG dbcounter [-] [83345] Writing DB stats cinder:UPDATE=128,cinder:INSERT=45,cinder:SELECT=124,cinder:DELETE=11 {{(pid=83345) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 10 13:16:00 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-df2e3194-f6cd-4fcc-9b5a-0d5c54e0827e tempest-VolumesGetTest-1325070593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 8.661s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:16:00 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-f5d7d42d-7d1f-4eaf-8d9e-489abe8aad12 tempest-SnapshotsActionsTest-802738678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.012s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:16:00 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-f5d7d42d-7d1f-4eaf-8d9e-489abe8aad12 tempest-SnapshotsActionsTest-802738678 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f252bf08b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:15:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-486824048',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f013013-ffcb-4dd4-8e73-3e004e4c6f11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3111be95c7dd4de09d4c81f5d62d6a34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:15:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:15:49Z,use_quota=True,user_id='07411b8f4620475ca3bdaab75d4d16b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)}" {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 13:16:00 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-f5d7d42d-7d1f-4eaf-8d9e-489abe8aad12 tempest-SnapshotsActionsTest-802738678 None] Creating volume 4f013013-ffcb-4dd4-8e73-3e004e4c6f11 {{(pid=83345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 13:16:00 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-f5d7d42d-7d1f-4eaf-8d9e-489abe8aad12 tempest-SnapshotsActionsTest-802738678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:16:00 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-f5d7d42d-7d1f-4eaf-8d9e-489abe8aad12 tempest-SnapshotsActionsTest-802738678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:16:00 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-f5d7d42d-7d1f-4eaf-8d9e-489abe8aad12 tempest-SnapshotsActionsTest-802738678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:16:00 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-f5d7d42d-7d1f-4eaf-8d9e-489abe8aad12 tempest-SnapshotsActionsTest-802738678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:16:00 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-f5d7d42d-7d1f-4eaf-8d9e-489abe8aad12 tempest-SnapshotsActionsTest-802738678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:16:00 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-f5d7d42d-7d1f-4eaf-8d9e-489abe8aad12 tempest-SnapshotsActionsTest-802738678 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:16:00 devstack cinder-volume[83345]: INFO cinder.volume.drivers.remotefs [None req-f5d7d42d-7d1f-4eaf-8d9e-489abe8aad12 tempest-SnapshotsActionsTest-802738678 None] casted to osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331
Apr 10 13:16:00 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-f5d7d42d-7d1f-4eaf-8d9e-489abe8aad12 tempest-SnapshotsActionsTest-802738678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11 1073741824 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:00 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-df2e3194-f6cd-4fcc-9b5a-0d5c54e0827e tempest-VolumesGetTest-1325070593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42d4077b-d338-4146-87a0-6c975a87b381) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1542b8a-a5fe-4e27-ba4a-74abacec48a4', 'volume_size': 1, 'source_volid': 'e3c57b6e-ddf6-4382-9d46-8a8c9722c588', 'source_volstatus': 'available'}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:16:00 devstack sudo[88274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11 1073741824
Apr 10 13:16:00 devstack sudo[88274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:00 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-df2e3194-f6cd-4fcc-9b5a-0d5c54e0827e tempest-VolumesGetTest-1325070593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (558cbe62-3011-494c-9b34-2d8a013b5c69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:16:00 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-df2e3194-f6cd-4fcc-9b5a-0d5c54e0827e tempest-VolumesGetTest-1325070593 None] Volume volume-e1542b8a-a5fe-4e27-ba4a-74abacec48a4 (e1542b8a-a5fe-4e27-ba4a-74abacec48a4): created successfully
Apr 10 13:16:00 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-df2e3194-f6cd-4fcc-9b5a-0d5c54e0827e tempest-VolumesGetTest-1325070593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (558cbe62-3011-494c-9b34-2d8a013b5c69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:16:00 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-df2e3194-f6cd-4fcc-9b5a-0d5c54e0827e tempest-VolumesGetTest-1325070593 None] Flow 'volume_create_manager' (0fb781fe-469c-44bf-b603-eb00eaf4fee3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:16:00 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-df2e3194-f6cd-4fcc-9b5a-0d5c54e0827e tempest-VolumesGetTest-1325070593 None] Created volume successfully.
Apr 10 13:16:00 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e848170-12fd-408a-99a2-f40af1808f11 tempest-VolumesGetTest-1325070593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:16:00 devstack sudo[88274]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:00 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-7e848170-12fd-408a-99a2-f40af1808f11 tempest-VolumesGetTest-1325070593 None] Flow 'volume_create_manager' (e57f24ad-168d-46d8-862e-496e83d3b7e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:16:00 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-7e848170-12fd-408a-99a2-f40af1808f11 tempest-VolumesGetTest-1325070593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (154b0564-b73e-4eef-8564-095ecaa7166b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:16:00 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-f5d7d42d-7d1f-4eaf-8d9e-489abe8aad12 tempest-SnapshotsActionsTest-802738678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11 1073741824" returned: 0 in 0.598s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:00 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-7e848170-12fd-408a-99a2-f40af1808f11 tempest-VolumesGetTest-1325070593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (154b0564-b73e-4eef-8564-095ecaa7166b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:16:01Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1915647700',display_name='tempest-VolumesGetTest-Volume-1354625700',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab28e917-4854-4a30-bdd1-e913ac487535,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2164901a19c74ad5a7ac47fa92772df3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:16:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:16:01Z,use_quota=True,user_id='e6a465b820764bf78e3ec91bbb896b7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:16:00 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-7e848170-12fd-408a-99a2-f40af1808f11 tempest-VolumesGetTest-1325070593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b375c5f3-d4b9-4674-9532-dc1d5f029b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:16:00 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-7e848170-12fd-408a-99a2-f40af1808f11 tempest-VolumesGetTest-1325070593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b375c5f3-d4b9-4674-9532-dc1d5f029b7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:16:00 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-7e848170-12fd-408a-99a2-f40af1808f11 tempest-VolumesGetTest-1325070593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a50141ab-a98b-4f02-b9fe-5ec9da82b80d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:16:00 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-7e848170-12fd-408a-99a2-f40af1808f11 tempest-VolumesGetTest-1325070593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a50141ab-a98b-4f02-b9fe-5ec9da82b80d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab28e917-4854-4a30-bdd1-e913ac487535', 'volume_name': 'volume-ab28e917-4854-4a30-bdd1-e913ac487535', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:16:00 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-7e848170-12fd-408a-99a2-f40af1808f11 tempest-VolumesGetTest-1325070593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0dd3823-0938-47db-b965-8895f8b49297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:16:00 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-7e848170-12fd-408a-99a2-f40af1808f11 tempest-VolumesGetTest-1325070593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0dd3823-0938-47db-b965-8895f8b49297) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:16:00 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-7e848170-12fd-408a-99a2-f40af1808f11 tempest-VolumesGetTest-1325070593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5aa30beb-e5c6-4f39-87fb-294611d1a32b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:16:00 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-7e848170-12fd-408a-99a2-f40af1808f11 tempest-VolumesGetTest-1325070593 None] Volume ab28e917-4854-4a30-bdd1-e913ac487535: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab28e917-4854-4a30-bdd1-e913ac487535', 'volume_size': 1}
Apr 10 13:16:00 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-7e848170-12fd-408a-99a2-f40af1808f11 tempest-VolumesGetTest-1325070593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:16:00 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-f5d7d42d-7d1f-4eaf-8d9e-489abe8aad12 tempest-SnapshotsActionsTest-802738678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:00 devstack sudo[88279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11
Apr 10 13:16:00 devstack sudo[88279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:01 devstack sudo[88279]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:01 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-f5d7d42d-7d1f-4eaf-8d9e-489abe8aad12 tempest-SnapshotsActionsTest-802738678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11" returned: 0 in 0.421s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:01 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-f5d7d42d-7d1f-4eaf-8d9e-489abe8aad12 tempest-SnapshotsActionsTest-802738678 None] <== create_volume: return (1071ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'} {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 13:16:01 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-f5d7d42d-7d1f-4eaf-8d9e-489abe8aad12 tempest-SnapshotsActionsTest-802738678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.074s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:16:01 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-af90e113-3a20-415c-b0d6-5273dc44e9cf tempest-VolumesExtendTest-27412717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 9.681s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:16:01 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-f5d7d42d-7d1f-4eaf-8d9e-489abe8aad12 tempest-SnapshotsActionsTest-802738678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5061ee15-180c-4d6c-a946-ac1ff7aac677) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:16:01 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-f5d7d42d-7d1f-4eaf-8d9e-489abe8aad12 tempest-SnapshotsActionsTest-802738678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75c1a094-7508-4f1f-9063-46e6350af8cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:16:01 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[a81355ee-323a-4393-ba26-e1a422f4d9ec]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:16:01 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-af90e113-3a20-415c-b0d6-5273dc44e9cf tempest-VolumesExtendTest-27412717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-94794e9e-8a79-46ba-9fb4-20681ce1fc3d {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:01 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-f5d7d42d-7d1f-4eaf-8d9e-489abe8aad12 tempest-SnapshotsActionsTest-802738678 None] Volume volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11 (4f013013-ffcb-4dd4-8e73-3e004e4c6f11): created successfully
Apr 10 13:16:01 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-f5d7d42d-7d1f-4eaf-8d9e-489abe8aad12 tempest-SnapshotsActionsTest-802738678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75c1a094-7508-4f1f-9063-46e6350af8cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:16:01 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-f5d7d42d-7d1f-4eaf-8d9e-489abe8aad12 tempest-SnapshotsActionsTest-802738678 None] Flow 'volume_create_manager' (3a201aea-a84f-4278-8ff7-1d1c2e630772) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:16:01 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-f5d7d42d-7d1f-4eaf-8d9e-489abe8aad12 tempest-SnapshotsActionsTest-802738678 None] Created volume successfully.
Apr 10 13:16:01 devstack sudo[88282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-94794e9e-8a79-46ba-9fb4-20681ce1fc3d
Apr 10 13:16:01 devstack sudo[88282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:01 devstack sudo[88282]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:01 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-af90e113-3a20-415c-b0d6-5273dc44e9cf tempest-VolumesExtendTest-27412717 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-94794e9e-8a79-46ba-9fb4-20681ce1fc3d" returned: 0 in 0.485s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:01 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-af90e113-3a20-415c-b0d6-5273dc44e9cf tempest-VolumesExtendTest-27412717 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-94794e9e-8a79-46ba-9fb4-20681ce1fc3d.038018d5-a984-4954-9747-6055d05befa7 2G {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:01 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-af90e113-3a20-415c-b0d6-5273dc44e9cf tempest-VolumesExtendTest-27412717 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-94794e9e-8a79-46ba-9fb4-20681ce1fc3d.038018d5-a984-4954-9747-6055d05befa7 2G" returned: 0 in 0.073s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:01 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-af90e113-3a20-415c-b0d6-5273dc44e9cf tempest-VolumesExtendTest-27412717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.587s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:16:01 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-ac6f04e7-e0ee-458e-a6fc-e3e4094ec2a3 tempest-VolumesCloneTest-1104349490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 8.976s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:16:01 devstack cinder-volume[83345]: INFO cinder.volume.drivers.remotefs [None req-ac6f04e7-e0ee-458e-a6fc-e3e4094ec2a3 tempest-VolumesCloneTest-1104349490 None] Cloning volume bca8a6fd-bb57-4f99-9236-8905ba89a16a to volume 14f83146-2b5b-4643-960c-d9812b29d4ac
Apr 10 13:16:01 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-ac6f04e7-e0ee-458e-a6fc-e3e4094ec2a3 tempest-VolumesCloneTest-1104349490 None] Creating offline snapshot fbc176ae-4ac1-4c9c-8058-b9f1e5a38c86 of volume bca8a6fd-bb57-4f99-9236-8905ba89a16a {{(pid=83345) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 10 13:16:01 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac3c5701-517f-438f-85f2-a753f4b3aa8e]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:16:01 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ac6f04e7-e0ee-458e-a6fc-e3e4094ec2a3 tempest-VolumesCloneTest-1104349490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-bca8a6fd-bb57-4f99-9236-8905ba89a16a {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:01 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-af90e113-3a20-415c-b0d6-5273dc44e9cf tempest-VolumesExtendTest-27412717 None] Extend volume completed successfully.
Apr 10 13:16:01 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-f24aa791-1aa7-4768-859f-74ed66bca9ce tempest-SnapshotsActionsTest-802738678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:16:01 devstack sudo[88291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-bca8a6fd-bb57-4f99-9236-8905ba89a16a
Apr 10 13:16:01 devstack sudo[88291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:02 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-449b1ee3-d379-4392-b206-2f6a2508d602 tempest-VolumesExtendTest-27412717 None] Acquiring lock "cinder-038018d5-a984-4954-9747-6055d05befa7-delete_snapshot" by "delete_snapshot" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:16:02 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-449b1ee3-d379-4392-b206-2f6a2508d602 tempest-VolumesExtendTest-27412717 None] Lock "cinder-038018d5-a984-4954-9747-6055d05befa7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:16:02 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-449b1ee3-d379-4392-b206-2f6a2508d602 tempest-VolumesExtendTest-27412717 None] Acquiring lock "cinder-quobyte-94794e9e-8a79-46ba-9fb4-20681ce1fc3d" by "delete_snapshot" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:16:02 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-449b1ee3-d379-4392-b206-2f6a2508d602 tempest-VolumesExtendTest-27412717 None] Lock "cinder-quobyte-94794e9e-8a79-46ba-9fb4-20681ce1fc3d" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:16:02 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-449b1ee3-d379-4392-b206-2f6a2508d602 tempest-VolumesExtendTest-27412717 None] Acquiring lock "cinder-quobyte-038018d5-a984-4954-9747-6055d05befa7" by "_delete_snapshot" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:16:02 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-449b1ee3-d379-4392-b206-2f6a2508d602 tempest-VolumesExtendTest-27412717 None] Lock "cinder-quobyte-038018d5-a984-4954-9747-6055d05befa7" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:16:02 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-449b1ee3-d379-4392-b206-2f6a2508d602 tempest-VolumesExtendTest-27412717 None] Deleting offline snapshot 038018d5-a984-4954-9747-6055d05befa7 of volume 94794e9e-8a79-46ba-9fb4-20681ce1fc3d {{(pid=83345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 10 13:16:02 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-449b1ee3-d379-4392-b206-2f6a2508d602 tempest-VolumesExtendTest-27412717 None] snapshot_file for this snap is: volume-94794e9e-8a79-46ba-9fb4-20681ce1fc3d.038018d5-a984-4954-9747-6055d05befa7 {{(pid=83345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 10 13:16:02 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[c396a0e9-5cc1-4ecc-8124-f7864ca3fae1]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:16:02 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-449b1ee3-d379-4392-b206-2f6a2508d602 tempest-VolumesExtendTest-27412717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-94794e9e-8a79-46ba-9fb4-20681ce1fc3d.038018d5-a984-4954-9747-6055d05befa7 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:02 devstack sudo[88291]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:02 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ac6f04e7-e0ee-458e-a6fc-e3e4094ec2a3 tempest-VolumesCloneTest-1104349490 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-bca8a6fd-bb57-4f99-9236-8905ba89a16a" returned: 0 in 0.515s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:02 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ac6f04e7-e0ee-458e-a6fc-e3e4094ec2a3 tempest-VolumesCloneTest-1104349490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-bca8a6fd-bb57-4f99-9236-8905ba89a16a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-bca8a6fd-bb57-4f99-9236-8905ba89a16a.fbc176ae-4ac1-4c9c-8058-b9f1e5a38c86 1G {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:02 devstack sudo[88296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-94794e9e-8a79-46ba-9fb4-20681ce1fc3d.038018d5-a984-4954-9747-6055d05befa7
Apr 10 13:16:02 devstack sudo[88296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:02 devstack sudo[88297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-bca8a6fd-bb57-4f99-9236-8905ba89a16a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-bca8a6fd-bb57-4f99-9236-8905ba89a16a.fbc176ae-4ac1-4c9c-8058-b9f1e5a38c86 1G
Apr 10 13:16:02 devstack sudo[88297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:02 devstack sudo[88296]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:02 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-449b1ee3-d379-4392-b206-2f6a2508d602 tempest-VolumesExtendTest-27412717 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-94794e9e-8a79-46ba-9fb4-20681ce1fc3d.038018d5-a984-4954-9747-6055d05befa7" returned: 0 in 0.508s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:02 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-449b1ee3-d379-4392-b206-2f6a2508d602 tempest-VolumesExtendTest-27412717 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94794e9e-8a79-46ba-9fb4-20681ce1fc3d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 13:16:02 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0f1d07b-ea18-4894-8168-81b2959edefe]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:16:02 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-449b1ee3-d379-4392-b206-2f6a2508d602 tempest-VolumesExtendTest-27412717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-94794e9e-8a79-46ba-9fb4-20681ce1fc3d {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:02 devstack sudo[88297]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:02 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ac6f04e7-e0ee-458e-a6fc-e3e4094ec2a3 tempest-VolumesCloneTest-1104349490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-bca8a6fd-bb57-4f99-9236-8905ba89a16a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-bca8a6fd-bb57-4f99-9236-8905ba89a16a.fbc176ae-4ac1-4c9c-8058-b9f1e5a38c86 1G" returned: 0 in 0.474s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:02 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ac6f04e7-e0ee-458e-a6fc-e3e4094ec2a3 tempest-VolumesCloneTest-1104349490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bca8a6fd-bb57-4f99-9236-8905ba89a16a -F qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-bca8a6fd-bb57-4f99-9236-8905ba89a16a.fbc176ae-4ac1-4c9c-8058-b9f1e5a38c86 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:02 devstack sudo[88307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bca8a6fd-bb57-4f99-9236-8905ba89a16a -F qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-bca8a6fd-bb57-4f99-9236-8905ba89a16a.fbc176ae-4ac1-4c9c-8058-b9f1e5a38c86
Apr 10 13:16:02 devstack sudo[88307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:02 devstack sudo[88306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-94794e9e-8a79-46ba-9fb4-20681ce1fc3d
Apr 10 13:16:02 devstack sudo[88306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:03 devstack sudo[88307]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:03 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ac6f04e7-e0ee-458e-a6fc-e3e4094ec2a3 tempest-VolumesCloneTest-1104349490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bca8a6fd-bb57-4f99-9236-8905ba89a16a -F qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-bca8a6fd-bb57-4f99-9236-8905ba89a16a.fbc176ae-4ac1-4c9c-8058-b9f1e5a38c86" returned: 0 in 0.441s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:03 devstack cinder-volume[83345]: WARNING cinder.volume.drivers.remotefs [None req-ac6f04e7-e0ee-458e-a6fc-e3e4094ec2a3 tempest-VolumesCloneTest-1104349490 None] /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-bca8a6fd-bb57-4f99-9236-8905ba89a16a.fbc176ae-4ac1-4c9c-8058-b9f1e5a38c86 is being set with open permissions: ugo+rw
Apr 10 13:16:03 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ac6f04e7-e0ee-458e-a6fc-e3e4094ec2a3 tempest-VolumesCloneTest-1104349490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-bca8a6fd-bb57-4f99-9236-8905ba89a16a.fbc176ae-4ac1-4c9c-8058-b9f1e5a38c86 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:03 devstack sudo[88316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-bca8a6fd-bb57-4f99-9236-8905ba89a16a.fbc176ae-4ac1-4c9c-8058-b9f1e5a38c86
Apr 10 13:16:03 devstack sudo[88316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:03 devstack sudo[88306]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:03 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-449b1ee3-d379-4392-b206-2f6a2508d602 tempest-VolumesExtendTest-27412717 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-94794e9e-8a79-46ba-9fb4-20681ce1fc3d" returned: 0 in 0.496s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:03 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-449b1ee3-d379-4392-b206-2f6a2508d602 tempest-VolumesExtendTest-27412717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-94794e9e-8a79-46ba-9fb4-20681ce1fc3d.038018d5-a984-4954-9747-6055d05befa7 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:03 devstack sudo[88318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-94794e9e-8a79-46ba-9fb4-20681ce1fc3d.038018d5-a984-4954-9747-6055d05befa7
Apr 10 13:16:03 devstack sudo[88318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:03 devstack sudo[88316]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:03 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ac6f04e7-e0ee-458e-a6fc-e3e4094ec2a3 tempest-VolumesCloneTest-1104349490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-bca8a6fd-bb57-4f99-9236-8905ba89a16a.fbc176ae-4ac1-4c9c-8058-b9f1e5a38c86" returned: 0 in 0.438s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:03 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ac6f04e7-e0ee-458e-a6fc-e3e4094ec2a3 tempest-VolumesCloneTest-1104349490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-bca8a6fd-bb57-4f99-9236-8905ba89a16a.info {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:03 devstack sudo[88324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-bca8a6fd-bb57-4f99-9236-8905ba89a16a.info
Apr 10 13:16:03 devstack sudo[88324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:03 devstack sudo[88318]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:03 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-449b1ee3-d379-4392-b206-2f6a2508d602 tempest-VolumesExtendTest-27412717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-94794e9e-8a79-46ba-9fb4-20681ce1fc3d.038018d5-a984-4954-9747-6055d05befa7" returned: 0 in 0.463s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:03 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-449b1ee3-d379-4392-b206-2f6a2508d602 tempest-VolumesExtendTest-27412717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-94794e9e-8a79-46ba-9fb4-20681ce1fc3d.038018d5-a984-4954-9747-6055d05befa7 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:03 devstack sudo[88326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-94794e9e-8a79-46ba-9fb4-20681ce1fc3d.038018d5-a984-4954-9747-6055d05befa7
Apr 10 13:16:03 devstack sudo[88326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:04 devstack sudo[88324]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:04 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ac6f04e7-e0ee-458e-a6fc-e3e4094ec2a3 tempest-VolumesCloneTest-1104349490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-bca8a6fd-bb57-4f99-9236-8905ba89a16a.info" returned: 0 in 0.416s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:04 devstack cinder-volume[83345]: WARNING cinder.volume.drivers.remotefs [None req-ac6f04e7-e0ee-458e-a6fc-e3e4094ec2a3 tempest-VolumesCloneTest-1104349490 None] /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-bca8a6fd-bb57-4f99-9236-8905ba89a16a.info is being set with open permissions: ugo+rw
Apr 10 13:16:04 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ac6f04e7-e0ee-458e-a6fc-e3e4094ec2a3 tempest-VolumesCloneTest-1104349490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-bca8a6fd-bb57-4f99-9236-8905ba89a16a.info {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:04 devstack sudo[88330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-bca8a6fd-bb57-4f99-9236-8905ba89a16a.info
Apr 10 13:16:04 devstack sudo[88330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:04 devstack sudo[88326]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:04 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-449b1ee3-d379-4392-b206-2f6a2508d602 tempest-VolumesExtendTest-27412717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-94794e9e-8a79-46ba-9fb4-20681ce1fc3d.038018d5-a984-4954-9747-6055d05befa7" returned: 0 in 0.433s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:04 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-449b1ee3-d379-4392-b206-2f6a2508d602 tempest-VolumesExtendTest-27412717 None] Lock "cinder-quobyte-038018d5-a984-4954-9747-6055d05befa7" released by "_delete_snapshot" :: held 1.951s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:16:04 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-449b1ee3-d379-4392-b206-2f6a2508d602 tempest-VolumesExtendTest-27412717 None] Lock "cinder-quobyte-94794e9e-8a79-46ba-9fb4-20681ce1fc3d" released by "delete_snapshot" :: held 1.966s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:16:04 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-449b1ee3-d379-4392-b206-2f6a2508d602 tempest-VolumesExtendTest-27412717 None] Created reservations ['9b6e291e-93b1-432b-90dd-ebadaffb2f2a', '37b27f24-387b-4412-8235-03c07f580de8', '7ad4e509-95e6-4a61-b933-d5aeca8a35bf', '7e8112db-a4f2-4566-b065-05b5dc70ebf0'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:16:04 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-449b1ee3-d379-4392-b206-2f6a2508d602 tempest-VolumesExtendTest-27412717 None] Delete snapshot completed successfully.
Apr 10 13:16:04 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-449b1ee3-d379-4392-b206-2f6a2508d602 tempest-VolumesExtendTest-27412717 None] Lock "cinder-038018d5-a984-4954-9747-6055d05befa7-delete_snapshot" released by "delete_snapshot" :: held 2.052s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:16:04 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-56e9d570-b8c6-4632-9bba-9944414494fb tempest-VolumesExtendTest-27412717 None] Acquiring lock "cinder-94794e9e-8a79-46ba-9fb4-20681ce1fc3d-delete_volume" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:16:04 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-56e9d570-b8c6-4632-9bba-9944414494fb tempest-VolumesExtendTest-27412717 None] Lock "cinder-94794e9e-8a79-46ba-9fb4-20681ce1fc3d-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:16:04 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-56e9d570-b8c6-4632-9bba-9944414494fb tempest-VolumesExtendTest-27412717 None] Acquiring lock "cinder-quobyte-94794e9e-8a79-46ba-9fb4-20681ce1fc3d" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:16:04 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-56e9d570-b8c6-4632-9bba-9944414494fb tempest-VolumesExtendTest-27412717 None] Lock "cinder-quobyte-94794e9e-8a79-46ba-9fb4-20681ce1fc3d" acquired by "delete_volume" :: waited 0.010s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:16:04 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9e59185-823d-48a1-94fc-8b3536a8b27a]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:16:04 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-56e9d570-b8c6-4632-9bba-9944414494fb tempest-VolumesExtendTest-27412717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-94794e9e-8a79-46ba-9fb4-20681ce1fc3d {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:04 devstack sudo[88332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-94794e9e-8a79-46ba-9fb4-20681ce1fc3d
Apr 10 13:16:04 devstack sudo[88332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:04 devstack sudo[88330]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:04 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ac6f04e7-e0ee-458e-a6fc-e3e4094ec2a3 tempest-VolumesCloneTest-1104349490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-bca8a6fd-bb57-4f99-9236-8905ba89a16a.info" returned: 0 in 0.452s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:04 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-ac6f04e7-e0ee-458e-a6fc-e3e4094ec2a3 tempest-VolumesCloneTest-1104349490 None] Acquiring lock "cinder-quobyte-14f83146-2b5b-4643-960c-d9812b29d4ac" by "_copy_volume_from_snapshot" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:16:04 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-ac6f04e7-e0ee-458e-a6fc-e3e4094ec2a3 tempest-VolumesCloneTest-1104349490 None] Lock "cinder-quobyte-14f83146-2b5b-4643-960c-d9812b29d4ac" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:16:04 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-ac6f04e7-e0ee-458e-a6fc-e3e4094ec2a3 tempest-VolumesCloneTest-1104349490 None] snapshot: fbc176ae-4ac1-4c9c-8058-b9f1e5a38c86, volume: 14f83146-2b5b-4643-960c-d9812b29d4ac,  {{(pid=83345) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 10 13:16:04 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-ac6f04e7-e0ee-458e-a6fc-e3e4094ec2a3 tempest-VolumesCloneTest-1104349490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:16:04 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-ac6f04e7-e0ee-458e-a6fc-e3e4094ec2a3 tempest-VolumesCloneTest-1104349490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:16:04 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-ac6f04e7-e0ee-458e-a6fc-e3e4094ec2a3 tempest-VolumesCloneTest-1104349490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:16:04 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-ac6f04e7-e0ee-458e-a6fc-e3e4094ec2a3 tempest-VolumesCloneTest-1104349490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:16:04 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-ac6f04e7-e0ee-458e-a6fc-e3e4094ec2a3 tempest-VolumesCloneTest-1104349490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:16:04 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca2af10a-c9d9-4fe4-8507-0655fc19d118]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:16:04 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ac6f04e7-e0ee-458e-a6fc-e3e4094ec2a3 tempest-VolumesCloneTest-1104349490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-bca8a6fd-bb57-4f99-9236-8905ba89a16a.fbc176ae-4ac1-4c9c-8058-b9f1e5a38c86 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:04 devstack sudo[88335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-bca8a6fd-bb57-4f99-9236-8905ba89a16a.fbc176ae-4ac1-4c9c-8058-b9f1e5a38c86
Apr 10 13:16:04 devstack sudo[88335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:04 devstack sudo[88332]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:04 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-56e9d570-b8c6-4632-9bba-9944414494fb tempest-VolumesExtendTest-27412717 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-94794e9e-8a79-46ba-9fb4-20681ce1fc3d" returned: 0 in 0.511s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:04 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-56e9d570-b8c6-4632-9bba-9944414494fb tempest-VolumesExtendTest-27412717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-94794e9e-8a79-46ba-9fb4-20681ce1fc3d {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:05 devstack sudo[88340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-94794e9e-8a79-46ba-9fb4-20681ce1fc3d
Apr 10 13:16:05 devstack sudo[88340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:05 devstack sudo[88335]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:05 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ac6f04e7-e0ee-458e-a6fc-e3e4094ec2a3 tempest-VolumesCloneTest-1104349490 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-bca8a6fd-bb57-4f99-9236-8905ba89a16a.fbc176ae-4ac1-4c9c-8058-b9f1e5a38c86" returned: 0 in 0.473s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:05 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-ac6f04e7-e0ee-458e-a6fc-e3e4094ec2a3 tempest-VolumesCloneTest-1104349490 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bca8a6fd-bb57-4f99-9236-8905ba89a16a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 13:16:05 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-ac6f04e7-e0ee-458e-a6fc-e3e4094ec2a3 tempest-VolumesCloneTest-1104349490 None] will copy from snapshot at /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-bca8a6fd-bb57-4f99-9236-8905ba89a16a {{(pid=83345) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 10 13:16:05 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-ac6f04e7-e0ee-458e-a6fc-e3e4094ec2a3 tempest-VolumesCloneTest-1104349490 None] Creating direct copy from snapshot {{(pid=83345) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 10 13:16:05 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b0f6112-ace5-44d3-9a7a-fc3ddfa23545]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:16:05 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ac6f04e7-e0ee-458e-a6fc-e3e4094ec2a3 tempest-VolumesCloneTest-1104349490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-bca8a6fd-bb57-4f99-9236-8905ba89a16a {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:05 devstack sudo[88345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-bca8a6fd-bb57-4f99-9236-8905ba89a16a
Apr 10 13:16:05 devstack sudo[88345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:05 devstack sudo[88340]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:05 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-56e9d570-b8c6-4632-9bba-9944414494fb tempest-VolumesExtendTest-27412717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-94794e9e-8a79-46ba-9fb4-20681ce1fc3d" returned: 0 in 0.409s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:05 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-56e9d570-b8c6-4632-9bba-9944414494fb tempest-VolumesExtendTest-27412717 None] Lock "cinder-quobyte-94794e9e-8a79-46ba-9fb4-20681ce1fc3d" released by "delete_volume" :: held 0.956s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:16:05 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-56e9d570-b8c6-4632-9bba-9944414494fb tempest-VolumesExtendTest-27412717 None] Created reservations ['dd9b2dd8-dcc3-4fea-9fcd-593c83835fe3', 'd7e6eca3-5832-4257-93d6-0da933524c02', 'dff5c6f9-87ca-47f8-9a66-22bc1c041e55', 'f2513b00-e927-4713-83e2-07c41371474e'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:16:05 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-56e9d570-b8c6-4632-9bba-9944414494fb tempest-VolumesExtendTest-27412717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:16:05 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-56e9d570-b8c6-4632-9bba-9944414494fb tempest-VolumesExtendTest-27412717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:16:05 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-56e9d570-b8c6-4632-9bba-9944414494fb tempest-VolumesExtendTest-27412717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:16:05 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-56e9d570-b8c6-4632-9bba-9944414494fb tempest-VolumesExtendTest-27412717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:16:05 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-56e9d570-b8c6-4632-9bba-9944414494fb tempest-VolumesExtendTest-27412717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:16:05 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-56e9d570-b8c6-4632-9bba-9944414494fb tempest-VolumesExtendTest-27412717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:05 devstack sudo[88348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:16:05 devstack sudo[88348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:05 devstack sudo[88345]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:05 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ac6f04e7-e0ee-458e-a6fc-e3e4094ec2a3 tempest-VolumesCloneTest-1104349490 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-bca8a6fd-bb57-4f99-9236-8905ba89a16a" returned: 0 in 0.506s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:05 devstack cinder-volume[83345]: DEBUG cinder.utils [None req-ac6f04e7-e0ee-458e-a6fc-e3e4094ec2a3 tempest-VolumesCloneTest-1104349490 None] Path /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-14f83146-2b5b-4643-960c-d9812b29d4ac not found in is_blk_device check {{(pid=83345) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 10 13:16:05 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ac6f04e7-e0ee-458e-a6fc-e3e4094ec2a3 tempest-VolumesCloneTest-1104349490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-bca8a6fd-bb57-4f99-9236-8905ba89a16a /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-14f83146-2b5b-4643-960c-d9812b29d4ac {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:05 devstack sudo[88353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-bca8a6fd-bb57-4f99-9236-8905ba89a16a /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-14f83146-2b5b-4643-960c-d9812b29d4ac
Apr 10 13:16:05 devstack sudo[88353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:05 devstack sudo[88348]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:05 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-56e9d570-b8c6-4632-9bba-9944414494fb tempest-VolumesExtendTest-27412717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.475s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:05 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-56e9d570-b8c6-4632-9bba-9944414494fb tempest-VolumesExtendTest-27412717 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:16:05 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-56e9d570-b8c6-4632-9bba-9944414494fb tempest-VolumesExtendTest-27412717 None] Deleted volume successfully.
Apr 10 13:16:05 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-56e9d570-b8c6-4632-9bba-9944414494fb tempest-VolumesExtendTest-27412717 None] Lock "cinder-94794e9e-8a79-46ba-9fb4-20681ce1fc3d-delete_volume" released by "delete_volume" :: held 1.569s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:16:07 devstack sudo[88353]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:07 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ac6f04e7-e0ee-458e-a6fc-e3e4094ec2a3 tempest-VolumesCloneTest-1104349490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-bca8a6fd-bb57-4f99-9236-8905ba89a16a /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-14f83146-2b5b-4643-960c-d9812b29d4ac" returned: 0 in 2.308s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:07 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4289636-6be8-4c92-9eaf-0c4adac141d5]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:16:07 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ac6f04e7-e0ee-458e-a6fc-e3e4094ec2a3 tempest-VolumesCloneTest-1104349490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-bca8a6fd-bb57-4f99-9236-8905ba89a16a {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:08 devstack sudo[88367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-bca8a6fd-bb57-4f99-9236-8905ba89a16a
Apr 10 13:16:08 devstack sudo[88367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:08 devstack sudo[88367]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:08 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ac6f04e7-e0ee-458e-a6fc-e3e4094ec2a3 tempest-VolumesCloneTest-1104349490 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-bca8a6fd-bb57-4f99-9236-8905ba89a16a" returned: 0 in 0.649s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:08 devstack cinder-volume[83345]: DEBUG cinder.image.image_utils [None req-ac6f04e7-e0ee-458e-a6fc-e3e4094ec2a3 tempest-VolumesCloneTest-1104349490 None] Image conversion details: src /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-bca8a6fd-bb57-4f99-9236-8905ba89a16a, size 1024.00 MB, duration 2.31 sec, destination /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-14f83146-2b5b-4643-960c-d9812b29d4ac {{(pid=83345) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 10 13:16:08 devstack cinder-volume[83345]: INFO cinder.image.image_utils [None req-ac6f04e7-e0ee-458e-a6fc-e3e4094ec2a3 tempest-VolumesCloneTest-1104349490 None] Converted 1024.00 MB image at 443.49 MB/s
Apr 10 13:16:08 devstack cinder-volume[83345]: WARNING cinder.volume.drivers.remotefs [None req-ac6f04e7-e0ee-458e-a6fc-e3e4094ec2a3 tempest-VolumesCloneTest-1104349490 None] /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-14f83146-2b5b-4643-960c-d9812b29d4ac is being set with open permissions: ugo+rw
Apr 10 13:16:08 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ac6f04e7-e0ee-458e-a6fc-e3e4094ec2a3 tempest-VolumesCloneTest-1104349490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-14f83146-2b5b-4643-960c-d9812b29d4ac {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:08 devstack sudo[88372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-14f83146-2b5b-4643-960c-d9812b29d4ac
Apr 10 13:16:08 devstack sudo[88372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:09 devstack sudo[88372]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:09 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ac6f04e7-e0ee-458e-a6fc-e3e4094ec2a3 tempest-VolumesCloneTest-1104349490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-14f83146-2b5b-4643-960c-d9812b29d4ac" returned: 0 in 0.461s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:09 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-ac6f04e7-e0ee-458e-a6fc-e3e4094ec2a3 tempest-VolumesCloneTest-1104349490 None] Lock "cinder-quobyte-14f83146-2b5b-4643-960c-d9812b29d4ac" released by "_copy_volume_from_snapshot" :: held 4.443s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:16:09 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-ac6f04e7-e0ee-458e-a6fc-e3e4094ec2a3 tempest-VolumesCloneTest-1104349490 None] Acquiring lock "cinder-quobyte-fbc176ae-4ac1-4c9c-8058-b9f1e5a38c86" by "_delete_snapshot" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:16:09 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-ac6f04e7-e0ee-458e-a6fc-e3e4094ec2a3 tempest-VolumesCloneTest-1104349490 None] Lock "cinder-quobyte-fbc176ae-4ac1-4c9c-8058-b9f1e5a38c86" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:16:09 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-ac6f04e7-e0ee-458e-a6fc-e3e4094ec2a3 tempest-VolumesCloneTest-1104349490 None] Deleting offline snapshot fbc176ae-4ac1-4c9c-8058-b9f1e5a38c86 of volume bca8a6fd-bb57-4f99-9236-8905ba89a16a {{(pid=83345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 10 13:16:09 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-ac6f04e7-e0ee-458e-a6fc-e3e4094ec2a3 tempest-VolumesCloneTest-1104349490 None] snapshot_file for this snap is: volume-bca8a6fd-bb57-4f99-9236-8905ba89a16a.fbc176ae-4ac1-4c9c-8058-b9f1e5a38c86 {{(pid=83345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 10 13:16:09 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd343220-ac74-4509-9d18-9fb82123de11]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:16:09 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ac6f04e7-e0ee-458e-a6fc-e3e4094ec2a3 tempest-VolumesCloneTest-1104349490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-bca8a6fd-bb57-4f99-9236-8905ba89a16a.fbc176ae-4ac1-4c9c-8058-b9f1e5a38c86 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:09 devstack sudo[88375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-bca8a6fd-bb57-4f99-9236-8905ba89a16a.fbc176ae-4ac1-4c9c-8058-b9f1e5a38c86
Apr 10 13:16:09 devstack sudo[88375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:09 devstack sudo[88375]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:09 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ac6f04e7-e0ee-458e-a6fc-e3e4094ec2a3 tempest-VolumesCloneTest-1104349490 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-bca8a6fd-bb57-4f99-9236-8905ba89a16a.fbc176ae-4ac1-4c9c-8058-b9f1e5a38c86" returned: 0 in 0.536s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:09 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-ac6f04e7-e0ee-458e-a6fc-e3e4094ec2a3 tempest-VolumesCloneTest-1104349490 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bca8a6fd-bb57-4f99-9236-8905ba89a16a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 13:16:09 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd45fad9-9374-4c5d-a8f5-9c2aea4d1f43]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:16:09 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ac6f04e7-e0ee-458e-a6fc-e3e4094ec2a3 tempest-VolumesCloneTest-1104349490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-bca8a6fd-bb57-4f99-9236-8905ba89a16a {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:09 devstack sudo[88380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-bca8a6fd-bb57-4f99-9236-8905ba89a16a
Apr 10 13:16:09 devstack sudo[88380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:09 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-3891625d-29fc-4282-ab80-5834d9dca002 tempest-VolumesSnapshotListTestJSON-947768007 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:16:09 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-3891625d-29fc-4282-ab80-5834d9dca002 tempest-VolumesSnapshotListTestJSON-947768007 None] Flow 'volume_create_manager' (35999b75-2efb-467d-a04a-7f8a64235e88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:16:09 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-3891625d-29fc-4282-ab80-5834d9dca002 tempest-VolumesSnapshotListTestJSON-947768007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4a6b655-69f3-46cd-b85f-d0a9fe44f85a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:16:09 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-3891625d-29fc-4282-ab80-5834d9dca002 tempest-VolumesSnapshotListTestJSON-947768007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4a6b655-69f3-46cd-b85f-d0a9fe44f85a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:16:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1123869985',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4faf7785-29e6-4fbc-b559-705a84ceb769,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77e87fa609d44936aa6c98572654f2b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:16:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:16:10Z,use_quota=True,user_id='f0faa45e5e8d4697ad71178a5f9c399d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:16:09 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-3891625d-29fc-4282-ab80-5834d9dca002 tempest-VolumesSnapshotListTestJSON-947768007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fb491e3-e2d8-481f-825b-e0b01e7a4ac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:16:09 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-3891625d-29fc-4282-ab80-5834d9dca002 tempest-VolumesSnapshotListTestJSON-947768007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fb491e3-e2d8-481f-825b-e0b01e7a4ac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:16:09 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-3891625d-29fc-4282-ab80-5834d9dca002 tempest-VolumesSnapshotListTestJSON-947768007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (012e6107-8b63-4b23-9a19-cb7d06a6600e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:16:09 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-3891625d-29fc-4282-ab80-5834d9dca002 tempest-VolumesSnapshotListTestJSON-947768007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (012e6107-8b63-4b23-9a19-cb7d06a6600e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4faf7785-29e6-4fbc-b559-705a84ceb769', 'volume_name': 'volume-4faf7785-29e6-4fbc-b559-705a84ceb769', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:16:09 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-3891625d-29fc-4282-ab80-5834d9dca002 tempest-VolumesSnapshotListTestJSON-947768007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5833e6c6-f9fe-401c-aa2f-fb721ea9dd69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:16:09 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-3891625d-29fc-4282-ab80-5834d9dca002 tempest-VolumesSnapshotListTestJSON-947768007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5833e6c6-f9fe-401c-aa2f-fb721ea9dd69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:16:09 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-3891625d-29fc-4282-ab80-5834d9dca002 tempest-VolumesSnapshotListTestJSON-947768007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebe9d067-ef55-4750-9aab-9058221b579e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:16:09 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-3891625d-29fc-4282-ab80-5834d9dca002 tempest-VolumesSnapshotListTestJSON-947768007 None] Volume 4faf7785-29e6-4fbc-b559-705a84ceb769: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4faf7785-29e6-4fbc-b559-705a84ceb769', 'volume_size': 1}
Apr 10 13:16:09 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-3891625d-29fc-4282-ab80-5834d9dca002 tempest-VolumesSnapshotListTestJSON-947768007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:16:10 devstack sudo[88380]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:10 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ac6f04e7-e0ee-458e-a6fc-e3e4094ec2a3 tempest-VolumesCloneTest-1104349490 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-bca8a6fd-bb57-4f99-9236-8905ba89a16a" returned: 0 in 0.500s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:10 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ac6f04e7-e0ee-458e-a6fc-e3e4094ec2a3 tempest-VolumesCloneTest-1104349490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-bca8a6fd-bb57-4f99-9236-8905ba89a16a.fbc176ae-4ac1-4c9c-8058-b9f1e5a38c86 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:10 devstack sudo[88385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-bca8a6fd-bb57-4f99-9236-8905ba89a16a.fbc176ae-4ac1-4c9c-8058-b9f1e5a38c86
Apr 10 13:16:10 devstack sudo[88385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:10 devstack sudo[88385]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:10 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ac6f04e7-e0ee-458e-a6fc-e3e4094ec2a3 tempest-VolumesCloneTest-1104349490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-bca8a6fd-bb57-4f99-9236-8905ba89a16a.fbc176ae-4ac1-4c9c-8058-b9f1e5a38c86" returned: 0 in 0.453s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:10 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ac6f04e7-e0ee-458e-a6fc-e3e4094ec2a3 tempest-VolumesCloneTest-1104349490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-bca8a6fd-bb57-4f99-9236-8905ba89a16a.fbc176ae-4ac1-4c9c-8058-b9f1e5a38c86 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:10 devstack sudo[88390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-bca8a6fd-bb57-4f99-9236-8905ba89a16a.fbc176ae-4ac1-4c9c-8058-b9f1e5a38c86
Apr 10 13:16:10 devstack sudo[88390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:11 devstack sudo[88390]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:11 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ac6f04e7-e0ee-458e-a6fc-e3e4094ec2a3 tempest-VolumesCloneTest-1104349490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-bca8a6fd-bb57-4f99-9236-8905ba89a16a.fbc176ae-4ac1-4c9c-8058-b9f1e5a38c86" returned: 0 in 0.417s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:11 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-ac6f04e7-e0ee-458e-a6fc-e3e4094ec2a3 tempest-VolumesCloneTest-1104349490 None] Lock "cinder-quobyte-fbc176ae-4ac1-4c9c-8058-b9f1e5a38c86" released by "_delete_snapshot" :: held 1.960s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:16:11 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-ac6f04e7-e0ee-458e-a6fc-e3e4094ec2a3 tempest-VolumesCloneTest-1104349490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.258s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:16:11 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-7e848170-12fd-408a-99a2-f40af1808f11 tempest-VolumesGetTest-1325070593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.289s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:16:11 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-7e848170-12fd-408a-99a2-f40af1808f11 tempest-VolumesGetTest-1325070593 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f252bf08b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:16:01Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1915647700',display_name='tempest-VolumesGetTest-Volume-1354625700',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab28e917-4854-4a30-bdd1-e913ac487535,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2164901a19c74ad5a7ac47fa92772df3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:16:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:16:01Z,use_quota=True,user_id='e6a465b820764bf78e3ec91bbb896b7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)}" {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 13:16:11 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-7e848170-12fd-408a-99a2-f40af1808f11 tempest-VolumesGetTest-1325070593 None] Creating volume ab28e917-4854-4a30-bdd1-e913ac487535 {{(pid=83345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 13:16:11 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-7e848170-12fd-408a-99a2-f40af1808f11 tempest-VolumesGetTest-1325070593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:16:11 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-7e848170-12fd-408a-99a2-f40af1808f11 tempest-VolumesGetTest-1325070593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:16:11 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-7e848170-12fd-408a-99a2-f40af1808f11 tempest-VolumesGetTest-1325070593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:16:11 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-7e848170-12fd-408a-99a2-f40af1808f11 tempest-VolumesGetTest-1325070593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:16:11 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-7e848170-12fd-408a-99a2-f40af1808f11 tempest-VolumesGetTest-1325070593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:16:11 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-7e848170-12fd-408a-99a2-f40af1808f11 tempest-VolumesGetTest-1325070593 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:16:11 devstack cinder-volume[83345]: INFO cinder.volume.drivers.remotefs [None req-7e848170-12fd-408a-99a2-f40af1808f11 tempest-VolumesGetTest-1325070593 None] casted to osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331
Apr 10 13:16:11 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-7e848170-12fd-408a-99a2-f40af1808f11 tempest-VolumesGetTest-1325070593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-ab28e917-4854-4a30-bdd1-e913ac487535 1073741824 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:11 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ac6f04e7-e0ee-458e-a6fc-e3e4094ec2a3 tempest-VolumesCloneTest-1104349490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (887a8e33-5542-431f-ba8b-39255e3a41cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14f83146-2b5b-4643-960c-d9812b29d4ac', 'volume_size': 2, 'source_volid': 'bca8a6fd-bb57-4f99-9236-8905ba89a16a', 'source_volstatus': 'available'}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:16:11 devstack sudo[88393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-ab28e917-4854-4a30-bdd1-e913ac487535 1073741824
Apr 10 13:16:11 devstack sudo[88393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:11 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ac6f04e7-e0ee-458e-a6fc-e3e4094ec2a3 tempest-VolumesCloneTest-1104349490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1828211b-2ec5-46e0-a4df-9a8333b9b68f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:16:11 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-ac6f04e7-e0ee-458e-a6fc-e3e4094ec2a3 tempest-VolumesCloneTest-1104349490 None] Volume volume-14f83146-2b5b-4643-960c-d9812b29d4ac (14f83146-2b5b-4643-960c-d9812b29d4ac): created successfully
Apr 10 13:16:11 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ac6f04e7-e0ee-458e-a6fc-e3e4094ec2a3 tempest-VolumesCloneTest-1104349490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1828211b-2ec5-46e0-a4df-9a8333b9b68f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:16:11 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ac6f04e7-e0ee-458e-a6fc-e3e4094ec2a3 tempest-VolumesCloneTest-1104349490 None] Flow 'volume_create_manager' (5a246e72-c429-4e81-b1c1-6efc991c6c5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:16:11 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-ac6f04e7-e0ee-458e-a6fc-e3e4094ec2a3 tempest-VolumesCloneTest-1104349490 None] Created volume successfully.
Apr 10 13:16:11 devstack sudo[88393]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:11 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-7e848170-12fd-408a-99a2-f40af1808f11 tempest-VolumesGetTest-1325070593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-ab28e917-4854-4a30-bdd1-e913ac487535 1073741824" returned: 0 in 0.506s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:11 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-7e848170-12fd-408a-99a2-f40af1808f11 tempest-VolumesGetTest-1325070593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-ab28e917-4854-4a30-bdd1-e913ac487535 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:11 devstack sudo[88399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-ab28e917-4854-4a30-bdd1-e913ac487535
Apr 10 13:16:11 devstack sudo[88399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:12 devstack sudo[88399]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:12 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-7e848170-12fd-408a-99a2-f40af1808f11 tempest-VolumesGetTest-1325070593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-ab28e917-4854-4a30-bdd1-e913ac487535" returned: 0 in 0.414s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:12 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-7e848170-12fd-408a-99a2-f40af1808f11 tempest-VolumesGetTest-1325070593 None] <== create_volume: return (941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'} {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 13:16:12 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-7e848170-12fd-408a-99a2-f40af1808f11 tempest-VolumesGetTest-1325070593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.944s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:16:12 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-f24aa791-1aa7-4768-859f-74ed66bca9ce tempest-SnapshotsActionsTest-802738678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 10.110s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:16:12 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-7e848170-12fd-408a-99a2-f40af1808f11 tempest-VolumesGetTest-1325070593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5aa30beb-e5c6-4f39-87fb-294611d1a32b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab28e917-4854-4a30-bdd1-e913ac487535', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:16:12 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-7e848170-12fd-408a-99a2-f40af1808f11 tempest-VolumesGetTest-1325070593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5152281f-c558-4332-a8a7-bf15c6a2b6b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:16:12 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-f24aa791-1aa7-4768-859f-74ed66bca9ce tempest-SnapshotsActionsTest-802738678 None] Creating offline snapshot 4f5b55c6-a3ad-4794-8bb5-40a452cfc583 of volume 4f013013-ffcb-4dd4-8e73-3e004e4c6f11 {{(pid=83345) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 10 13:16:12 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-7e848170-12fd-408a-99a2-f40af1808f11 tempest-VolumesGetTest-1325070593 None] Volume volume-ab28e917-4854-4a30-bdd1-e913ac487535 (ab28e917-4854-4a30-bdd1-e913ac487535): created successfully
Apr 10 13:16:12 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-7e848170-12fd-408a-99a2-f40af1808f11 tempest-VolumesGetTest-1325070593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5152281f-c558-4332-a8a7-bf15c6a2b6b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:16:12 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-7e848170-12fd-408a-99a2-f40af1808f11 tempest-VolumesGetTest-1325070593 None] Flow 'volume_create_manager' (e57f24ad-168d-46d8-862e-496e83d3b7e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:16:12 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9ba45ae-d346-4755-abb6-10eab17de128]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:16:12 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-f24aa791-1aa7-4768-859f-74ed66bca9ce tempest-SnapshotsActionsTest-802738678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:12 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-7e848170-12fd-408a-99a2-f40af1808f11 tempest-VolumesGetTest-1325070593 None] Created volume successfully.
Apr 10 13:16:12 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-3e9b62d0-5f88-410f-a3b2-a1aaaa9f771f tempest-VolumesCloneTest-1104349490 None] Acquiring lock "cinder-14f83146-2b5b-4643-960c-d9812b29d4ac-delete_volume" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:16:12 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-3e9b62d0-5f88-410f-a3b2-a1aaaa9f771f tempest-VolumesCloneTest-1104349490 None] Lock "cinder-14f83146-2b5b-4643-960c-d9812b29d4ac-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:16:12 devstack sudo[88402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11
Apr 10 13:16:12 devstack sudo[88402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:12 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-3e9b62d0-5f88-410f-a3b2-a1aaaa9f771f tempest-VolumesCloneTest-1104349490 None] Acquiring lock "cinder-quobyte-14f83146-2b5b-4643-960c-d9812b29d4ac" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:16:12 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-3e9b62d0-5f88-410f-a3b2-a1aaaa9f771f tempest-VolumesCloneTest-1104349490 None] Lock "cinder-quobyte-14f83146-2b5b-4643-960c-d9812b29d4ac" acquired by "delete_volume" :: waited 0.010s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:16:12 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[58acc5c0-e540-4ca7-b414-02b64d2f88c6]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:16:12 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-3e9b62d0-5f88-410f-a3b2-a1aaaa9f771f tempest-VolumesCloneTest-1104349490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-14f83146-2b5b-4643-960c-d9812b29d4ac {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:12 devstack sudo[88404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-14f83146-2b5b-4643-960c-d9812b29d4ac
Apr 10 13:16:12 devstack sudo[88404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:12 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-0184fc7c-97a9-4378-99a2-862b03116d34 tempest-VolumesGetTest-1325070593 None] Acquiring lock "cinder-ab28e917-4854-4a30-bdd1-e913ac487535-delete_volume" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:16:12 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-0184fc7c-97a9-4378-99a2-862b03116d34 tempest-VolumesGetTest-1325070593 None] Lock "cinder-ab28e917-4854-4a30-bdd1-e913ac487535-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:16:12 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-0184fc7c-97a9-4378-99a2-862b03116d34 tempest-VolumesGetTest-1325070593 None] Acquiring lock "cinder-quobyte-ab28e917-4854-4a30-bdd1-e913ac487535" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:16:12 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-0184fc7c-97a9-4378-99a2-862b03116d34 tempest-VolumesGetTest-1325070593 None] Lock "cinder-quobyte-ab28e917-4854-4a30-bdd1-e913ac487535" acquired by "delete_volume" :: waited 0.008s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:16:12 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[024064d7-6730-4fa8-9b3f-7b6a4a3e771c]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:16:12 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-0184fc7c-97a9-4378-99a2-862b03116d34 tempest-VolumesGetTest-1325070593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-ab28e917-4854-4a30-bdd1-e913ac487535 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:12 devstack sudo[88402]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:12 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-f24aa791-1aa7-4768-859f-74ed66bca9ce tempest-SnapshotsActionsTest-802738678 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11" returned: 0 in 0.534s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:12 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-f24aa791-1aa7-4768-859f-74ed66bca9ce tempest-SnapshotsActionsTest-802738678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.4f5b55c6-a3ad-4794-8bb5-40a452cfc583 1G {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:12 devstack sudo[88413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.4f5b55c6-a3ad-4794-8bb5-40a452cfc583 1G
Apr 10 13:16:12 devstack sudo[88413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:12 devstack sudo[88409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-ab28e917-4854-4a30-bdd1-e913ac487535
Apr 10 13:16:12 devstack sudo[88409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:12 devstack sudo[88404]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:12 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-3e9b62d0-5f88-410f-a3b2-a1aaaa9f771f tempest-VolumesCloneTest-1104349490 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-14f83146-2b5b-4643-960c-d9812b29d4ac" returned: 0 in 0.504s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:12 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-3e9b62d0-5f88-410f-a3b2-a1aaaa9f771f tempest-VolumesCloneTest-1104349490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-14f83146-2b5b-4643-960c-d9812b29d4ac {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:12 devstack sudo[88416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-14f83146-2b5b-4643-960c-d9812b29d4ac
Apr 10 13:16:12 devstack sudo[88416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:13 devstack sudo[88409]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:13 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-0184fc7c-97a9-4378-99a2-862b03116d34 tempest-VolumesGetTest-1325070593 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-ab28e917-4854-4a30-bdd1-e913ac487535" returned: 0 in 0.489s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:13 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-0184fc7c-97a9-4378-99a2-862b03116d34 tempest-VolumesGetTest-1325070593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-ab28e917-4854-4a30-bdd1-e913ac487535 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:13 devstack sudo[88425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-ab28e917-4854-4a30-bdd1-e913ac487535
Apr 10 13:16:13 devstack sudo[88425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:13 devstack sudo[88413]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:13 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-f24aa791-1aa7-4768-859f-74ed66bca9ce tempest-SnapshotsActionsTest-802738678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.4f5b55c6-a3ad-4794-8bb5-40a452cfc583 1G" returned: 0 in 0.493s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:13 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-f24aa791-1aa7-4768-859f-74ed66bca9ce tempest-SnapshotsActionsTest-802738678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11 -F qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.4f5b55c6-a3ad-4794-8bb5-40a452cfc583 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:13 devstack sudo[88416]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:13 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-3e9b62d0-5f88-410f-a3b2-a1aaaa9f771f tempest-VolumesCloneTest-1104349490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-14f83146-2b5b-4643-960c-d9812b29d4ac" returned: 0 in 0.439s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:13 devstack sudo[88427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11 -F qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.4f5b55c6-a3ad-4794-8bb5-40a452cfc583
Apr 10 13:16:13 devstack sudo[88427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:13 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-3e9b62d0-5f88-410f-a3b2-a1aaaa9f771f tempest-VolumesCloneTest-1104349490 None] Lock "cinder-quobyte-14f83146-2b5b-4643-960c-d9812b29d4ac" released by "delete_volume" :: held 0.963s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:16:13 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-3e9b62d0-5f88-410f-a3b2-a1aaaa9f771f tempest-VolumesCloneTest-1104349490 None] Created reservations ['8e96f585-0375-4deb-87c2-66e694c273c9', '4780d956-4163-4509-93db-6b8082bfff28', 'b3a69d58-9ed6-499c-afdc-8c3ade02d588', '810105ca-c2c3-40d6-b7ac-cfc495862e30'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:16:13 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-3e9b62d0-5f88-410f-a3b2-a1aaaa9f771f tempest-VolumesCloneTest-1104349490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:16:13 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-3e9b62d0-5f88-410f-a3b2-a1aaaa9f771f tempest-VolumesCloneTest-1104349490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:16:13 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-3e9b62d0-5f88-410f-a3b2-a1aaaa9f771f tempest-VolumesCloneTest-1104349490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:16:13 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-3e9b62d0-5f88-410f-a3b2-a1aaaa9f771f tempest-VolumesCloneTest-1104349490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:16:13 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-3e9b62d0-5f88-410f-a3b2-a1aaaa9f771f tempest-VolumesCloneTest-1104349490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:16:13 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-3e9b62d0-5f88-410f-a3b2-a1aaaa9f771f tempest-VolumesCloneTest-1104349490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:13 devstack sudo[88429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:16:13 devstack sudo[88429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:13 devstack sudo[88425]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:13 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-0184fc7c-97a9-4378-99a2-862b03116d34 tempest-VolumesGetTest-1325070593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-ab28e917-4854-4a30-bdd1-e913ac487535" returned: 0 in 0.436s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:13 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-0184fc7c-97a9-4378-99a2-862b03116d34 tempest-VolumesGetTest-1325070593 None] Lock "cinder-quobyte-ab28e917-4854-4a30-bdd1-e913ac487535" released by "delete_volume" :: held 0.947s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:16:13 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-0184fc7c-97a9-4378-99a2-862b03116d34 tempest-VolumesGetTest-1325070593 None] Created reservations ['bd461da7-1e46-45f2-943f-a746ea0fe81e', 'c7b56f67-bdb1-4106-b72e-34738c312442', '558e3870-ca8e-47c5-b6ab-940d60acacb2', 'b345b0e1-2d87-4a95-a34e-228204e8fbf5'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:16:13 devstack sudo[88427]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:13 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-f24aa791-1aa7-4768-859f-74ed66bca9ce tempest-SnapshotsActionsTest-802738678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11 -F qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.4f5b55c6-a3ad-4794-8bb5-40a452cfc583" returned: 0 in 0.456s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:13 devstack cinder-volume[83345]: WARNING cinder.volume.drivers.remotefs [None req-f24aa791-1aa7-4768-859f-74ed66bca9ce tempest-SnapshotsActionsTest-802738678 None] /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.4f5b55c6-a3ad-4794-8bb5-40a452cfc583 is being set with open permissions: ugo+rw
Apr 10 13:16:13 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-f24aa791-1aa7-4768-859f-74ed66bca9ce tempest-SnapshotsActionsTest-802738678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.4f5b55c6-a3ad-4794-8bb5-40a452cfc583 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:13 devstack sudo[88435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.4f5b55c6-a3ad-4794-8bb5-40a452cfc583
Apr 10 13:16:13 devstack sudo[88435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:13 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-0184fc7c-97a9-4378-99a2-862b03116d34 tempest-VolumesGetTest-1325070593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:16:13 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-0184fc7c-97a9-4378-99a2-862b03116d34 tempest-VolumesGetTest-1325070593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:16:13 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-0184fc7c-97a9-4378-99a2-862b03116d34 tempest-VolumesGetTest-1325070593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:16:13 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-0184fc7c-97a9-4378-99a2-862b03116d34 tempest-VolumesGetTest-1325070593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:16:13 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-0184fc7c-97a9-4378-99a2-862b03116d34 tempest-VolumesGetTest-1325070593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:16:13 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-0184fc7c-97a9-4378-99a2-862b03116d34 tempest-VolumesGetTest-1325070593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:13 devstack sudo[88438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:16:13 devstack sudo[88438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:13 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-a22077cb-67a0-4652-ac6b-a848ae4d7653 tempest-VolumesGetTest-1325070593 None] Acquiring lock "cinder-e1542b8a-a5fe-4e27-ba4a-74abacec48a4-delete_volume" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:16:13 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-a22077cb-67a0-4652-ac6b-a848ae4d7653 tempest-VolumesGetTest-1325070593 None] Lock "cinder-e1542b8a-a5fe-4e27-ba4a-74abacec48a4-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:16:13 devstack sudo[88429]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:13 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-3e9b62d0-5f88-410f-a3b2-a1aaaa9f771f tempest-VolumesCloneTest-1104349490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.494s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:13 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-3e9b62d0-5f88-410f-a3b2-a1aaaa9f771f tempest-VolumesCloneTest-1104349490 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:16:13 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-a22077cb-67a0-4652-ac6b-a848ae4d7653 tempest-VolumesGetTest-1325070593 None] Acquiring lock "cinder-quobyte-e1542b8a-a5fe-4e27-ba4a-74abacec48a4" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:16:13 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-3e9b62d0-5f88-410f-a3b2-a1aaaa9f771f tempest-VolumesCloneTest-1104349490 None] Deleted volume successfully.
Apr 10 13:16:13 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-a22077cb-67a0-4652-ac6b-a848ae4d7653 tempest-VolumesGetTest-1325070593 None] Lock "cinder-quobyte-e1542b8a-a5fe-4e27-ba4a-74abacec48a4" acquired by "delete_volume" :: waited 0.015s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:16:13 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-3e9b62d0-5f88-410f-a3b2-a1aaaa9f771f tempest-VolumesCloneTest-1104349490 None] Lock "cinder-14f83146-2b5b-4643-960c-d9812b29d4ac-delete_volume" released by "delete_volume" :: held 1.626s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:16:13 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[af073ebc-6c00-4ff6-9160-1a928634d2dd]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:16:13 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-a22077cb-67a0-4652-ac6b-a848ae4d7653 tempest-VolumesGetTest-1325070593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e1542b8a-a5fe-4e27-ba4a-74abacec48a4 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:13 devstack sudo[88440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e1542b8a-a5fe-4e27-ba4a-74abacec48a4
Apr 10 13:16:13 devstack sudo[88440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:14 devstack sudo[88435]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:14 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-f24aa791-1aa7-4768-859f-74ed66bca9ce tempest-SnapshotsActionsTest-802738678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.4f5b55c6-a3ad-4794-8bb5-40a452cfc583" returned: 0 in 0.475s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:14 devstack sudo[88438]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:14 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-0184fc7c-97a9-4378-99a2-862b03116d34 tempest-VolumesGetTest-1325070593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.453s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:14 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-f24aa791-1aa7-4768-859f-74ed66bca9ce tempest-SnapshotsActionsTest-802738678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.info {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:14 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-0184fc7c-97a9-4378-99a2-862b03116d34 tempest-VolumesGetTest-1325070593 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:16:14 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-0184fc7c-97a9-4378-99a2-862b03116d34 tempest-VolumesGetTest-1325070593 None] Deleted volume successfully.
Apr 10 13:16:14 devstack sudo[88444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.info
Apr 10 13:16:14 devstack sudo[88444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:14 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-0184fc7c-97a9-4378-99a2-862b03116d34 tempest-VolumesGetTest-1325070593 None] Lock "cinder-ab28e917-4854-4a30-bdd1-e913ac487535-delete_volume" released by "delete_volume" :: held 1.563s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:16:14 devstack sudo[88440]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:14 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-a22077cb-67a0-4652-ac6b-a848ae4d7653 tempest-VolumesGetTest-1325070593 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e1542b8a-a5fe-4e27-ba4a-74abacec48a4" returned: 0 in 0.512s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:14 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-a22077cb-67a0-4652-ac6b-a848ae4d7653 tempest-VolumesGetTest-1325070593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e1542b8a-a5fe-4e27-ba4a-74abacec48a4 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:14 devstack sudo[88449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e1542b8a-a5fe-4e27-ba4a-74abacec48a4
Apr 10 13:16:14 devstack sudo[88449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:14 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-8e401ac5-7834-40c2-8765-1cb06bd78d9a tempest-VolumesCloneTest-1104349490 None] Acquiring lock "cinder-bca8a6fd-bb57-4f99-9236-8905ba89a16a-delete_volume" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:16:14 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-8e401ac5-7834-40c2-8765-1cb06bd78d9a tempest-VolumesCloneTest-1104349490 None] Lock "cinder-bca8a6fd-bb57-4f99-9236-8905ba89a16a-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:16:14 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-8e401ac5-7834-40c2-8765-1cb06bd78d9a tempest-VolumesCloneTest-1104349490 None] Acquiring lock "cinder-quobyte-bca8a6fd-bb57-4f99-9236-8905ba89a16a" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:16:14 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-8e401ac5-7834-40c2-8765-1cb06bd78d9a tempest-VolumesCloneTest-1104349490 None] Lock "cinder-quobyte-bca8a6fd-bb57-4f99-9236-8905ba89a16a" acquired by "delete_volume" :: waited 0.008s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:16:14 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa892ad6-99f0-41c0-a090-b72ecb02f686]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:16:14 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-8e401ac5-7834-40c2-8765-1cb06bd78d9a tempest-VolumesCloneTest-1104349490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-bca8a6fd-bb57-4f99-9236-8905ba89a16a {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:14 devstack sudo[88451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-bca8a6fd-bb57-4f99-9236-8905ba89a16a
Apr 10 13:16:14 devstack sudo[88451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:14 devstack sudo[88444]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:14 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-f24aa791-1aa7-4768-859f-74ed66bca9ce tempest-SnapshotsActionsTest-802738678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.info" returned: 0 in 0.458s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:14 devstack cinder-volume[83345]: WARNING cinder.volume.drivers.remotefs [None req-f24aa791-1aa7-4768-859f-74ed66bca9ce tempest-SnapshotsActionsTest-802738678 None] /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.info is being set with open permissions: ugo+rw
Apr 10 13:16:14 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-f24aa791-1aa7-4768-859f-74ed66bca9ce tempest-SnapshotsActionsTest-802738678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.info {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:14 devstack sudo[88454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.info
Apr 10 13:16:14 devstack sudo[88454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:14 devstack sudo[88449]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:14 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-a22077cb-67a0-4652-ac6b-a848ae4d7653 tempest-VolumesGetTest-1325070593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e1542b8a-a5fe-4e27-ba4a-74abacec48a4" returned: 0 in 0.440s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:14 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-a22077cb-67a0-4652-ac6b-a848ae4d7653 tempest-VolumesGetTest-1325070593 None] Lock "cinder-quobyte-e1542b8a-a5fe-4e27-ba4a-74abacec48a4" released by "delete_volume" :: held 0.979s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:16:14 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-a22077cb-67a0-4652-ac6b-a848ae4d7653 tempest-VolumesGetTest-1325070593 None] Created reservations ['bbcc1503-0720-4c01-a888-dab38f6b24e7', '5c4425f0-4c11-4e8b-893a-18ced6dcfb28', '0c223a35-e4df-4048-8588-cbb941af84f6', 'c3cf5f49-b043-4af4-911b-b47c06901c0a'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:16:14 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-a22077cb-67a0-4652-ac6b-a848ae4d7653 tempest-VolumesGetTest-1325070593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:16:14 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-a22077cb-67a0-4652-ac6b-a848ae4d7653 tempest-VolumesGetTest-1325070593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:16:14 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-a22077cb-67a0-4652-ac6b-a848ae4d7653 tempest-VolumesGetTest-1325070593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:16:14 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-a22077cb-67a0-4652-ac6b-a848ae4d7653 tempest-VolumesGetTest-1325070593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:16:14 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-a22077cb-67a0-4652-ac6b-a848ae4d7653 tempest-VolumesGetTest-1325070593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:16:14 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-a22077cb-67a0-4652-ac6b-a848ae4d7653 tempest-VolumesGetTest-1325070593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:14 devstack sudo[88457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:16:14 devstack sudo[88457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:14 devstack sudo[88451]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:14 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-8e401ac5-7834-40c2-8765-1cb06bd78d9a tempest-VolumesCloneTest-1104349490 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-bca8a6fd-bb57-4f99-9236-8905ba89a16a" returned: 0 in 0.522s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:14 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-8e401ac5-7834-40c2-8765-1cb06bd78d9a tempest-VolumesCloneTest-1104349490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-bca8a6fd-bb57-4f99-9236-8905ba89a16a {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:14 devstack sudo[88454]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:14 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-f24aa791-1aa7-4768-859f-74ed66bca9ce tempest-SnapshotsActionsTest-802738678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.info" returned: 0 in 0.438s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:14 devstack sudo[88463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-bca8a6fd-bb57-4f99-9236-8905ba89a16a
Apr 10 13:16:14 devstack sudo[88463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:14 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-f24aa791-1aa7-4768-859f-74ed66bca9ce tempest-SnapshotsActionsTest-802738678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.929s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:16:14 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-3891625d-29fc-4282-ab80-5834d9dca002 tempest-VolumesSnapshotListTestJSON-947768007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.108s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:16:14 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-3891625d-29fc-4282-ab80-5834d9dca002 tempest-VolumesSnapshotListTestJSON-947768007 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f252bf08b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:16:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1123869985',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4faf7785-29e6-4fbc-b559-705a84ceb769,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77e87fa609d44936aa6c98572654f2b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:16:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:16:10Z,use_quota=True,user_id='f0faa45e5e8d4697ad71178a5f9c399d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)}" {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 13:16:14 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-3891625d-29fc-4282-ab80-5834d9dca002 tempest-VolumesSnapshotListTestJSON-947768007 None] Creating volume 4faf7785-29e6-4fbc-b559-705a84ceb769 {{(pid=83345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 13:16:14 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-3891625d-29fc-4282-ab80-5834d9dca002 tempest-VolumesSnapshotListTestJSON-947768007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:16:14 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-3891625d-29fc-4282-ab80-5834d9dca002 tempest-VolumesSnapshotListTestJSON-947768007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:16:14 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-3891625d-29fc-4282-ab80-5834d9dca002 tempest-VolumesSnapshotListTestJSON-947768007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:16:14 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-3891625d-29fc-4282-ab80-5834d9dca002 tempest-VolumesSnapshotListTestJSON-947768007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:16:14 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-3891625d-29fc-4282-ab80-5834d9dca002 tempest-VolumesSnapshotListTestJSON-947768007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:16:14 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-3891625d-29fc-4282-ab80-5834d9dca002 tempest-VolumesSnapshotListTestJSON-947768007 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:16:14 devstack cinder-volume[83345]: INFO cinder.volume.drivers.remotefs [None req-3891625d-29fc-4282-ab80-5834d9dca002 tempest-VolumesSnapshotListTestJSON-947768007 None] casted to osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331
Apr 10 13:16:14 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-3891625d-29fc-4282-ab80-5834d9dca002 tempest-VolumesSnapshotListTestJSON-947768007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4faf7785-29e6-4fbc-b559-705a84ceb769 1073741824 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:15 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-f24aa791-1aa7-4768-859f-74ed66bca9ce tempest-SnapshotsActionsTest-802738678 None] Create snapshot completed successfully
Apr 10 13:16:15 devstack sudo[88465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4faf7785-29e6-4fbc-b559-705a84ceb769 1073741824
Apr 10 13:16:15 devstack sudo[88465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:15 devstack sudo[88457]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:15 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-a22077cb-67a0-4652-ac6b-a848ae4d7653 tempest-VolumesGetTest-1325070593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.435s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:15 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-a22077cb-67a0-4652-ac6b-a848ae4d7653 tempest-VolumesGetTest-1325070593 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:16:15 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-a22077cb-67a0-4652-ac6b-a848ae4d7653 tempest-VolumesGetTest-1325070593 None] Deleted volume successfully.
Apr 10 13:16:15 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-a22077cb-67a0-4652-ac6b-a848ae4d7653 tempest-VolumesGetTest-1325070593 None] Lock "cinder-e1542b8a-a5fe-4e27-ba4a-74abacec48a4-delete_volume" released by "delete_volume" :: held 1.587s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:16:15 devstack sudo[88463]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:15 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-8e401ac5-7834-40c2-8765-1cb06bd78d9a tempest-VolumesCloneTest-1104349490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-bca8a6fd-bb57-4f99-9236-8905ba89a16a" returned: 0 in 0.419s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:15 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-8e401ac5-7834-40c2-8765-1cb06bd78d9a tempest-VolumesCloneTest-1104349490 None] Lock "cinder-quobyte-bca8a6fd-bb57-4f99-9236-8905ba89a16a" released by "delete_volume" :: held 0.972s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:16:15 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-8e401ac5-7834-40c2-8765-1cb06bd78d9a tempest-VolumesCloneTest-1104349490 None] Created reservations ['44f544f3-0642-4169-a690-e7314776d027', '6b701fa8-19ca-4bc7-b647-3a563e97b47c', 'd209d55f-b13e-40fd-a45f-9c9532f7cdf9', 'e589fa04-be84-44a7-ad1d-df5289627409'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:16:15 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-8e401ac5-7834-40c2-8765-1cb06bd78d9a tempest-VolumesCloneTest-1104349490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:16:15 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-8e401ac5-7834-40c2-8765-1cb06bd78d9a tempest-VolumesCloneTest-1104349490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:16:15 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-8e401ac5-7834-40c2-8765-1cb06bd78d9a tempest-VolumesCloneTest-1104349490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:16:15 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-8e401ac5-7834-40c2-8765-1cb06bd78d9a tempest-VolumesCloneTest-1104349490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:16:15 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-8e401ac5-7834-40c2-8765-1cb06bd78d9a tempest-VolumesCloneTest-1104349490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:16:15 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-8e401ac5-7834-40c2-8765-1cb06bd78d9a tempest-VolumesCloneTest-1104349490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:15 devstack sudo[88472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:16:15 devstack sudo[88472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:15 devstack sudo[88465]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:15 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-3891625d-29fc-4282-ab80-5834d9dca002 tempest-VolumesSnapshotListTestJSON-947768007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4faf7785-29e6-4fbc-b559-705a84ceb769 1073741824" returned: 0 in 0.577s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:15 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-3891625d-29fc-4282-ab80-5834d9dca002 tempest-VolumesSnapshotListTestJSON-947768007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4faf7785-29e6-4fbc-b559-705a84ceb769 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:15 devstack sudo[88474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4faf7785-29e6-4fbc-b559-705a84ceb769
Apr 10 13:16:15 devstack sudo[88474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:15 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-a2172500-0b11-46d9-899c-b15f1b0c19ce tempest-SnapshotsActionsTest-802738678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:16:15 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-3dbd6c5e-1ac4-4594-b1e1-03e16c21636d tempest-VolumesGetTest-1325070593 None] Acquiring lock "cinder-e3c57b6e-ddf6-4382-9d46-8a8c9722c588-delete_volume" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:16:15 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-3dbd6c5e-1ac4-4594-b1e1-03e16c21636d tempest-VolumesGetTest-1325070593 None] Lock "cinder-e3c57b6e-ddf6-4382-9d46-8a8c9722c588-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:16:15 devstack sudo[88472]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:15 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-8e401ac5-7834-40c2-8765-1cb06bd78d9a tempest-VolumesCloneTest-1104349490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.476s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:15 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-8e401ac5-7834-40c2-8765-1cb06bd78d9a tempest-VolumesCloneTest-1104349490 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:16:15 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-8e401ac5-7834-40c2-8765-1cb06bd78d9a tempest-VolumesCloneTest-1104349490 None] Deleted volume successfully.
Apr 10 13:16:15 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-3dbd6c5e-1ac4-4594-b1e1-03e16c21636d tempest-VolumesGetTest-1325070593 None] Acquiring lock "cinder-quobyte-e3c57b6e-ddf6-4382-9d46-8a8c9722c588" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:16:15 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-8e401ac5-7834-40c2-8765-1cb06bd78d9a tempest-VolumesCloneTest-1104349490 None] Lock "cinder-bca8a6fd-bb57-4f99-9236-8905ba89a16a-delete_volume" released by "delete_volume" :: held 1.615s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:16:15 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-3dbd6c5e-1ac4-4594-b1e1-03e16c21636d tempest-VolumesGetTest-1325070593 None] Lock "cinder-quobyte-e3c57b6e-ddf6-4382-9d46-8a8c9722c588" acquired by "delete_volume" :: waited 0.019s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:16:15 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[4db7170d-304b-4ee0-a67a-7cb1af6e820a]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:16:15 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-3dbd6c5e-1ac4-4594-b1e1-03e16c21636d tempest-VolumesGetTest-1325070593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e3c57b6e-ddf6-4382-9d46-8a8c9722c588 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:16 devstack sudo[88474]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:16 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-3891625d-29fc-4282-ab80-5834d9dca002 tempest-VolumesSnapshotListTestJSON-947768007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4faf7785-29e6-4fbc-b559-705a84ceb769" returned: 0 in 0.482s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:16 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-3891625d-29fc-4282-ab80-5834d9dca002 tempest-VolumesSnapshotListTestJSON-947768007 None] <== create_volume: return (1087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'} {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 13:16:16 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-3891625d-29fc-4282-ab80-5834d9dca002 tempest-VolumesSnapshotListTestJSON-947768007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.089s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:16:16 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-a2172500-0b11-46d9-899c-b15f1b0c19ce tempest-SnapshotsActionsTest-802738678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.380s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:16:16 devstack sudo[88478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e3c57b6e-ddf6-4382-9d46-8a8c9722c588
Apr 10 13:16:16 devstack sudo[88478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:16 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-3891625d-29fc-4282-ab80-5834d9dca002 tempest-VolumesSnapshotListTestJSON-947768007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebe9d067-ef55-4750-9aab-9058221b579e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4faf7785-29e6-4fbc-b559-705a84ceb769', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:16:16 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-3891625d-29fc-4282-ab80-5834d9dca002 tempest-VolumesSnapshotListTestJSON-947768007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f291ba2e-7dc1-44e8-b789-78ff2cf1e04b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:16:16 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-a2172500-0b11-46d9-899c-b15f1b0c19ce tempest-SnapshotsActionsTest-802738678 None] Creating offline snapshot ba3d72ff-e6db-4efb-b6e9-c49dc5450e86 of volume 4f013013-ffcb-4dd4-8e73-3e004e4c6f11 {{(pid=83345) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 10 13:16:16 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-3891625d-29fc-4282-ab80-5834d9dca002 tempest-VolumesSnapshotListTestJSON-947768007 None] Volume volume-4faf7785-29e6-4fbc-b559-705a84ceb769 (4faf7785-29e6-4fbc-b559-705a84ceb769): created successfully
Apr 10 13:16:16 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-3891625d-29fc-4282-ab80-5834d9dca002 tempest-VolumesSnapshotListTestJSON-947768007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f291ba2e-7dc1-44e8-b789-78ff2cf1e04b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:16:16 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-3891625d-29fc-4282-ab80-5834d9dca002 tempest-VolumesSnapshotListTestJSON-947768007 None] Flow 'volume_create_manager' (35999b75-2efb-467d-a04a-7f8a64235e88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:16:16 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbd6c37a-1ce2-46e7-bda1-54bcebf8526c]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:16:16 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-a2172500-0b11-46d9-899c-b15f1b0c19ce tempest-SnapshotsActionsTest-802738678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.4f5b55c6-a3ad-4794-8bb5-40a452cfc583 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:16 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-3891625d-29fc-4282-ab80-5834d9dca002 tempest-VolumesSnapshotListTestJSON-947768007 None] Created volume successfully.
Apr 10 13:16:16 devstack sudo[88480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.4f5b55c6-a3ad-4794-8bb5-40a452cfc583
Apr 10 13:16:16 devstack sudo[88480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:16 devstack sudo[88478]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:16 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-3dbd6c5e-1ac4-4594-b1e1-03e16c21636d tempest-VolumesGetTest-1325070593 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e3c57b6e-ddf6-4382-9d46-8a8c9722c588" returned: 0 in 0.492s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:16 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-3dbd6c5e-1ac4-4594-b1e1-03e16c21636d tempest-VolumesGetTest-1325070593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e3c57b6e-ddf6-4382-9d46-8a8c9722c588 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:16 devstack sudo[88485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e3c57b6e-ddf6-4382-9d46-8a8c9722c588
Apr 10 13:16:16 devstack sudo[88485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:16 devstack sudo[88480]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:16 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-a2172500-0b11-46d9-899c-b15f1b0c19ce tempest-SnapshotsActionsTest-802738678 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.4f5b55c6-a3ad-4794-8bb5-40a452cfc583" returned: 0 in 0.498s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:16 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-a2172500-0b11-46d9-899c-b15f1b0c19ce tempest-SnapshotsActionsTest-802738678 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 13:16:16 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-a2172500-0b11-46d9-899c-b15f1b0c19ce tempest-SnapshotsActionsTest-802738678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.4f5b55c6-a3ad-4794-8bb5-40a452cfc583,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.ba3d72ff-e6db-4efb-b6e9-c49dc5450e86 1G {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:16 devstack sudo[88490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.4f5b55c6-a3ad-4794-8bb5-40a452cfc583,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.ba3d72ff-e6db-4efb-b6e9-c49dc5450e86 1G
Apr 10 13:16:16 devstack sudo[88490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:16 devstack sudo[88485]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:16 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-3dbd6c5e-1ac4-4594-b1e1-03e16c21636d tempest-VolumesGetTest-1325070593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e3c57b6e-ddf6-4382-9d46-8a8c9722c588" returned: 0 in 0.465s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:16 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-3dbd6c5e-1ac4-4594-b1e1-03e16c21636d tempest-VolumesGetTest-1325070593 None] Lock "cinder-quobyte-e3c57b6e-ddf6-4382-9d46-8a8c9722c588" released by "delete_volume" :: held 0.984s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:16:16 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-3dbd6c5e-1ac4-4594-b1e1-03e16c21636d tempest-VolumesGetTest-1325070593 None] Created reservations ['bff99344-3542-4c7e-9ef5-9319637f714b', 'db147144-dbf9-4532-9658-03c61a728d88', 'dd47beb4-82fe-4eda-9c48-105e458b4d1d', 'dc6246c8-28e4-4d5b-939f-4a2289692f3c'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:16:17 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-3dbd6c5e-1ac4-4594-b1e1-03e16c21636d tempest-VolumesGetTest-1325070593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:16:17 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-3dbd6c5e-1ac4-4594-b1e1-03e16c21636d tempest-VolumesGetTest-1325070593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:16:17 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-3dbd6c5e-1ac4-4594-b1e1-03e16c21636d tempest-VolumesGetTest-1325070593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:16:17 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-3dbd6c5e-1ac4-4594-b1e1-03e16c21636d tempest-VolumesGetTest-1325070593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:16:17 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-3dbd6c5e-1ac4-4594-b1e1-03e16c21636d tempest-VolumesGetTest-1325070593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:16:17 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-3dbd6c5e-1ac4-4594-b1e1-03e16c21636d tempest-VolumesGetTest-1325070593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:17 devstack sudo[88496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:16:17 devstack sudo[88496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:17 devstack sudo[88490]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:17 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-a2172500-0b11-46d9-899c-b15f1b0c19ce tempest-SnapshotsActionsTest-802738678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.4f5b55c6-a3ad-4794-8bb5-40a452cfc583,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.ba3d72ff-e6db-4efb-b6e9-c49dc5450e86 1G" returned: 0 in 0.621s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:17 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-a2172500-0b11-46d9-899c-b15f1b0c19ce tempest-SnapshotsActionsTest-802738678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.4f5b55c6-a3ad-4794-8bb5-40a452cfc583 -F qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.ba3d72ff-e6db-4efb-b6e9-c49dc5450e86 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:17 devstack sudo[88498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.4f5b55c6-a3ad-4794-8bb5-40a452cfc583 -F qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.ba3d72ff-e6db-4efb-b6e9-c49dc5450e86
Apr 10 13:16:17 devstack sudo[88498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:17 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-f79a75ff-482d-4aa8-b66a-3ac48789c3df tempest-VolumesSnapshotListTestJSON-947768007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:16:17 devstack sudo[88496]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:17 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-3dbd6c5e-1ac4-4594-b1e1-03e16c21636d tempest-VolumesGetTest-1325070593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.531s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:17 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-3dbd6c5e-1ac4-4594-b1e1-03e16c21636d tempest-VolumesGetTest-1325070593 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:16:17 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-3dbd6c5e-1ac4-4594-b1e1-03e16c21636d tempest-VolumesGetTest-1325070593 None] Deleted volume successfully.
Apr 10 13:16:17 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-3dbd6c5e-1ac4-4594-b1e1-03e16c21636d tempest-VolumesGetTest-1325070593 None] Lock "cinder-e3c57b6e-ddf6-4382-9d46-8a8c9722c588-delete_volume" released by "delete_volume" :: held 1.672s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:16:17 devstack sudo[88498]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:17 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-a2172500-0b11-46d9-899c-b15f1b0c19ce tempest-SnapshotsActionsTest-802738678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.4f5b55c6-a3ad-4794-8bb5-40a452cfc583 -F qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.ba3d72ff-e6db-4efb-b6e9-c49dc5450e86" returned: 0 in 0.520s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:17 devstack cinder-volume[83345]: WARNING cinder.volume.drivers.remotefs [None req-a2172500-0b11-46d9-899c-b15f1b0c19ce tempest-SnapshotsActionsTest-802738678 None] /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.ba3d72ff-e6db-4efb-b6e9-c49dc5450e86 is being set with open permissions: ugo+rw
Apr 10 13:16:17 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-a2172500-0b11-46d9-899c-b15f1b0c19ce tempest-SnapshotsActionsTest-802738678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.ba3d72ff-e6db-4efb-b6e9-c49dc5450e86 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:17 devstack sudo[88504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.ba3d72ff-e6db-4efb-b6e9-c49dc5450e86
Apr 10 13:16:17 devstack sudo[88504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:18 devstack sudo[88504]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:18 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-a2172500-0b11-46d9-899c-b15f1b0c19ce tempest-SnapshotsActionsTest-802738678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.ba3d72ff-e6db-4efb-b6e9-c49dc5450e86" returned: 0 in 0.519s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:18 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-a2172500-0b11-46d9-899c-b15f1b0c19ce tempest-SnapshotsActionsTest-802738678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.242s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:16:18 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-f79a75ff-482d-4aa8-b66a-3ac48789c3df tempest-VolumesSnapshotListTestJSON-947768007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.005s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:16:18 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-f79a75ff-482d-4aa8-b66a-3ac48789c3df tempest-VolumesSnapshotListTestJSON-947768007 None] Creating offline snapshot 01c337fe-1254-4449-826b-4c9e702ab9b4 of volume 4faf7785-29e6-4fbc-b559-705a84ceb769 {{(pid=83345) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 10 13:16:18 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e3918bb-2d8d-40bf-b658-7d52146f50f9 tempest-VolumesCloneNegativeTest-201690201 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:16:18 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-4e3918bb-2d8d-40bf-b658-7d52146f50f9 tempest-VolumesCloneNegativeTest-201690201 None] Flow 'volume_create_manager' (6fdcf2dc-7878-4ddf-8d7d-6c0778d0a8cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:16:18 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-4e3918bb-2d8d-40bf-b658-7d52146f50f9 tempest-VolumesCloneNegativeTest-201690201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cbe5112-a335-48e6-b14a-846948b17372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:16:18 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe377dd1-504a-48f8-a725-0871ed389e2a]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:16:18 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-f79a75ff-482d-4aa8-b66a-3ac48789c3df tempest-VolumesSnapshotListTestJSON-947768007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4faf7785-29e6-4fbc-b559-705a84ceb769 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:18 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-a2172500-0b11-46d9-899c-b15f1b0c19ce tempest-SnapshotsActionsTest-802738678 None] Create snapshot completed successfully
Apr 10 13:16:18 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-4e3918bb-2d8d-40bf-b658-7d52146f50f9 tempest-VolumesCloneNegativeTest-201690201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cbe5112-a335-48e6-b14a-846948b17372) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:16:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1473083874',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcf35861-76b1-48a3-b467-11ab139325a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='895e2ebe95f0411b9c0010016aa038f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:16:18Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:16:18Z,use_quota=True,user_id='aa0f66d92e914ef0b0fd0a485d0d7a8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:16:18 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-4e3918bb-2d8d-40bf-b658-7d52146f50f9 tempest-VolumesCloneNegativeTest-201690201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f46387e-0b99-497d-ad25-aad61a6c711f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:16:18 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-4e3918bb-2d8d-40bf-b658-7d52146f50f9 tempest-VolumesCloneNegativeTest-201690201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f46387e-0b99-497d-ad25-aad61a6c711f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:16:18 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-4e3918bb-2d8d-40bf-b658-7d52146f50f9 tempest-VolumesCloneNegativeTest-201690201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1822f33d-1a87-41be-8f92-5ace197d0ce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:16:18 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-4e3918bb-2d8d-40bf-b658-7d52146f50f9 tempest-VolumesCloneNegativeTest-201690201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1822f33d-1a87-41be-8f92-5ace197d0ce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dcf35861-76b1-48a3-b467-11ab139325a6', 'volume_name': 'volume-dcf35861-76b1-48a3-b467-11ab139325a6', 'volume_size': 2}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:16:18 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-4e3918bb-2d8d-40bf-b658-7d52146f50f9 tempest-VolumesCloneNegativeTest-201690201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83d4ed3a-0028-423b-ae88-782ca5824506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:16:18 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-4e3918bb-2d8d-40bf-b658-7d52146f50f9 tempest-VolumesCloneNegativeTest-201690201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83d4ed3a-0028-423b-ae88-782ca5824506) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:16:18 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-4e3918bb-2d8d-40bf-b658-7d52146f50f9 tempest-VolumesCloneNegativeTest-201690201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (107837a0-51b8-414d-9bf7-bac637bea673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:16:18 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-4e3918bb-2d8d-40bf-b658-7d52146f50f9 tempest-VolumesCloneNegativeTest-201690201 None] Volume dcf35861-76b1-48a3-b467-11ab139325a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dcf35861-76b1-48a3-b467-11ab139325a6', 'volume_size': 2}
Apr 10 13:16:18 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-4e3918bb-2d8d-40bf-b658-7d52146f50f9 tempest-VolumesCloneNegativeTest-201690201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:16:18 devstack sudo[88508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4faf7785-29e6-4fbc-b559-705a84ceb769
Apr 10 13:16:18 devstack sudo[88508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:18 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-864d569e-43d0-4055-9b45-ce50385561f2 tempest-VolumesGetTest-1325070593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:16:18 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-864d569e-43d0-4055-9b45-ce50385561f2 tempest-VolumesGetTest-1325070593 None] Flow 'volume_create_manager' (4930bd13-171b-4a65-b536-b62fb81d8f88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:16:18 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-864d569e-43d0-4055-9b45-ce50385561f2 tempest-VolumesGetTest-1325070593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf30c099-5ca5-4e25-a299-fc554d68f659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:16:18 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-864d569e-43d0-4055-9b45-ce50385561f2 tempest-VolumesGetTest-1325070593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf30c099-5ca5-4e25-a299-fc554d68f659) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:16:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-387177869',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90de3300-cba4-448e-a4a5-237131336da0,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='2164901a19c74ad5a7ac47fa92772df3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:16:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:16:18Z,use_quota=True,user_id='e6a465b820764bf78e3ec91bbb896b7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:16:18 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-864d569e-43d0-4055-9b45-ce50385561f2 tempest-VolumesGetTest-1325070593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e25497ac-c791-457a-9a1d-c631a6e02429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:16:18 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-864d569e-43d0-4055-9b45-ce50385561f2 tempest-VolumesGetTest-1325070593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e25497ac-c791-457a-9a1d-c631a6e02429) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:16:18 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-864d569e-43d0-4055-9b45-ce50385561f2 tempest-VolumesGetTest-1325070593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (518ad2f9-0e40-40b7-b4bc-d5408be1bcf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:16:18 devstack cinder-volume[83345]: DEBUG cinder.image.glance [None req-864d569e-43d0-4055-9b45-ce50385561f2 tempest-VolumesGetTest-1325070593 None] Creating Keystone auth plugin from conf {{(pid=83345) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 10 13:16:18 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-864d569e-43d0-4055-9b45-ce50385561f2 tempest-VolumesGetTest-1325070593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (518ad2f9-0e40-40b7-b4bc-d5408be1bcf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '90de3300-cba4-448e-a4a5-237131336da0', 'volume_name': 'volume-90de3300-cba4-448e-a4a5-237131336da0', 'volume_size': 1, 'image_id': 'dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8c498714b5e64042a43894acdb754f15', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5', 'created_at': datetime.datetime(2026, 4, 10, 11, 6, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 10, 11, 6, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f25211cee00>}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:16:18 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-864d569e-43d0-4055-9b45-ce50385561f2 tempest-VolumesGetTest-1325070593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50517d7c-984a-44d0-b84c-51c74ceca55c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:16:18 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-864d569e-43d0-4055-9b45-ce50385561f2 tempest-VolumesGetTest-1325070593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50517d7c-984a-44d0-b84c-51c74ceca55c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:16:18 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-864d569e-43d0-4055-9b45-ce50385561f2 tempest-VolumesGetTest-1325070593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2351be73-1643-4ab6-b1f0-d6f76c141fb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:16:18 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-864d569e-43d0-4055-9b45-ce50385561f2 tempest-VolumesGetTest-1325070593 None] Volume 90de3300-cba4-448e-a4a5-237131336da0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-90de3300-cba4-448e-a4a5-237131336da0', 'volume_size': 1, 'image_id': 'dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8c498714b5e64042a43894acdb754f15', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5', 'created_at': datetime.datetime(2026, 4, 10, 11, 6, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 10, 11, 6, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f25211cee00>}
Apr 10 13:16:18 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-864d569e-43d0-4055-9b45-ce50385561f2 tempest-VolumesGetTest-1325070593 None] Trying to clone 90de3300-cba4-448e-a4a5-237131336da0 from image dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5 at location (None, [{'url': 'file:///opt/stack/data/glance/images/dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5', 'metadata': {}}]). {{(pid=83345) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 10 13:16:18 devstack cinder-volume[83345]: DEBUG cinder.image.image_utils [None req-864d569e-43d0-4055-9b45-ce50385561f2 tempest-VolumesGetTest-1325070593 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5_q72hcqrwdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83345) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 10 13:16:18 devstack cinder-volume[83345]: INFO cinder.image.image_utils [None req-864d569e-43d0-4055-9b45-ce50385561f2 tempest-VolumesGetTest-1325070593 None] Image download 20.69 MB at 20.69 MB/s
Apr 10 13:16:18 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-21e9d68e-4eed-41f8-9425-52c91067e08b tempest-SnapshotsActionsTest-1189246844 None] Acquiring lock "cinder-ba3d72ff-e6db-4efb-b6e9-c49dc5450e86-delete_snapshot" by "delete_snapshot" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:16:18 devstack sudo[88508]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:18 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-f79a75ff-482d-4aa8-b66a-3ac48789c3df tempest-VolumesSnapshotListTestJSON-947768007 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4faf7785-29e6-4fbc-b559-705a84ceb769" returned: 0 in 0.580s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:18 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-f79a75ff-482d-4aa8-b66a-3ac48789c3df tempest-VolumesSnapshotListTestJSON-947768007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4faf7785-29e6-4fbc-b559-705a84ceb769,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4faf7785-29e6-4fbc-b559-705a84ceb769.01c337fe-1254-4449-826b-4c9e702ab9b4 1G {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:18 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-21e9d68e-4eed-41f8-9425-52c91067e08b tempest-SnapshotsActionsTest-1189246844 None] Lock "cinder-ba3d72ff-e6db-4efb-b6e9-c49dc5450e86-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:16:18 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-21e9d68e-4eed-41f8-9425-52c91067e08b tempest-SnapshotsActionsTest-1189246844 None] Acquiring lock "cinder-quobyte-4f013013-ffcb-4dd4-8e73-3e004e4c6f11" by "delete_snapshot" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:16:18 devstack sudo[88520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4faf7785-29e6-4fbc-b559-705a84ceb769,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4faf7785-29e6-4fbc-b559-705a84ceb769.01c337fe-1254-4449-826b-4c9e702ab9b4 1G
Apr 10 13:16:18 devstack sudo[88520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:18 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-21e9d68e-4eed-41f8-9425-52c91067e08b tempest-SnapshotsActionsTest-1189246844 None] Lock "cinder-quobyte-4f013013-ffcb-4dd4-8e73-3e004e4c6f11" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:16:18 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-21e9d68e-4eed-41f8-9425-52c91067e08b tempest-SnapshotsActionsTest-1189246844 None] Acquiring lock "cinder-quobyte-ba3d72ff-e6db-4efb-b6e9-c49dc5450e86" by "_delete_snapshot" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:16:18 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4d6a217-61ed-4753-8e37-11d741a47e04]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:16:18 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-864d569e-43d0-4055-9b45-ce50385561f2 tempest-VolumesGetTest-1325070593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5_q72hcqrwdevstack@QuobyteHD {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:18 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-21e9d68e-4eed-41f8-9425-52c91067e08b tempest-SnapshotsActionsTest-1189246844 None] Lock "cinder-quobyte-ba3d72ff-e6db-4efb-b6e9-c49dc5450e86" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:16:18 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-21e9d68e-4eed-41f8-9425-52c91067e08b tempest-SnapshotsActionsTest-1189246844 None] Deleting offline snapshot ba3d72ff-e6db-4efb-b6e9-c49dc5450e86 of volume 4f013013-ffcb-4dd4-8e73-3e004e4c6f11 {{(pid=83345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 10 13:16:18 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-21e9d68e-4eed-41f8-9425-52c91067e08b tempest-SnapshotsActionsTest-1189246844 None] snapshot_file for this snap is: volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.ba3d72ff-e6db-4efb-b6e9-c49dc5450e86 {{(pid=83345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 10 13:16:18 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b49dab2-77d4-4af4-b239-4c85dfc508b8]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:16:18 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-21e9d68e-4eed-41f8-9425-52c91067e08b tempest-SnapshotsActionsTest-1189246844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.ba3d72ff-e6db-4efb-b6e9-c49dc5450e86 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:19 devstack sudo[88522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5_q72hcqrwdevstack@QuobyteHD
Apr 10 13:16:19 devstack sudo[88522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:19 devstack sudo[88523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.ba3d72ff-e6db-4efb-b6e9-c49dc5450e86
Apr 10 13:16:19 devstack sudo[88523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:19 devstack sudo[88520]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:19 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-f79a75ff-482d-4aa8-b66a-3ac48789c3df tempest-VolumesSnapshotListTestJSON-947768007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4faf7785-29e6-4fbc-b559-705a84ceb769,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4faf7785-29e6-4fbc-b559-705a84ceb769.01c337fe-1254-4449-826b-4c9e702ab9b4 1G" returned: 0 in 0.523s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:19 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-f79a75ff-482d-4aa8-b66a-3ac48789c3df tempest-VolumesSnapshotListTestJSON-947768007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4faf7785-29e6-4fbc-b559-705a84ceb769 -F qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4faf7785-29e6-4fbc-b559-705a84ceb769.01c337fe-1254-4449-826b-4c9e702ab9b4 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:19 devstack sudo[88522]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:19 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-864d569e-43d0-4055-9b45-ce50385561f2 tempest-VolumesGetTest-1325070593 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5_q72hcqrwdevstack@QuobyteHD" returned: 0 in 0.498s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:19 devstack cinder-volume[83345]: DEBUG cinder.image.image_utils [None req-864d569e-43d0-4055-9b45-ce50385561f2 tempest-VolumesGetTest-1325070593 None] Temporary image dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5 is fetched for user e6a465b820764bf78e3ec91bbb896b7f. {{(pid=83345) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 10 13:16:19 devstack sudo[88523]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:19 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-21e9d68e-4eed-41f8-9425-52c91067e08b tempest-SnapshotsActionsTest-1189246844 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.ba3d72ff-e6db-4efb-b6e9-c49dc5450e86" returned: 0 in 0.501s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:19 devstack sudo[88535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4faf7785-29e6-4fbc-b559-705a84ceb769 -F qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4faf7785-29e6-4fbc-b559-705a84ceb769.01c337fe-1254-4449-826b-4c9e702ab9b4
Apr 10 13:16:19 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-21e9d68e-4eed-41f8-9425-52c91067e08b tempest-SnapshotsActionsTest-1189246844 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 13:16:19 devstack sudo[88535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:19 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb042b9f-d118-426c-a213-e4dd7a339a65]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:16:19 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-21e9d68e-4eed-41f8-9425-52c91067e08b tempest-SnapshotsActionsTest-1189246844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.4f5b55c6-a3ad-4794-8bb5-40a452cfc583 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:19 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[19ddbf29-dc52-4fd0-99e4-09d65b59e19b]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:16:19 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-864d569e-43d0-4055-9b45-ce50385561f2 tempest-VolumesGetTest-1325070593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5_q72hcqrwdevstack@QuobyteHD {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:19 devstack sudo[88537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.4f5b55c6-a3ad-4794-8bb5-40a452cfc583
Apr 10 13:16:19 devstack sudo[88537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:19 devstack sudo[88538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5_q72hcqrwdevstack@QuobyteHD
Apr 10 13:16:19 devstack sudo[88538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:19 devstack sudo[88535]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:19 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-f79a75ff-482d-4aa8-b66a-3ac48789c3df tempest-VolumesSnapshotListTestJSON-947768007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4faf7785-29e6-4fbc-b559-705a84ceb769 -F qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4faf7785-29e6-4fbc-b559-705a84ceb769.01c337fe-1254-4449-826b-4c9e702ab9b4" returned: 0 in 0.465s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:19 devstack cinder-volume[83345]: WARNING cinder.volume.drivers.remotefs [None req-f79a75ff-482d-4aa8-b66a-3ac48789c3df tempest-VolumesSnapshotListTestJSON-947768007 None] /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4faf7785-29e6-4fbc-b559-705a84ceb769.01c337fe-1254-4449-826b-4c9e702ab9b4 is being set with open permissions: ugo+rw
Apr 10 13:16:19 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-f79a75ff-482d-4aa8-b66a-3ac48789c3df tempest-VolumesSnapshotListTestJSON-947768007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4faf7785-29e6-4fbc-b559-705a84ceb769.01c337fe-1254-4449-826b-4c9e702ab9b4 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:19 devstack sudo[88549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4faf7785-29e6-4fbc-b559-705a84ceb769.01c337fe-1254-4449-826b-4c9e702ab9b4
Apr 10 13:16:19 devstack sudo[88549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:20 devstack sudo[88538]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:20 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-864d569e-43d0-4055-9b45-ce50385561f2 tempest-VolumesGetTest-1325070593 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5_q72hcqrwdevstack@QuobyteHD" returned: 0 in 0.481s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:20 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-864d569e-43d0-4055-9b45-ce50385561f2 tempest-VolumesGetTest-1325070593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:16:20 devstack sudo[88537]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:20 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-21e9d68e-4eed-41f8-9425-52c91067e08b tempest-SnapshotsActionsTest-1189246844 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.4f5b55c6-a3ad-4794-8bb5-40a452cfc583" returned: 0 in 0.525s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:20 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-21e9d68e-4eed-41f8-9425-52c91067e08b tempest-SnapshotsActionsTest-1189246844 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 13:16:20 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-21e9d68e-4eed-41f8-9425-52c91067e08b tempest-SnapshotsActionsTest-1189246844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.ba3d72ff-e6db-4efb-b6e9-c49dc5450e86 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:20 devstack sudo[88554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.ba3d72ff-e6db-4efb-b6e9-c49dc5450e86
Apr 10 13:16:20 devstack sudo[88554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:20 devstack sudo[88549]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:20 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-f79a75ff-482d-4aa8-b66a-3ac48789c3df tempest-VolumesSnapshotListTestJSON-947768007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4faf7785-29e6-4fbc-b559-705a84ceb769.01c337fe-1254-4449-826b-4c9e702ab9b4" returned: 0 in 0.434s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:20 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-f79a75ff-482d-4aa8-b66a-3ac48789c3df tempest-VolumesSnapshotListTestJSON-947768007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4faf7785-29e6-4fbc-b559-705a84ceb769.info {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:20 devstack sudo[88560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4faf7785-29e6-4fbc-b559-705a84ceb769.info
Apr 10 13:16:20 devstack sudo[88560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:20 devstack sudo[88554]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:20 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-21e9d68e-4eed-41f8-9425-52c91067e08b tempest-SnapshotsActionsTest-1189246844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.ba3d72ff-e6db-4efb-b6e9-c49dc5450e86" returned: 0 in 0.477s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:20 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-21e9d68e-4eed-41f8-9425-52c91067e08b tempest-SnapshotsActionsTest-1189246844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.ba3d72ff-e6db-4efb-b6e9-c49dc5450e86 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:20 devstack sudo[88562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.ba3d72ff-e6db-4efb-b6e9-c49dc5450e86
Apr 10 13:16:20 devstack sudo[88562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:20 devstack sudo[88560]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:20 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-f79a75ff-482d-4aa8-b66a-3ac48789c3df tempest-VolumesSnapshotListTestJSON-947768007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4faf7785-29e6-4fbc-b559-705a84ceb769.info" returned: 0 in 0.446s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:20 devstack cinder-volume[83345]: WARNING cinder.volume.drivers.remotefs [None req-f79a75ff-482d-4aa8-b66a-3ac48789c3df tempest-VolumesSnapshotListTestJSON-947768007 None] /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4faf7785-29e6-4fbc-b559-705a84ceb769.info is being set with open permissions: ugo+rw
Apr 10 13:16:20 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-f79a75ff-482d-4aa8-b66a-3ac48789c3df tempest-VolumesSnapshotListTestJSON-947768007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4faf7785-29e6-4fbc-b559-705a84ceb769.info {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:20 devstack sudo[88565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4faf7785-29e6-4fbc-b559-705a84ceb769.info
Apr 10 13:16:20 devstack sudo[88565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:20 devstack sudo[88562]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:20 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-21e9d68e-4eed-41f8-9425-52c91067e08b tempest-SnapshotsActionsTest-1189246844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.ba3d72ff-e6db-4efb-b6e9-c49dc5450e86" returned: 0 in 0.412s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:20 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-21e9d68e-4eed-41f8-9425-52c91067e08b tempest-SnapshotsActionsTest-1189246844 None] Lock "cinder-quobyte-ba3d72ff-e6db-4efb-b6e9-c49dc5450e86" released by "_delete_snapshot" :: held 1.966s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:16:20 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-21e9d68e-4eed-41f8-9425-52c91067e08b tempest-SnapshotsActionsTest-1189246844 None] Lock "cinder-quobyte-4f013013-ffcb-4dd4-8e73-3e004e4c6f11" released by "delete_snapshot" :: held 1.987s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:16:21 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-21e9d68e-4eed-41f8-9425-52c91067e08b tempest-SnapshotsActionsTest-1189246844 None] Created reservations ['5d2bac72-0e16-4775-a798-75e060d1827c', '62e7cab5-fac5-40c1-acef-112c0d459c52', '211fd45e-4273-42eb-8a4f-9c9f069c97dc', '1c1a9815-d084-4c3c-9c7a-36b57e1a7468'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:16:21 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-21e9d68e-4eed-41f8-9425-52c91067e08b tempest-SnapshotsActionsTest-1189246844 None] Delete snapshot completed successfully.
Apr 10 13:16:21 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-21e9d68e-4eed-41f8-9425-52c91067e08b tempest-SnapshotsActionsTest-1189246844 None] Lock "cinder-ba3d72ff-e6db-4efb-b6e9-c49dc5450e86-delete_snapshot" released by "delete_snapshot" :: held 2.091s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:16:21 devstack sudo[88565]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:21 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-f79a75ff-482d-4aa8-b66a-3ac48789c3df tempest-VolumesSnapshotListTestJSON-947768007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4faf7785-29e6-4fbc-b559-705a84ceb769.info" returned: 0 in 0.416s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:21 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-f79a75ff-482d-4aa8-b66a-3ac48789c3df tempest-VolumesSnapshotListTestJSON-947768007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.960s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:16:21 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-4e3918bb-2d8d-40bf-b658-7d52146f50f9 tempest-VolumesCloneNegativeTest-201690201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.847s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:16:21 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-4e3918bb-2d8d-40bf-b658-7d52146f50f9 tempest-VolumesCloneNegativeTest-201690201 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f252bf08b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:16:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1473083874',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcf35861-76b1-48a3-b467-11ab139325a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='895e2ebe95f0411b9c0010016aa038f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:16:18Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:16:18Z,use_quota=True,user_id='aa0f66d92e914ef0b0fd0a485d0d7a8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)}" {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 13:16:21 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-4e3918bb-2d8d-40bf-b658-7d52146f50f9 tempest-VolumesCloneNegativeTest-201690201 None] Creating volume dcf35861-76b1-48a3-b467-11ab139325a6 {{(pid=83345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 13:16:21 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-4e3918bb-2d8d-40bf-b658-7d52146f50f9 tempest-VolumesCloneNegativeTest-201690201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:16:21 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-4e3918bb-2d8d-40bf-b658-7d52146f50f9 tempest-VolumesCloneNegativeTest-201690201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:16:21 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-4e3918bb-2d8d-40bf-b658-7d52146f50f9 tempest-VolumesCloneNegativeTest-201690201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:16:21 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-4e3918bb-2d8d-40bf-b658-7d52146f50f9 tempest-VolumesCloneNegativeTest-201690201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:16:21 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-4e3918bb-2d8d-40bf-b658-7d52146f50f9 tempest-VolumesCloneNegativeTest-201690201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:16:21 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-4e3918bb-2d8d-40bf-b658-7d52146f50f9 tempest-VolumesCloneNegativeTest-201690201 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:16:21 devstack cinder-volume[83345]: INFO cinder.volume.drivers.remotefs [None req-4e3918bb-2d8d-40bf-b658-7d52146f50f9 tempest-VolumesCloneNegativeTest-201690201 None] casted to osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331
Apr 10 13:16:21 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-4e3918bb-2d8d-40bf-b658-7d52146f50f9 tempest-VolumesCloneNegativeTest-201690201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-dcf35861-76b1-48a3-b467-11ab139325a6 2147483648 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:21 devstack sudo[88569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-dcf35861-76b1-48a3-b467-11ab139325a6 2147483648
Apr 10 13:16:21 devstack sudo[88569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:21 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-f79a75ff-482d-4aa8-b66a-3ac48789c3df tempest-VolumesSnapshotListTestJSON-947768007 None] Create snapshot completed successfully
Apr 10 13:16:21 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-28e04bf7-c5f3-47ac-a6ee-d416d6d8098a tempest-VolumesSnapshotListTestJSON-947768007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:16:21 devstack sudo[88569]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:21 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-4e3918bb-2d8d-40bf-b658-7d52146f50f9 tempest-VolumesCloneNegativeTest-201690201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-dcf35861-76b1-48a3-b467-11ab139325a6 2147483648" returned: 0 in 0.514s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:21 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-4e3918bb-2d8d-40bf-b658-7d52146f50f9 tempest-VolumesCloneNegativeTest-201690201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-dcf35861-76b1-48a3-b467-11ab139325a6 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:21 devstack sudo[88575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-dcf35861-76b1-48a3-b467-11ab139325a6
Apr 10 13:16:21 devstack sudo[88575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:22 devstack sudo[88575]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:22 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-4e3918bb-2d8d-40bf-b658-7d52146f50f9 tempest-VolumesCloneNegativeTest-201690201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-dcf35861-76b1-48a3-b467-11ab139325a6" returned: 0 in 0.439s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:22 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-4e3918bb-2d8d-40bf-b658-7d52146f50f9 tempest-VolumesCloneNegativeTest-201690201 None] <== create_volume: return (975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'} {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 13:16:22 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-4e3918bb-2d8d-40bf-b658-7d52146f50f9 tempest-VolumesCloneNegativeTest-201690201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:16:22 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-864d569e-43d0-4055-9b45-ce50385561f2 tempest-VolumesGetTest-1325070593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.222s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:16:22 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-864d569e-43d0-4055-9b45-ce50385561f2 tempest-VolumesGetTest-1325070593 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f252bf08b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:16:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-387177869',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90de3300-cba4-448e-a4a5-237131336da0,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='2164901a19c74ad5a7ac47fa92772df3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:16:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:16:18Z,use_quota=True,user_id='e6a465b820764bf78e3ec91bbb896b7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)}" {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 13:16:22 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-864d569e-43d0-4055-9b45-ce50385561f2 tempest-VolumesGetTest-1325070593 None] Creating volume 90de3300-cba4-448e-a4a5-237131336da0 {{(pid=83345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 13:16:22 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-864d569e-43d0-4055-9b45-ce50385561f2 tempest-VolumesGetTest-1325070593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:16:22 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-864d569e-43d0-4055-9b45-ce50385561f2 tempest-VolumesGetTest-1325070593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:16:22 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-864d569e-43d0-4055-9b45-ce50385561f2 tempest-VolumesGetTest-1325070593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:16:22 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-864d569e-43d0-4055-9b45-ce50385561f2 tempest-VolumesGetTest-1325070593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:16:22 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-864d569e-43d0-4055-9b45-ce50385561f2 tempest-VolumesGetTest-1325070593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:16:22 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-864d569e-43d0-4055-9b45-ce50385561f2 tempest-VolumesGetTest-1325070593 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:16:22 devstack cinder-volume[83345]: INFO cinder.volume.drivers.remotefs [None req-864d569e-43d0-4055-9b45-ce50385561f2 tempest-VolumesGetTest-1325070593 None] casted to osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331
Apr 10 13:16:22 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-864d569e-43d0-4055-9b45-ce50385561f2 tempest-VolumesGetTest-1325070593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-90de3300-cba4-448e-a4a5-237131336da0 1073741824 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:22 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-4e3918bb-2d8d-40bf-b658-7d52146f50f9 tempest-VolumesCloneNegativeTest-201690201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (107837a0-51b8-414d-9bf7-bac637bea673) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dcf35861-76b1-48a3-b467-11ab139325a6', 'volume_size': 2}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:16:22 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-4e3918bb-2d8d-40bf-b658-7d52146f50f9 tempest-VolumesCloneNegativeTest-201690201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a70564ec-21c8-4d77-8eef-fe1b70ac8d0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:16:22 devstack sudo[88578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-90de3300-cba4-448e-a4a5-237131336da0 1073741824
Apr 10 13:16:22 devstack sudo[88578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:22 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-76fc09ac-d96f-45d8-b2fe-e19d41592373 tempest-SnapshotsActionsTest-802738678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:16:22 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-4e3918bb-2d8d-40bf-b658-7d52146f50f9 tempest-VolumesCloneNegativeTest-201690201 None] Volume volume-dcf35861-76b1-48a3-b467-11ab139325a6 (dcf35861-76b1-48a3-b467-11ab139325a6): created successfully
Apr 10 13:16:22 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-4e3918bb-2d8d-40bf-b658-7d52146f50f9 tempest-VolumesCloneNegativeTest-201690201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a70564ec-21c8-4d77-8eef-fe1b70ac8d0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:16:22 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-4e3918bb-2d8d-40bf-b658-7d52146f50f9 tempest-VolumesCloneNegativeTest-201690201 None] Flow 'volume_create_manager' (6fdcf2dc-7878-4ddf-8d7d-6c0778d0a8cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:16:22 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-4e3918bb-2d8d-40bf-b658-7d52146f50f9 tempest-VolumesCloneNegativeTest-201690201 None] Created volume successfully.
Apr 10 13:16:22 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-ed79765b-0b7d-41ea-8485-de6271c8ab8b tempest-VolumesCloneNegativeTest-201690201 None] Acquiring lock "cinder-dcf35861-76b1-48a3-b467-11ab139325a6-delete_volume" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:16:22 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-ed79765b-0b7d-41ea-8485-de6271c8ab8b tempest-VolumesCloneNegativeTest-201690201 None] Lock "cinder-dcf35861-76b1-48a3-b467-11ab139325a6-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:16:22 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-ed79765b-0b7d-41ea-8485-de6271c8ab8b tempest-VolumesCloneNegativeTest-201690201 None] Acquiring lock "cinder-quobyte-dcf35861-76b1-48a3-b467-11ab139325a6" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:16:22 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-ed79765b-0b7d-41ea-8485-de6271c8ab8b tempest-VolumesCloneNegativeTest-201690201 None] Lock "cinder-quobyte-dcf35861-76b1-48a3-b467-11ab139325a6" acquired by "delete_volume" :: waited 0.007s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:16:22 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7defd78-f2c2-4b98-ab36-9fde849e93f2]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:16:22 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ed79765b-0b7d-41ea-8485-de6271c8ab8b tempest-VolumesCloneNegativeTest-201690201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-dcf35861-76b1-48a3-b467-11ab139325a6 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:22 devstack sudo[88583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-dcf35861-76b1-48a3-b467-11ab139325a6
Apr 10 13:16:22 devstack sudo[88583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:22 devstack sudo[88578]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:22 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-864d569e-43d0-4055-9b45-ce50385561f2 tempest-VolumesGetTest-1325070593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-90de3300-cba4-448e-a4a5-237131336da0 1073741824" returned: 0 in 0.537s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:22 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-864d569e-43d0-4055-9b45-ce50385561f2 tempest-VolumesGetTest-1325070593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-90de3300-cba4-448e-a4a5-237131336da0 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:22 devstack sudo[88586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-90de3300-cba4-448e-a4a5-237131336da0
Apr 10 13:16:22 devstack sudo[88586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:23 devstack sudo[88583]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:23 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ed79765b-0b7d-41ea-8485-de6271c8ab8b tempest-VolumesCloneNegativeTest-201690201 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-dcf35861-76b1-48a3-b467-11ab139325a6" returned: 0 in 0.482s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:23 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ed79765b-0b7d-41ea-8485-de6271c8ab8b tempest-VolumesCloneNegativeTest-201690201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-dcf35861-76b1-48a3-b467-11ab139325a6 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:23 devstack sudo[88592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-dcf35861-76b1-48a3-b467-11ab139325a6
Apr 10 13:16:23 devstack sudo[88592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:23 devstack sudo[88586]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:23 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-864d569e-43d0-4055-9b45-ce50385561f2 tempest-VolumesGetTest-1325070593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-90de3300-cba4-448e-a4a5-237131336da0" returned: 0 in 0.407s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:23 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-864d569e-43d0-4055-9b45-ce50385561f2 tempest-VolumesGetTest-1325070593 None] <== create_volume: return (968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'} {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 13:16:23 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-864d569e-43d0-4055-9b45-ce50385561f2 tempest-VolumesGetTest-1325070593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.971s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:16:23 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-28e04bf7-c5f3-47ac-a6ee-d416d6d8098a tempest-VolumesSnapshotListTestJSON-947768007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.673s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:16:23 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-28e04bf7-c5f3-47ac-a6ee-d416d6d8098a tempest-VolumesSnapshotListTestJSON-947768007 None] Creating offline snapshot a87dfedb-457b-43a8-b901-2778173ca043 of volume 4faf7785-29e6-4fbc-b559-705a84ceb769 {{(pid=83345) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 10 13:16:23 devstack cinder-volume[83345]: DEBUG cinder.volume.volume_utils [None req-864d569e-43d0-4055-9b45-ce50385561f2 tempest-VolumesGetTest-1325070593 None] Attempting download of dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5 ((None, [{'url': 'file:///opt/stack/data/glance/images/dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5', 'metadata': {}}])) to volume 90de3300-cba4-448e-a4a5-237131336da0. {{(pid=83345) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 10 13:16:23 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[e06e1035-7364-4467-ae8a-eb1c71ddc4b7]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:16:23 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-28e04bf7-c5f3-47ac-a6ee-d416d6d8098a tempest-VolumesSnapshotListTestJSON-947768007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4faf7785-29e6-4fbc-b559-705a84ceb769.01c337fe-1254-4449-826b-4c9e702ab9b4 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:23 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[a227e78e-0983-4036-8e1b-eb0ead0f910e]: (4, 'raw') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:16:23 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-864d569e-43d0-4055-9b45-ce50385561f2 tempest-VolumesGetTest-1325070593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5_e37n1a0s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:23 devstack sudo[88594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4faf7785-29e6-4fbc-b559-705a84ceb769.01c337fe-1254-4449-826b-4c9e702ab9b4
Apr 10 13:16:23 devstack sudo[88594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:23 devstack sudo[88595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5_e37n1a0s
Apr 10 13:16:23 devstack sudo[88595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:23 devstack sudo[88592]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:23 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ed79765b-0b7d-41ea-8485-de6271c8ab8b tempest-VolumesCloneNegativeTest-201690201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-dcf35861-76b1-48a3-b467-11ab139325a6" returned: 0 in 0.433s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:23 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-ed79765b-0b7d-41ea-8485-de6271c8ab8b tempest-VolumesCloneNegativeTest-201690201 None] Lock "cinder-quobyte-dcf35861-76b1-48a3-b467-11ab139325a6" released by "delete_volume" :: held 0.937s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:16:23 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-ed79765b-0b7d-41ea-8485-de6271c8ab8b tempest-VolumesCloneNegativeTest-201690201 None] Created reservations ['d9ecaaa6-6b2c-4e70-a794-6b62efae95ae', '042995a6-f31b-4f0b-8e83-3cf082a63555', '033d4d94-6fb7-4f6b-98f4-5688c95fa8a5', '551e18b0-3f1a-4745-ac02-c274dede5c9d'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:16:23 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-ed79765b-0b7d-41ea-8485-de6271c8ab8b tempest-VolumesCloneNegativeTest-201690201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:16:23 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-ed79765b-0b7d-41ea-8485-de6271c8ab8b tempest-VolumesCloneNegativeTest-201690201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:16:23 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-ed79765b-0b7d-41ea-8485-de6271c8ab8b tempest-VolumesCloneNegativeTest-201690201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:16:23 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-ed79765b-0b7d-41ea-8485-de6271c8ab8b tempest-VolumesCloneNegativeTest-201690201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:16:23 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-ed79765b-0b7d-41ea-8485-de6271c8ab8b tempest-VolumesCloneNegativeTest-201690201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:16:23 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ed79765b-0b7d-41ea-8485-de6271c8ab8b tempest-VolumesCloneNegativeTest-201690201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:23 devstack sudo[88599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:16:23 devstack sudo[88599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:23 devstack sudo[88595]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:23 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-864d569e-43d0-4055-9b45-ce50385561f2 tempest-VolumesGetTest-1325070593 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5_e37n1a0s" returned: 0 in 0.491s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:23 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-864d569e-43d0-4055-9b45-ce50385561f2 tempest-VolumesGetTest-1325070593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5_e37n1a0s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:23 devstack sudo[88594]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:23 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-28e04bf7-c5f3-47ac-a6ee-d416d6d8098a tempest-VolumesSnapshotListTestJSON-947768007 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4faf7785-29e6-4fbc-b559-705a84ceb769.01c337fe-1254-4449-826b-4c9e702ab9b4" returned: 0 in 0.560s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:23 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-28e04bf7-c5f3-47ac-a6ee-d416d6d8098a tempest-VolumesSnapshotListTestJSON-947768007 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4faf7785-29e6-4fbc-b559-705a84ceb769(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 13:16:23 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-28e04bf7-c5f3-47ac-a6ee-d416d6d8098a tempest-VolumesSnapshotListTestJSON-947768007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4faf7785-29e6-4fbc-b559-705a84ceb769.01c337fe-1254-4449-826b-4c9e702ab9b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4faf7785-29e6-4fbc-b559-705a84ceb769.a87dfedb-457b-43a8-b901-2778173ca043 1G {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:23 devstack sudo[88607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4faf7785-29e6-4fbc-b559-705a84ceb769.01c337fe-1254-4449-826b-4c9e702ab9b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4faf7785-29e6-4fbc-b559-705a84ceb769.a87dfedb-457b-43a8-b901-2778173ca043 1G
Apr 10 13:16:23 devstack sudo[88607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:23 devstack sudo[88606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5_e37n1a0s
Apr 10 13:16:23 devstack sudo[88606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:24 devstack sudo[88599]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:24 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ed79765b-0b7d-41ea-8485-de6271c8ab8b tempest-VolumesCloneNegativeTest-201690201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.530s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:24 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-ed79765b-0b7d-41ea-8485-de6271c8ab8b tempest-VolumesCloneNegativeTest-201690201 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:16:24 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-ed79765b-0b7d-41ea-8485-de6271c8ab8b tempest-VolumesCloneNegativeTest-201690201 None] Deleted volume successfully.
Apr 10 13:16:24 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-ed79765b-0b7d-41ea-8485-de6271c8ab8b tempest-VolumesCloneNegativeTest-201690201 None] Lock "cinder-dcf35861-76b1-48a3-b467-11ab139325a6-delete_volume" released by "delete_volume" :: held 1.591s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:16:24 devstack sudo[88606]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:24 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-864d569e-43d0-4055-9b45-ce50385561f2 tempest-VolumesGetTest-1325070593 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5_e37n1a0s" returned: 1 in 0.542s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:24 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-864d569e-43d0-4055-9b45-ce50385561f2 tempest-VolumesGetTest-1325070593 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5_e37n1a0s' failed. Not Retrying. {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 10 13:16:24 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7aed8dc-b07c-41ed-91de-e9eec8d00a8e]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:16:24 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-864d569e-43d0-4055-9b45-ce50385561f2 tempest-VolumesGetTest-1325070593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5_q72hcqrwdevstack@QuobyteHD {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:24 devstack sudo[88616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5_q72hcqrwdevstack@QuobyteHD
Apr 10 13:16:24 devstack sudo[88616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:24 devstack sudo[88607]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:24 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-28e04bf7-c5f3-47ac-a6ee-d416d6d8098a tempest-VolumesSnapshotListTestJSON-947768007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4faf7785-29e6-4fbc-b559-705a84ceb769.01c337fe-1254-4449-826b-4c9e702ab9b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4faf7785-29e6-4fbc-b559-705a84ceb769.a87dfedb-457b-43a8-b901-2778173ca043 1G" returned: 0 in 0.582s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:24 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-28e04bf7-c5f3-47ac-a6ee-d416d6d8098a tempest-VolumesSnapshotListTestJSON-947768007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4faf7785-29e6-4fbc-b559-705a84ceb769.01c337fe-1254-4449-826b-4c9e702ab9b4 -F qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4faf7785-29e6-4fbc-b559-705a84ceb769.a87dfedb-457b-43a8-b901-2778173ca043 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:24 devstack sudo[88618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4faf7785-29e6-4fbc-b559-705a84ceb769.01c337fe-1254-4449-826b-4c9e702ab9b4 -F qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4faf7785-29e6-4fbc-b559-705a84ceb769.a87dfedb-457b-43a8-b901-2778173ca043
Apr 10 13:16:24 devstack sudo[88618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:24 devstack sudo[88616]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:24 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-864d569e-43d0-4055-9b45-ce50385561f2 tempest-VolumesGetTest-1325070593 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5_q72hcqrwdevstack@QuobyteHD" returned: 0 in 0.547s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:24 devstack cinder-volume[83345]: DEBUG cinder.image.image_utils [None req-864d569e-43d0-4055-9b45-ce50385561f2 tempest-VolumesGetTest-1325070593 None] dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5 was qcow2, converting to raw {{(pid=83345) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 10 13:16:24 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-864d569e-43d0-4055-9b45-ce50385561f2 tempest-VolumesGetTest-1325070593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5_q72hcqrwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-90de3300-cba4-448e-a4a5-237131336da0 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:24 devstack sudo[88626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5_q72hcqrwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-90de3300-cba4-448e-a4a5-237131336da0
Apr 10 13:16:24 devstack sudo[88626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:24 devstack sudo[88618]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:24 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-28e04bf7-c5f3-47ac-a6ee-d416d6d8098a tempest-VolumesSnapshotListTestJSON-947768007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4faf7785-29e6-4fbc-b559-705a84ceb769.01c337fe-1254-4449-826b-4c9e702ab9b4 -F qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4faf7785-29e6-4fbc-b559-705a84ceb769.a87dfedb-457b-43a8-b901-2778173ca043" returned: 0 in 0.521s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:24 devstack cinder-volume[83345]: WARNING cinder.volume.drivers.remotefs [None req-28e04bf7-c5f3-47ac-a6ee-d416d6d8098a tempest-VolumesSnapshotListTestJSON-947768007 None] /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4faf7785-29e6-4fbc-b559-705a84ceb769.a87dfedb-457b-43a8-b901-2778173ca043 is being set with open permissions: ugo+rw
Apr 10 13:16:24 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-28e04bf7-c5f3-47ac-a6ee-d416d6d8098a tempest-VolumesSnapshotListTestJSON-947768007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4faf7785-29e6-4fbc-b559-705a84ceb769.a87dfedb-457b-43a8-b901-2778173ca043 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:24 devstack sudo[88628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4faf7785-29e6-4fbc-b559-705a84ceb769.a87dfedb-457b-43a8-b901-2778173ca043
Apr 10 13:16:24 devstack sudo[88628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:25 devstack sudo[88628]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:25 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-28e04bf7-c5f3-47ac-a6ee-d416d6d8098a tempest-VolumesSnapshotListTestJSON-947768007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4faf7785-29e6-4fbc-b559-705a84ceb769.a87dfedb-457b-43a8-b901-2778173ca043" returned: 0 in 0.518s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:25 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-28e04bf7-c5f3-47ac-a6ee-d416d6d8098a tempest-VolumesSnapshotListTestJSON-947768007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.248s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:16:25 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-76fc09ac-d96f-45d8-b2fe-e19d41592373 tempest-SnapshotsActionsTest-802738678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.197s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:16:25 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-76fc09ac-d96f-45d8-b2fe-e19d41592373 tempest-SnapshotsActionsTest-802738678 None] Creating offline snapshot 1fa7d9d4-7e7f-495d-aea2-401f59d319da of volume 4f013013-ffcb-4dd4-8e73-3e004e4c6f11 {{(pid=83345) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 10 13:16:25 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[f107e8f8-be8a-42d6-9805-1a5d1e880043]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:16:25 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-28e04bf7-c5f3-47ac-a6ee-d416d6d8098a tempest-VolumesSnapshotListTestJSON-947768007 None] Create snapshot completed successfully
Apr 10 13:16:25 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-76fc09ac-d96f-45d8-b2fe-e19d41592373 tempest-SnapshotsActionsTest-802738678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.4f5b55c6-a3ad-4794-8bb5-40a452cfc583 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:25 devstack sudo[88644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.4f5b55c6-a3ad-4794-8bb5-40a452cfc583
Apr 10 13:16:25 devstack sudo[88644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:25 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-ee1ee128-24e9-4c3b-903f-e3c2a3baadac tempest-VolumesSnapshotListTestJSON-947768007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:16:25 devstack sudo[88626]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:25 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-864d569e-43d0-4055-9b45-ce50385561f2 tempest-VolumesGetTest-1325070593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5_q72hcqrwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-90de3300-cba4-448e-a4a5-237131336da0" returned: 0 in 0.992s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:25 devstack cinder-volume[83345]: DEBUG cinder.image.image_utils [None req-864d569e-43d0-4055-9b45-ce50385561f2 tempest-VolumesGetTest-1325070593 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5_q72hcqrwdevstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-90de3300-cba4-448e-a4a5-237131336da0 {{(pid=83345) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 10 13:16:25 devstack cinder-volume[83345]: INFO cinder.image.image_utils [None req-864d569e-43d0-4055-9b45-ce50385561f2 tempest-VolumesGetTest-1325070593 None] Converted 112.00 MB image at 112.00 MB/s
Apr 10 13:16:25 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-864d569e-43d0-4055-9b45-ce50385561f2 tempest-VolumesGetTest-1325070593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-90de3300-cba4-448e-a4a5-237131336da0 1G {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:25 devstack sudo[88646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-90de3300-cba4-448e-a4a5-237131336da0 1G
Apr 10 13:16:25 devstack sudo[88646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:26 devstack sudo[88644]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:26 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-76fc09ac-d96f-45d8-b2fe-e19d41592373 tempest-SnapshotsActionsTest-802738678 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.4f5b55c6-a3ad-4794-8bb5-40a452cfc583" returned: 0 in 0.662s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:26 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-76fc09ac-d96f-45d8-b2fe-e19d41592373 tempest-SnapshotsActionsTest-802738678 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 13:16:26 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-76fc09ac-d96f-45d8-b2fe-e19d41592373 tempest-SnapshotsActionsTest-802738678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.4f5b55c6-a3ad-4794-8bb5-40a452cfc583,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.1fa7d9d4-7e7f-495d-aea2-401f59d319da 1G {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:26 devstack sudo[88651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.4f5b55c6-a3ad-4794-8bb5-40a452cfc583,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.1fa7d9d4-7e7f-495d-aea2-401f59d319da 1G
Apr 10 13:16:26 devstack sudo[88651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:26 devstack sudo[88646]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:26 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-864d569e-43d0-4055-9b45-ce50385561f2 tempest-VolumesGetTest-1325070593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-90de3300-cba4-448e-a4a5-237131336da0 1G" returned: 0 in 0.507s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:26 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[29beebba-d28b-471c-8426-fb3566427837]: (4, 'raw') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:16:26 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-864d569e-43d0-4055-9b45-ce50385561f2 tempest-VolumesGetTest-1325070593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-90de3300-cba4-448e-a4a5-237131336da0 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:26 devstack sudo[88656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-90de3300-cba4-448e-a4a5-237131336da0
Apr 10 13:16:26 devstack sudo[88656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:26 devstack sudo[88651]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:26 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-76fc09ac-d96f-45d8-b2fe-e19d41592373 tempest-SnapshotsActionsTest-802738678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.4f5b55c6-a3ad-4794-8bb5-40a452cfc583,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.1fa7d9d4-7e7f-495d-aea2-401f59d319da 1G" returned: 0 in 0.530s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:26 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-76fc09ac-d96f-45d8-b2fe-e19d41592373 tempest-SnapshotsActionsTest-802738678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.4f5b55c6-a3ad-4794-8bb5-40a452cfc583 -F qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.1fa7d9d4-7e7f-495d-aea2-401f59d319da {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:26 devstack sudo[88661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.4f5b55c6-a3ad-4794-8bb5-40a452cfc583 -F qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.1fa7d9d4-7e7f-495d-aea2-401f59d319da
Apr 10 13:16:26 devstack sudo[88661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:26 devstack sudo[88656]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:26 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-864d569e-43d0-4055-9b45-ce50385561f2 tempest-VolumesGetTest-1325070593 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-90de3300-cba4-448e-a4a5-237131336da0" returned: 0 in 0.575s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:26 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-864d569e-43d0-4055-9b45-ce50385561f2 tempest-VolumesGetTest-1325070593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-90de3300-cba4-448e-a4a5-237131336da0 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:27 devstack sudo[88665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-90de3300-cba4-448e-a4a5-237131336da0
Apr 10 13:16:27 devstack sudo[88665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:27 devstack sudo[88661]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:27 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-76fc09ac-d96f-45d8-b2fe-e19d41592373 tempest-SnapshotsActionsTest-802738678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.4f5b55c6-a3ad-4794-8bb5-40a452cfc583 -F qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.1fa7d9d4-7e7f-495d-aea2-401f59d319da" returned: 0 in 0.494s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:27 devstack cinder-volume[83345]: WARNING cinder.volume.drivers.remotefs [None req-76fc09ac-d96f-45d8-b2fe-e19d41592373 tempest-SnapshotsActionsTest-802738678 None] /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.1fa7d9d4-7e7f-495d-aea2-401f59d319da is being set with open permissions: ugo+rw
Apr 10 13:16:27 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-76fc09ac-d96f-45d8-b2fe-e19d41592373 tempest-SnapshotsActionsTest-802738678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.1fa7d9d4-7e7f-495d-aea2-401f59d319da {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:27 devstack sudo[88670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.1fa7d9d4-7e7f-495d-aea2-401f59d319da
Apr 10 13:16:27 devstack sudo[88670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:27 devstack sudo[88665]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:27 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-864d569e-43d0-4055-9b45-ce50385561f2 tempest-VolumesGetTest-1325070593 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-90de3300-cba4-448e-a4a5-237131336da0" returned: 1 in 0.509s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:27 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-864d569e-43d0-4055-9b45-ce50385561f2 tempest-VolumesGetTest-1325070593 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-90de3300-cba4-448e-a4a5-237131336da0' failed. Not Retrying. {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 10 13:16:27 devstack cinder-volume[83345]: DEBUG cinder.volume.volume_utils [None req-864d569e-43d0-4055-9b45-ce50385561f2 tempest-VolumesGetTest-1325070593 None] Downloaded image dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5 ((None, [{'url': 'file:///opt/stack/data/glance/images/dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5', 'metadata': {}}])) to volume 90de3300-cba4-448e-a4a5-237131336da0 successfully. {{(pid=83345) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 10 13:16:27 devstack cinder-volume[83345]: DEBUG cinder.image.image_utils [None req-864d569e-43d0-4055-9b45-ce50385561f2 tempest-VolumesGetTest-1325070593 None] Temporary image dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5 for user e6a465b820764bf78e3ec91bbb896b7f is deleted. {{(pid=83345) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 10 13:16:27 devstack cinder-volume[83345]: DEBUG cinder.volume.volume_utils [None req-864d569e-43d0-4055-9b45-ce50385561f2 tempest-VolumesGetTest-1325070593 None] Marking volume 90de3300-cba4-448e-a4a5-237131336da0 as bootable. {{(pid=83345) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 10 13:16:27 devstack cinder-volume[83345]: DEBUG dbcounter [-] [83345] Writing DB stats cinder:UPDATE=177,cinder:SELECT=134,cinder:DELETE=12,cinder:INSERT=33 {{(pid=83345) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 10 13:16:27 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-864d569e-43d0-4055-9b45-ce50385561f2 tempest-VolumesGetTest-1325070593 None] Copying metadata from image dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5 to 90de3300-cba4-448e-a4a5-237131336da0. {{(pid=83345) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 10 13:16:27 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-864d569e-43d0-4055-9b45-ce50385561f2 tempest-VolumesGetTest-1325070593 None] Creating volume glance metadata for volume 90de3300-cba4-448e-a4a5-237131336da0 backed by image dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83345) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 10 13:16:27 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-864d569e-43d0-4055-9b45-ce50385561f2 tempest-VolumesGetTest-1325070593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2351be73-1643-4ab6-b1f0-d6f76c141fb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90de3300-cba4-448e-a4a5-237131336da0', 'volume_size': 1, 'image_id': 'dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8c498714b5e64042a43894acdb754f15', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5', 'created_at': datetime.datetime(2026, 4, 10, 11, 6, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 10, 11, 6, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dd2f2a65-beb5-4d6d-b802-2ef0d49a1de5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f25211cee00>}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:16:27 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-864d569e-43d0-4055-9b45-ce50385561f2 tempest-VolumesGetTest-1325070593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a190fa0-b82b-437c-851b-7a0b484a438f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:16:27 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-864d569e-43d0-4055-9b45-ce50385561f2 tempest-VolumesGetTest-1325070593 None] Volume volume-90de3300-cba4-448e-a4a5-237131336da0 (90de3300-cba4-448e-a4a5-237131336da0): created successfully
Apr 10 13:16:27 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-864d569e-43d0-4055-9b45-ce50385561f2 tempest-VolumesGetTest-1325070593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a190fa0-b82b-437c-851b-7a0b484a438f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:16:27 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-864d569e-43d0-4055-9b45-ce50385561f2 tempest-VolumesGetTest-1325070593 None] Flow 'volume_create_manager' (4930bd13-171b-4a65-b536-b62fb81d8f88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:16:27 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-864d569e-43d0-4055-9b45-ce50385561f2 tempest-VolumesGetTest-1325070593 None] Created volume successfully.
Apr 10 13:16:27 devstack sudo[88670]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:27 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-76fc09ac-d96f-45d8-b2fe-e19d41592373 tempest-SnapshotsActionsTest-802738678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.1fa7d9d4-7e7f-495d-aea2-401f59d319da" returned: 0 in 0.425s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:27 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-76fc09ac-d96f-45d8-b2fe-e19d41592373 tempest-SnapshotsActionsTest-802738678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.184s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:16:27 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-ee1ee128-24e9-4c3b-903f-e3c2a3baadac tempest-VolumesSnapshotListTestJSON-947768007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.826s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:16:27 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-ee1ee128-24e9-4c3b-903f-e3c2a3baadac tempest-VolumesSnapshotListTestJSON-947768007 None] Creating offline snapshot 1558eb29-b192-4856-b31a-540233199897 of volume 4faf7785-29e6-4fbc-b559-705a84ceb769 {{(pid=83345) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 10 13:16:27 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-76fc09ac-d96f-45d8-b2fe-e19d41592373 tempest-SnapshotsActionsTest-802738678 None] Create snapshot completed successfully
Apr 10 13:16:27 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ffe909d-51a4-4a30-b4a5-db2818c54ea3]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:16:27 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ee1ee128-24e9-4c3b-903f-e3c2a3baadac tempest-VolumesSnapshotListTestJSON-947768007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4faf7785-29e6-4fbc-b559-705a84ceb769.a87dfedb-457b-43a8-b901-2778173ca043 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:27 devstack sudo[88676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4faf7785-29e6-4fbc-b559-705a84ceb769.a87dfedb-457b-43a8-b901-2778173ca043
Apr 10 13:16:27 devstack sudo[88676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:28 devstack sudo[88676]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:28 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ee1ee128-24e9-4c3b-903f-e3c2a3baadac tempest-VolumesSnapshotListTestJSON-947768007 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4faf7785-29e6-4fbc-b559-705a84ceb769.a87dfedb-457b-43a8-b901-2778173ca043" returned: 0 in 0.615s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:28 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-ee1ee128-24e9-4c3b-903f-e3c2a3baadac tempest-VolumesSnapshotListTestJSON-947768007 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4faf7785-29e6-4fbc-b559-705a84ceb769(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 13:16:28 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ee1ee128-24e9-4c3b-903f-e3c2a3baadac tempest-VolumesSnapshotListTestJSON-947768007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4faf7785-29e6-4fbc-b559-705a84ceb769.a87dfedb-457b-43a8-b901-2778173ca043,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4faf7785-29e6-4fbc-b559-705a84ceb769.1558eb29-b192-4856-b31a-540233199897 1G {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:28 devstack sudo[88715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4faf7785-29e6-4fbc-b559-705a84ceb769.a87dfedb-457b-43a8-b901-2778173ca043,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4faf7785-29e6-4fbc-b559-705a84ceb769.1558eb29-b192-4856-b31a-540233199897 1G
Apr 10 13:16:28 devstack sudo[88715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:28 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae409f39-e8e3-4978-887b-be27292ac98c tempest-VolumesGetTest-1325070593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:16:28 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ae409f39-e8e3-4978-887b-be27292ac98c tempest-VolumesGetTest-1325070593 None] Flow 'volume_create_manager' (bddb7672-6831-4fad-9750-a9199ed50f84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:16:28 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ae409f39-e8e3-4978-887b-be27292ac98c tempest-VolumesGetTest-1325070593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (777e76a2-cf59-4ca7-b5cb-67a8acbaa236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:16:28 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ae409f39-e8e3-4978-887b-be27292ac98c tempest-VolumesGetTest-1325070593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (777e76a2-cf59-4ca7-b5cb-67a8acbaa236) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:16:28Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1982972519',display_name='tempest-VolumesGetTest-Volume-140024360',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b86766e-2468-465e-86dc-3f4ad6b9ceaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2164901a19c74ad5a7ac47fa92772df3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:16:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:16:29Z,use_quota=True,user_id='e6a465b820764bf78e3ec91bbb896b7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:16:28 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ae409f39-e8e3-4978-887b-be27292ac98c tempest-VolumesGetTest-1325070593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e513905d-e908-4e6d-ba73-f87e263b069f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:16:28 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ae409f39-e8e3-4978-887b-be27292ac98c tempest-VolumesGetTest-1325070593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e513905d-e908-4e6d-ba73-f87e263b069f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:16:28 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ae409f39-e8e3-4978-887b-be27292ac98c tempest-VolumesGetTest-1325070593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc430e8a-7694-4a33-9116-2138a5ecd49c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:16:28 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ae409f39-e8e3-4978-887b-be27292ac98c tempest-VolumesGetTest-1325070593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc430e8a-7694-4a33-9116-2138a5ecd49c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b86766e-2468-465e-86dc-3f4ad6b9ceaf', 'volume_name': 'volume-1b86766e-2468-465e-86dc-3f4ad6b9ceaf', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:16:28 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ae409f39-e8e3-4978-887b-be27292ac98c tempest-VolumesGetTest-1325070593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c1533aa-2fb6-4699-8ef8-f5ad278e5330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:16:28 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ae409f39-e8e3-4978-887b-be27292ac98c tempest-VolumesGetTest-1325070593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c1533aa-2fb6-4699-8ef8-f5ad278e5330) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:16:28 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ae409f39-e8e3-4978-887b-be27292ac98c tempest-VolumesGetTest-1325070593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a63f2ccc-6a39-4f52-bff3-8d5d89f5a125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:16:28 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-ae409f39-e8e3-4978-887b-be27292ac98c tempest-VolumesGetTest-1325070593 None] Volume 1b86766e-2468-465e-86dc-3f4ad6b9ceaf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b86766e-2468-465e-86dc-3f4ad6b9ceaf', 'volume_size': 1}
Apr 10 13:16:28 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-ae409f39-e8e3-4978-887b-be27292ac98c tempest-VolumesGetTest-1325070593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:16:28 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-1d78f54a-727e-4165-afe2-15f10eba958d tempest-SnapshotsActionsTest-1189246844 None] Acquiring lock "cinder-1fa7d9d4-7e7f-495d-aea2-401f59d319da-delete_snapshot" by "delete_snapshot" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:16:28 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-1d78f54a-727e-4165-afe2-15f10eba958d tempest-SnapshotsActionsTest-1189246844 None] Lock "cinder-1fa7d9d4-7e7f-495d-aea2-401f59d319da-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:16:28 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-1d78f54a-727e-4165-afe2-15f10eba958d tempest-SnapshotsActionsTest-1189246844 None] Acquiring lock "cinder-quobyte-4f013013-ffcb-4dd4-8e73-3e004e4c6f11" by "delete_snapshot" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:16:28 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-1d78f54a-727e-4165-afe2-15f10eba958d tempest-SnapshotsActionsTest-1189246844 None] Lock "cinder-quobyte-4f013013-ffcb-4dd4-8e73-3e004e4c6f11" acquired by "delete_snapshot" :: waited 0.007s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:16:28 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-1d78f54a-727e-4165-afe2-15f10eba958d tempest-SnapshotsActionsTest-1189246844 None] Acquiring lock "cinder-quobyte-1fa7d9d4-7e7f-495d-aea2-401f59d319da" by "_delete_snapshot" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:16:28 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-1d78f54a-727e-4165-afe2-15f10eba958d tempest-SnapshotsActionsTest-1189246844 None] Lock "cinder-quobyte-1fa7d9d4-7e7f-495d-aea2-401f59d319da" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:16:28 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-1d78f54a-727e-4165-afe2-15f10eba958d tempest-SnapshotsActionsTest-1189246844 None] Deleting offline snapshot 1fa7d9d4-7e7f-495d-aea2-401f59d319da of volume 4f013013-ffcb-4dd4-8e73-3e004e4c6f11 {{(pid=83345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 10 13:16:28 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-1d78f54a-727e-4165-afe2-15f10eba958d tempest-SnapshotsActionsTest-1189246844 None] snapshot_file for this snap is: volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.1fa7d9d4-7e7f-495d-aea2-401f59d319da {{(pid=83345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 10 13:16:28 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b3c9711-554b-4ba6-8bd2-4c43e45397e7]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:16:28 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-1d78f54a-727e-4165-afe2-15f10eba958d tempest-SnapshotsActionsTest-1189246844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.1fa7d9d4-7e7f-495d-aea2-401f59d319da {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:28 devstack sudo[88717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.1fa7d9d4-7e7f-495d-aea2-401f59d319da
Apr 10 13:16:28 devstack sudo[88717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:28 devstack sudo[88715]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:28 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ee1ee128-24e9-4c3b-903f-e3c2a3baadac tempest-VolumesSnapshotListTestJSON-947768007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4faf7785-29e6-4fbc-b559-705a84ceb769.a87dfedb-457b-43a8-b901-2778173ca043,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4faf7785-29e6-4fbc-b559-705a84ceb769.1558eb29-b192-4856-b31a-540233199897 1G" returned: 0 in 0.676s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:29 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ee1ee128-24e9-4c3b-903f-e3c2a3baadac tempest-VolumesSnapshotListTestJSON-947768007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4faf7785-29e6-4fbc-b559-705a84ceb769.a87dfedb-457b-43a8-b901-2778173ca043 -F qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4faf7785-29e6-4fbc-b559-705a84ceb769.1558eb29-b192-4856-b31a-540233199897 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:29 devstack sudo[88722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4faf7785-29e6-4fbc-b559-705a84ceb769.a87dfedb-457b-43a8-b901-2778173ca043 -F qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4faf7785-29e6-4fbc-b559-705a84ceb769.1558eb29-b192-4856-b31a-540233199897
Apr 10 13:16:29 devstack sudo[88722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:29 devstack sudo[88717]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:29 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-1d78f54a-727e-4165-afe2-15f10eba958d tempest-SnapshotsActionsTest-1189246844 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.1fa7d9d4-7e7f-495d-aea2-401f59d319da" returned: 0 in 0.568s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:29 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-1d78f54a-727e-4165-afe2-15f10eba958d tempest-SnapshotsActionsTest-1189246844 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 13:16:29 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d45837b-5c5a-4a63-aee9-59740fab290f]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:16:29 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-1d78f54a-727e-4165-afe2-15f10eba958d tempest-SnapshotsActionsTest-1189246844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.4f5b55c6-a3ad-4794-8bb5-40a452cfc583 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:29 devstack sudo[88727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.4f5b55c6-a3ad-4794-8bb5-40a452cfc583
Apr 10 13:16:29 devstack sudo[88727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:29 devstack sudo[88722]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:29 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ee1ee128-24e9-4c3b-903f-e3c2a3baadac tempest-VolumesSnapshotListTestJSON-947768007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4faf7785-29e6-4fbc-b559-705a84ceb769.a87dfedb-457b-43a8-b901-2778173ca043 -F qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4faf7785-29e6-4fbc-b559-705a84ceb769.1558eb29-b192-4856-b31a-540233199897" returned: 0 in 0.480s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:29 devstack cinder-volume[83345]: WARNING cinder.volume.drivers.remotefs [None req-ee1ee128-24e9-4c3b-903f-e3c2a3baadac tempest-VolumesSnapshotListTestJSON-947768007 None] /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4faf7785-29e6-4fbc-b559-705a84ceb769.1558eb29-b192-4856-b31a-540233199897 is being set with open permissions: ugo+rw
Apr 10 13:16:29 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ee1ee128-24e9-4c3b-903f-e3c2a3baadac tempest-VolumesSnapshotListTestJSON-947768007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4faf7785-29e6-4fbc-b559-705a84ceb769.1558eb29-b192-4856-b31a-540233199897 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:29 devstack sudo[88732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4faf7785-29e6-4fbc-b559-705a84ceb769.1558eb29-b192-4856-b31a-540233199897
Apr 10 13:16:29 devstack sudo[88732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:29 devstack sudo[88727]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:29 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-1d78f54a-727e-4165-afe2-15f10eba958d tempest-SnapshotsActionsTest-1189246844 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.4f5b55c6-a3ad-4794-8bb5-40a452cfc583" returned: 0 in 0.530s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:29 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-1d78f54a-727e-4165-afe2-15f10eba958d tempest-SnapshotsActionsTest-1189246844 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 13:16:29 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-1d78f54a-727e-4165-afe2-15f10eba958d tempest-SnapshotsActionsTest-1189246844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.1fa7d9d4-7e7f-495d-aea2-401f59d319da {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:29 devstack sudo[88737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.1fa7d9d4-7e7f-495d-aea2-401f59d319da
Apr 10 13:16:29 devstack sudo[88737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:29 devstack sudo[88732]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:29 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ee1ee128-24e9-4c3b-903f-e3c2a3baadac tempest-VolumesSnapshotListTestJSON-947768007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4faf7785-29e6-4fbc-b559-705a84ceb769.1558eb29-b192-4856-b31a-540233199897" returned: 0 in 0.511s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:30 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-ee1ee128-24e9-4c3b-903f-e3c2a3baadac tempest-VolumesSnapshotListTestJSON-947768007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.350s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:16:30 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-ae409f39-e8e3-4978-887b-be27292ac98c tempest-VolumesGetTest-1325070593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.377s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:16:30 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-ae409f39-e8e3-4978-887b-be27292ac98c tempest-VolumesGetTest-1325070593 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f252bf08b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:16:28Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1982972519',display_name='tempest-VolumesGetTest-Volume-140024360',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b86766e-2468-465e-86dc-3f4ad6b9ceaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2164901a19c74ad5a7ac47fa92772df3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:16:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:16:29Z,use_quota=True,user_id='e6a465b820764bf78e3ec91bbb896b7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)}" {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 13:16:30 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-ae409f39-e8e3-4978-887b-be27292ac98c tempest-VolumesGetTest-1325070593 None] Creating volume 1b86766e-2468-465e-86dc-3f4ad6b9ceaf {{(pid=83345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 13:16:30 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-ae409f39-e8e3-4978-887b-be27292ac98c tempest-VolumesGetTest-1325070593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:16:30 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-ae409f39-e8e3-4978-887b-be27292ac98c tempest-VolumesGetTest-1325070593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:16:30 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-ae409f39-e8e3-4978-887b-be27292ac98c tempest-VolumesGetTest-1325070593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:16:30 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-ae409f39-e8e3-4978-887b-be27292ac98c tempest-VolumesGetTest-1325070593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:16:30 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-ae409f39-e8e3-4978-887b-be27292ac98c tempest-VolumesGetTest-1325070593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:16:30 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-ae409f39-e8e3-4978-887b-be27292ac98c tempest-VolumesGetTest-1325070593 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:16:30 devstack cinder-volume[83345]: INFO cinder.volume.drivers.remotefs [None req-ae409f39-e8e3-4978-887b-be27292ac98c tempest-VolumesGetTest-1325070593 None] casted to osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331
Apr 10 13:16:30 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ae409f39-e8e3-4978-887b-be27292ac98c tempest-VolumesGetTest-1325070593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-1b86766e-2468-465e-86dc-3f4ad6b9ceaf 1073741824 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:30 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-ee1ee128-24e9-4c3b-903f-e3c2a3baadac tempest-VolumesSnapshotListTestJSON-947768007 None] Create snapshot completed successfully
Apr 10 13:16:30 devstack sudo[88740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-1b86766e-2468-465e-86dc-3f4ad6b9ceaf 1073741824
Apr 10 13:16:30 devstack sudo[88740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:30 devstack sudo[88737]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:30 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-1d78f54a-727e-4165-afe2-15f10eba958d tempest-SnapshotsActionsTest-1189246844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.1fa7d9d4-7e7f-495d-aea2-401f59d319da" returned: 0 in 0.511s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:30 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-1d78f54a-727e-4165-afe2-15f10eba958d tempest-SnapshotsActionsTest-1189246844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.1fa7d9d4-7e7f-495d-aea2-401f59d319da {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:30 devstack sudo[88745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.1fa7d9d4-7e7f-495d-aea2-401f59d319da
Apr 10 13:16:30 devstack sudo[88745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:30 devstack sudo[88740]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:30 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ae409f39-e8e3-4978-887b-be27292ac98c tempest-VolumesGetTest-1325070593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-1b86766e-2468-465e-86dc-3f4ad6b9ceaf 1073741824" returned: 0 in 0.595s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:30 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ae409f39-e8e3-4978-887b-be27292ac98c tempest-VolumesGetTest-1325070593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-1b86766e-2468-465e-86dc-3f4ad6b9ceaf {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:30 devstack sudo[88750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-1b86766e-2468-465e-86dc-3f4ad6b9ceaf
Apr 10 13:16:30 devstack sudo[88750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:30 devstack sudo[88745]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:30 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-1d78f54a-727e-4165-afe2-15f10eba958d tempest-SnapshotsActionsTest-1189246844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.1fa7d9d4-7e7f-495d-aea2-401f59d319da" returned: 0 in 0.464s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:30 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-1d78f54a-727e-4165-afe2-15f10eba958d tempest-SnapshotsActionsTest-1189246844 None] Lock "cinder-quobyte-1fa7d9d4-7e7f-495d-aea2-401f59d319da" released by "_delete_snapshot" :: held 2.121s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:16:30 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-1d78f54a-727e-4165-afe2-15f10eba958d tempest-SnapshotsActionsTest-1189246844 None] Lock "cinder-quobyte-4f013013-ffcb-4dd4-8e73-3e004e4c6f11" released by "delete_snapshot" :: held 2.133s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:16:30 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-1d78f54a-727e-4165-afe2-15f10eba958d tempest-SnapshotsActionsTest-1189246844 None] Created reservations ['97200ca2-8421-4f77-a723-7df01a77335b', 'e2bca1c8-85d5-4f07-b065-1b7a76925d60', '2906cab7-f8d2-4b89-98da-0476fc34967b', 'a73646b9-c88a-48e1-83d4-ed3431e33923'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:16:30 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-1d78f54a-727e-4165-afe2-15f10eba958d tempest-SnapshotsActionsTest-1189246844 None] Delete snapshot completed successfully.
Apr 10 13:16:30 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-1d78f54a-727e-4165-afe2-15f10eba958d tempest-SnapshotsActionsTest-1189246844 None] Lock "cinder-1fa7d9d4-7e7f-495d-aea2-401f59d319da-delete_snapshot" released by "delete_snapshot" :: held 2.223s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:16:31 devstack sudo[88750]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:31 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ae409f39-e8e3-4978-887b-be27292ac98c tempest-VolumesGetTest-1325070593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-1b86766e-2468-465e-86dc-3f4ad6b9ceaf" returned: 0 in 0.514s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:31 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-ae409f39-e8e3-4978-887b-be27292ac98c tempest-VolumesGetTest-1325070593 None] <== create_volume: return (1138ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'} {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 13:16:31 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-ae409f39-e8e3-4978-887b-be27292ac98c tempest-VolumesGetTest-1325070593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.141s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:16:31 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ae409f39-e8e3-4978-887b-be27292ac98c tempest-VolumesGetTest-1325070593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a63f2ccc-6a39-4f52-bff3-8d5d89f5a125) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b86766e-2468-465e-86dc-3f4ad6b9ceaf', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:16:31 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ae409f39-e8e3-4978-887b-be27292ac98c tempest-VolumesGetTest-1325070593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b20f5a1-55dc-47e0-8e07-3e8370f78d52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:16:31 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-ae409f39-e8e3-4978-887b-be27292ac98c tempest-VolumesGetTest-1325070593 None] Volume volume-1b86766e-2468-465e-86dc-3f4ad6b9ceaf (1b86766e-2468-465e-86dc-3f4ad6b9ceaf): created successfully
Apr 10 13:16:31 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ae409f39-e8e3-4978-887b-be27292ac98c tempest-VolumesGetTest-1325070593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b20f5a1-55dc-47e0-8e07-3e8370f78d52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:16:31 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ae409f39-e8e3-4978-887b-be27292ac98c tempest-VolumesGetTest-1325070593 None] Flow 'volume_create_manager' (bddb7672-6831-4fad-9750-a9199ed50f84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:16:31 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-ae409f39-e8e3-4978-887b-be27292ac98c tempest-VolumesGetTest-1325070593 None] Created volume successfully.
Apr 10 13:16:31 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-069200a7-9a91-4f06-be8b-217dc2a3934c tempest-VolumesSnapshotListTestJSON-947768007 None] Acquiring lock "cinder-1558eb29-b192-4856-b31a-540233199897-delete_snapshot" by "delete_snapshot" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:16:31 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-58d17971-882d-4fc5-9c6a-c870694e3dd1 tempest-VolumesSnapshotTestJSON-825888665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:16:31 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-58d17971-882d-4fc5-9c6a-c870694e3dd1 tempest-VolumesSnapshotTestJSON-825888665 None] Flow 'volume_create_manager' (3e120d5f-0fdc-4642-999d-cc787aebd1f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:16:31 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-58d17971-882d-4fc5-9c6a-c870694e3dd1 tempest-VolumesSnapshotTestJSON-825888665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02779de5-2e4a-4a73-b56f-23763d146325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:16:31 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-069200a7-9a91-4f06-be8b-217dc2a3934c tempest-VolumesSnapshotListTestJSON-947768007 None] Lock "cinder-1558eb29-b192-4856-b31a-540233199897-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:16:31 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-069200a7-9a91-4f06-be8b-217dc2a3934c tempest-VolumesSnapshotListTestJSON-947768007 None] Acquiring lock "cinder-quobyte-4faf7785-29e6-4fbc-b559-705a84ceb769" by "delete_snapshot" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:16:31 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-58d17971-882d-4fc5-9c6a-c870694e3dd1 tempest-VolumesSnapshotTestJSON-825888665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02779de5-2e4a-4a73-b56f-23763d146325) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:16:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1766240854',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c50dafa0-5ef5-44b3-8d74-4e87989cecb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a23589ebdac46368f1e33de5aeb8af1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:16:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:16:32Z,use_quota=True,user_id='5bb118cb04cc4be28306326a911fb71f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:16:31 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-58d17971-882d-4fc5-9c6a-c870694e3dd1 tempest-VolumesSnapshotTestJSON-825888665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0962fb2f-1ac3-422b-adcd-db40cd458110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:16:31 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-58d17971-882d-4fc5-9c6a-c870694e3dd1 tempest-VolumesSnapshotTestJSON-825888665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0962fb2f-1ac3-422b-adcd-db40cd458110) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:16:31 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-58d17971-882d-4fc5-9c6a-c870694e3dd1 tempest-VolumesSnapshotTestJSON-825888665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8c625e6-9ecd-4a07-92d5-f63d27f766e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:16:31 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-58d17971-882d-4fc5-9c6a-c870694e3dd1 tempest-VolumesSnapshotTestJSON-825888665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8c625e6-9ecd-4a07-92d5-f63d27f766e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c50dafa0-5ef5-44b3-8d74-4e87989cecb7', 'volume_name': 'volume-c50dafa0-5ef5-44b3-8d74-4e87989cecb7', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:16:31 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-58d17971-882d-4fc5-9c6a-c870694e3dd1 tempest-VolumesSnapshotTestJSON-825888665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af28ec10-098c-4a7b-96d4-0ea000bfb14d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:16:31 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-58d17971-882d-4fc5-9c6a-c870694e3dd1 tempest-VolumesSnapshotTestJSON-825888665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af28ec10-098c-4a7b-96d4-0ea000bfb14d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:16:31 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-58d17971-882d-4fc5-9c6a-c870694e3dd1 tempest-VolumesSnapshotTestJSON-825888665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf980f1d-d5ac-49c2-b0e2-0a500de51528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:16:31 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-58d17971-882d-4fc5-9c6a-c870694e3dd1 tempest-VolumesSnapshotTestJSON-825888665 None] Volume c50dafa0-5ef5-44b3-8d74-4e87989cecb7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c50dafa0-5ef5-44b3-8d74-4e87989cecb7', 'volume_size': 1}
Apr 10 13:16:31 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-58d17971-882d-4fc5-9c6a-c870694e3dd1 tempest-VolumesSnapshotTestJSON-825888665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:16:31 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-58d17971-882d-4fc5-9c6a-c870694e3dd1 tempest-VolumesSnapshotTestJSON-825888665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:16:31 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-58d17971-882d-4fc5-9c6a-c870694e3dd1 tempest-VolumesSnapshotTestJSON-825888665 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f252bf08b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:16:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1766240854',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c50dafa0-5ef5-44b3-8d74-4e87989cecb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a23589ebdac46368f1e33de5aeb8af1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:16:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:16:32Z,use_quota=True,user_id='5bb118cb04cc4be28306326a911fb71f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)}" {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 13:16:31 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-58d17971-882d-4fc5-9c6a-c870694e3dd1 tempest-VolumesSnapshotTestJSON-825888665 None] Creating volume c50dafa0-5ef5-44b3-8d74-4e87989cecb7 {{(pid=83345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 13:16:31 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-58d17971-882d-4fc5-9c6a-c870694e3dd1 tempest-VolumesSnapshotTestJSON-825888665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:16:31 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-58d17971-882d-4fc5-9c6a-c870694e3dd1 tempest-VolumesSnapshotTestJSON-825888665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:16:31 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-58d17971-882d-4fc5-9c6a-c870694e3dd1 tempest-VolumesSnapshotTestJSON-825888665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:16:31 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-58d17971-882d-4fc5-9c6a-c870694e3dd1 tempest-VolumesSnapshotTestJSON-825888665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:16:31 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-58d17971-882d-4fc5-9c6a-c870694e3dd1 tempest-VolumesSnapshotTestJSON-825888665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:16:31 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-58d17971-882d-4fc5-9c6a-c870694e3dd1 tempest-VolumesSnapshotTestJSON-825888665 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:16:31 devstack cinder-volume[83345]: INFO cinder.volume.drivers.remotefs [None req-58d17971-882d-4fc5-9c6a-c870694e3dd1 tempest-VolumesSnapshotTestJSON-825888665 None] casted to osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331
Apr 10 13:16:31 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-58d17971-882d-4fc5-9c6a-c870694e3dd1 tempest-VolumesSnapshotTestJSON-825888665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-c50dafa0-5ef5-44b3-8d74-4e87989cecb7 1073741824 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:31 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-069200a7-9a91-4f06-be8b-217dc2a3934c tempest-VolumesSnapshotListTestJSON-947768007 None] Lock "cinder-quobyte-4faf7785-29e6-4fbc-b559-705a84ceb769" acquired by "delete_snapshot" :: waited 0.059s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:16:31 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-069200a7-9a91-4f06-be8b-217dc2a3934c tempest-VolumesSnapshotListTestJSON-947768007 None] Acquiring lock "cinder-quobyte-1558eb29-b192-4856-b31a-540233199897" by "_delete_snapshot" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:16:31 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-069200a7-9a91-4f06-be8b-217dc2a3934c tempest-VolumesSnapshotListTestJSON-947768007 None] Lock "cinder-quobyte-1558eb29-b192-4856-b31a-540233199897" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:16:31 devstack sudo[88755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-c50dafa0-5ef5-44b3-8d74-4e87989cecb7 1073741824
Apr 10 13:16:31 devstack sudo[88755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:31 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-069200a7-9a91-4f06-be8b-217dc2a3934c tempest-VolumesSnapshotListTestJSON-947768007 None] Deleting offline snapshot 1558eb29-b192-4856-b31a-540233199897 of volume 4faf7785-29e6-4fbc-b559-705a84ceb769 {{(pid=83345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 10 13:16:31 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-069200a7-9a91-4f06-be8b-217dc2a3934c tempest-VolumesSnapshotListTestJSON-947768007 None] snapshot_file for this snap is: volume-4faf7785-29e6-4fbc-b559-705a84ceb769.1558eb29-b192-4856-b31a-540233199897 {{(pid=83345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 10 13:16:31 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[fca43ed3-faac-4de1-b87c-67574afb005b]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:16:31 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-069200a7-9a91-4f06-be8b-217dc2a3934c tempest-VolumesSnapshotListTestJSON-947768007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4faf7785-29e6-4fbc-b559-705a84ceb769.1558eb29-b192-4856-b31a-540233199897 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:31 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-196fc915-3169-4b94-a81f-ffbdb3419c60 tempest-VolumesGetTest-1325070593 None] Acquiring lock "cinder-1b86766e-2468-465e-86dc-3f4ad6b9ceaf-delete_volume" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:16:31 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-196fc915-3169-4b94-a81f-ffbdb3419c60 tempest-VolumesGetTest-1325070593 None] Lock "cinder-1b86766e-2468-465e-86dc-3f4ad6b9ceaf-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:16:31 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-196fc915-3169-4b94-a81f-ffbdb3419c60 tempest-VolumesGetTest-1325070593 None] Acquiring lock "cinder-quobyte-1b86766e-2468-465e-86dc-3f4ad6b9ceaf" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:16:31 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-196fc915-3169-4b94-a81f-ffbdb3419c60 tempest-VolumesGetTest-1325070593 None] Lock "cinder-quobyte-1b86766e-2468-465e-86dc-3f4ad6b9ceaf" acquired by "delete_volume" :: waited 0.010s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:16:31 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[af56e939-f0a1-4b68-b42e-b03317cce365]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:16:31 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-196fc915-3169-4b94-a81f-ffbdb3419c60 tempest-VolumesGetTest-1325070593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-1b86766e-2468-465e-86dc-3f4ad6b9ceaf {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:31 devstack sudo[88757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4faf7785-29e6-4fbc-b559-705a84ceb769.1558eb29-b192-4856-b31a-540233199897
Apr 10 13:16:31 devstack sudo[88757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:31 devstack sudo[88759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-1b86766e-2468-465e-86dc-3f4ad6b9ceaf
Apr 10 13:16:31 devstack sudo[88759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:31 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-a98beb93-2965-4f82-a8cf-3da00b903989 tempest-SnapshotsActionsTest-802738678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:16:32 devstack sudo[88755]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:32 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-58d17971-882d-4fc5-9c6a-c870694e3dd1 tempest-VolumesSnapshotTestJSON-825888665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-c50dafa0-5ef5-44b3-8d74-4e87989cecb7 1073741824" returned: 0 in 0.565s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:32 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-58d17971-882d-4fc5-9c6a-c870694e3dd1 tempest-VolumesSnapshotTestJSON-825888665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-c50dafa0-5ef5-44b3-8d74-4e87989cecb7 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:32 devstack sudo[88767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-c50dafa0-5ef5-44b3-8d74-4e87989cecb7
Apr 10 13:16:32 devstack sudo[88767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:32 devstack sudo[88757]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:32 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-069200a7-9a91-4f06-be8b-217dc2a3934c tempest-VolumesSnapshotListTestJSON-947768007 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4faf7785-29e6-4fbc-b559-705a84ceb769.1558eb29-b192-4856-b31a-540233199897" returned: 0 in 0.583s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:32 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-069200a7-9a91-4f06-be8b-217dc2a3934c tempest-VolumesSnapshotListTestJSON-947768007 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4faf7785-29e6-4fbc-b559-705a84ceb769(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 13:16:32 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e51d1f1-d548-4f75-9d1e-d4734d9dadb0]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:16:32 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-069200a7-9a91-4f06-be8b-217dc2a3934c tempest-VolumesSnapshotListTestJSON-947768007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4faf7785-29e6-4fbc-b559-705a84ceb769.a87dfedb-457b-43a8-b901-2778173ca043 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:32 devstack sudo[88771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4faf7785-29e6-4fbc-b559-705a84ceb769.a87dfedb-457b-43a8-b901-2778173ca043
Apr 10 13:16:32 devstack sudo[88771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:32 devstack sudo[88759]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:32 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-196fc915-3169-4b94-a81f-ffbdb3419c60 tempest-VolumesGetTest-1325070593 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-1b86766e-2468-465e-86dc-3f4ad6b9ceaf" returned: 0 in 0.557s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:32 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-196fc915-3169-4b94-a81f-ffbdb3419c60 tempest-VolumesGetTest-1325070593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-1b86766e-2468-465e-86dc-3f4ad6b9ceaf {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:32 devstack sudo[88774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-1b86766e-2468-465e-86dc-3f4ad6b9ceaf
Apr 10 13:16:32 devstack sudo[88774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:32 devstack sudo[88767]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:32 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-58d17971-882d-4fc5-9c6a-c870694e3dd1 tempest-VolumesSnapshotTestJSON-825888665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-c50dafa0-5ef5-44b3-8d74-4e87989cecb7" returned: 0 in 0.427s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:32 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-58d17971-882d-4fc5-9c6a-c870694e3dd1 tempest-VolumesSnapshotTestJSON-825888665 None] <== create_volume: return (1016ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'} {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 13:16:32 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-58d17971-882d-4fc5-9c6a-c870694e3dd1 tempest-VolumesSnapshotTestJSON-825888665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.018s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:16:32 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-a98beb93-2965-4f82-a8cf-3da00b903989 tempest-SnapshotsActionsTest-802738678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.741s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:16:32 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-58d17971-882d-4fc5-9c6a-c870694e3dd1 tempest-VolumesSnapshotTestJSON-825888665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf980f1d-d5ac-49c2-b0e2-0a500de51528) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c50dafa0-5ef5-44b3-8d74-4e87989cecb7', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:16:32 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-58d17971-882d-4fc5-9c6a-c870694e3dd1 tempest-VolumesSnapshotTestJSON-825888665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfb19cb3-1623-4263-90c6-091cf5d7654a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:16:32 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-a98beb93-2965-4f82-a8cf-3da00b903989 tempest-SnapshotsActionsTest-802738678 None] Creating offline snapshot ffad0697-3971-4016-9246-ae68b80cab9e of volume 4f013013-ffcb-4dd4-8e73-3e004e4c6f11 {{(pid=83345) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 10 13:16:32 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[76187ff8-3e2e-4667-9410-1d3965827daf]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:16:32 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-a98beb93-2965-4f82-a8cf-3da00b903989 tempest-SnapshotsActionsTest-802738678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.4f5b55c6-a3ad-4794-8bb5-40a452cfc583 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:32 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-58d17971-882d-4fc5-9c6a-c870694e3dd1 tempest-VolumesSnapshotTestJSON-825888665 None] Volume volume-c50dafa0-5ef5-44b3-8d74-4e87989cecb7 (c50dafa0-5ef5-44b3-8d74-4e87989cecb7): created successfully
Apr 10 13:16:32 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-58d17971-882d-4fc5-9c6a-c870694e3dd1 tempest-VolumesSnapshotTestJSON-825888665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfb19cb3-1623-4263-90c6-091cf5d7654a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:16:32 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-58d17971-882d-4fc5-9c6a-c870694e3dd1 tempest-VolumesSnapshotTestJSON-825888665 None] Flow 'volume_create_manager' (3e120d5f-0fdc-4642-999d-cc787aebd1f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:16:32 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-58d17971-882d-4fc5-9c6a-c870694e3dd1 tempest-VolumesSnapshotTestJSON-825888665 None] Created volume successfully.
Apr 10 13:16:32 devstack sudo[88780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.4f5b55c6-a3ad-4794-8bb5-40a452cfc583
Apr 10 13:16:32 devstack sudo[88780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:32 devstack sudo[88771]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:32 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-069200a7-9a91-4f06-be8b-217dc2a3934c tempest-VolumesSnapshotListTestJSON-947768007 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4faf7785-29e6-4fbc-b559-705a84ceb769.a87dfedb-457b-43a8-b901-2778173ca043" returned: 0 in 0.520s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:32 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-069200a7-9a91-4f06-be8b-217dc2a3934c tempest-VolumesSnapshotListTestJSON-947768007 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4faf7785-29e6-4fbc-b559-705a84ceb769(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 13:16:32 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-069200a7-9a91-4f06-be8b-217dc2a3934c tempest-VolumesSnapshotListTestJSON-947768007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4faf7785-29e6-4fbc-b559-705a84ceb769.1558eb29-b192-4856-b31a-540233199897 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:32 devstack sudo[88783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4faf7785-29e6-4fbc-b559-705a84ceb769.1558eb29-b192-4856-b31a-540233199897
Apr 10 13:16:32 devstack sudo[88783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:32 devstack sudo[88774]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:32 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-196fc915-3169-4b94-a81f-ffbdb3419c60 tempest-VolumesGetTest-1325070593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-1b86766e-2468-465e-86dc-3f4ad6b9ceaf" returned: 0 in 0.496s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:32 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-196fc915-3169-4b94-a81f-ffbdb3419c60 tempest-VolumesGetTest-1325070593 None] Lock "cinder-quobyte-1b86766e-2468-465e-86dc-3f4ad6b9ceaf" released by "delete_volume" :: held 1.082s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:16:32 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-196fc915-3169-4b94-a81f-ffbdb3419c60 tempest-VolumesGetTest-1325070593 None] Created reservations ['719d3d05-a45d-4c48-a8ed-6cafb2a4ba96', '5868500f-308a-403d-87fc-6a7cb51836f7', 'ee2c724a-249a-419f-8841-4ef90b250574', '1b62e611-543b-4ecb-9189-526f524d5ee5'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:16:33 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-196fc915-3169-4b94-a81f-ffbdb3419c60 tempest-VolumesGetTest-1325070593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:16:33 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-196fc915-3169-4b94-a81f-ffbdb3419c60 tempest-VolumesGetTest-1325070593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:16:33 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-196fc915-3169-4b94-a81f-ffbdb3419c60 tempest-VolumesGetTest-1325070593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:16:33 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-196fc915-3169-4b94-a81f-ffbdb3419c60 tempest-VolumesGetTest-1325070593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:16:33 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-196fc915-3169-4b94-a81f-ffbdb3419c60 tempest-VolumesGetTest-1325070593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:16:33 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-196fc915-3169-4b94-a81f-ffbdb3419c60 tempest-VolumesGetTest-1325070593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:33 devstack sudo[88785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:16:33 devstack sudo[88785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:33 devstack sudo[88780]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:33 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-a98beb93-2965-4f82-a8cf-3da00b903989 tempest-SnapshotsActionsTest-802738678 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.4f5b55c6-a3ad-4794-8bb5-40a452cfc583" returned: 0 in 0.523s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:33 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-a98beb93-2965-4f82-a8cf-3da00b903989 tempest-SnapshotsActionsTest-802738678 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 13:16:33 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-a98beb93-2965-4f82-a8cf-3da00b903989 tempest-SnapshotsActionsTest-802738678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.4f5b55c6-a3ad-4794-8bb5-40a452cfc583,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.ffad0697-3971-4016-9246-ae68b80cab9e 1G {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:33 devstack sudo[88793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.4f5b55c6-a3ad-4794-8bb5-40a452cfc583,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.ffad0697-3971-4016-9246-ae68b80cab9e 1G
Apr 10 13:16:33 devstack sudo[88793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:33 devstack sudo[88783]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:33 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-069200a7-9a91-4f06-be8b-217dc2a3934c tempest-VolumesSnapshotListTestJSON-947768007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4faf7785-29e6-4fbc-b559-705a84ceb769.1558eb29-b192-4856-b31a-540233199897" returned: 0 in 0.501s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:33 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-069200a7-9a91-4f06-be8b-217dc2a3934c tempest-VolumesSnapshotListTestJSON-947768007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4faf7785-29e6-4fbc-b559-705a84ceb769.1558eb29-b192-4856-b31a-540233199897 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:33 devstack sudo[88795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4faf7785-29e6-4fbc-b559-705a84ceb769.1558eb29-b192-4856-b31a-540233199897
Apr 10 13:16:33 devstack sudo[88795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:33 devstack sudo[88785]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:33 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-196fc915-3169-4b94-a81f-ffbdb3419c60 tempest-VolumesGetTest-1325070593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.426s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:33 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-196fc915-3169-4b94-a81f-ffbdb3419c60 tempest-VolumesGetTest-1325070593 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:16:33 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-196fc915-3169-4b94-a81f-ffbdb3419c60 tempest-VolumesGetTest-1325070593 None] Deleted volume successfully.
Apr 10 13:16:33 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-196fc915-3169-4b94-a81f-ffbdb3419c60 tempest-VolumesGetTest-1325070593 None] Lock "cinder-1b86766e-2468-465e-86dc-3f4ad6b9ceaf-delete_volume" released by "delete_volume" :: held 1.684s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:16:33 devstack sudo[88795]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:33 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-069200a7-9a91-4f06-be8b-217dc2a3934c tempest-VolumesSnapshotListTestJSON-947768007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4faf7785-29e6-4fbc-b559-705a84ceb769.1558eb29-b192-4856-b31a-540233199897" returned: 0 in 0.434s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:33 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-069200a7-9a91-4f06-be8b-217dc2a3934c tempest-VolumesSnapshotListTestJSON-947768007 None] Lock "cinder-quobyte-1558eb29-b192-4856-b31a-540233199897" released by "_delete_snapshot" :: held 2.086s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:16:33 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-069200a7-9a91-4f06-be8b-217dc2a3934c tempest-VolumesSnapshotListTestJSON-947768007 None] Lock "cinder-quobyte-4faf7785-29e6-4fbc-b559-705a84ceb769" released by "delete_snapshot" :: held 2.103s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:16:33 devstack sudo[88793]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:33 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-a98beb93-2965-4f82-a8cf-3da00b903989 tempest-SnapshotsActionsTest-802738678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.4f5b55c6-a3ad-4794-8bb5-40a452cfc583,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.ffad0697-3971-4016-9246-ae68b80cab9e 1G" returned: 0 in 0.551s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:33 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-a98beb93-2965-4f82-a8cf-3da00b903989 tempest-SnapshotsActionsTest-802738678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.4f5b55c6-a3ad-4794-8bb5-40a452cfc583 -F qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.ffad0697-3971-4016-9246-ae68b80cab9e {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:33 devstack sudo[88802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.4f5b55c6-a3ad-4794-8bb5-40a452cfc583 -F qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.ffad0697-3971-4016-9246-ae68b80cab9e
Apr 10 13:16:33 devstack sudo[88802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:33 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-069200a7-9a91-4f06-be8b-217dc2a3934c tempest-VolumesSnapshotListTestJSON-947768007 None] Created reservations ['409d09b4-e56c-4549-8608-9a3dc1dc5326', '6712d94c-d8c6-40a2-b8b6-d39b60af32d3', 'ebed3ee8-2bd3-4be0-933b-70ae14ddab14', '73bb5554-9cd6-4004-9334-40d0dad26446'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:16:33 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-069200a7-9a91-4f06-be8b-217dc2a3934c tempest-VolumesSnapshotListTestJSON-947768007 None] Delete snapshot completed successfully.
Apr 10 13:16:33 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-069200a7-9a91-4f06-be8b-217dc2a3934c tempest-VolumesSnapshotListTestJSON-947768007 None] Lock "cinder-1558eb29-b192-4856-b31a-540233199897-delete_snapshot" released by "delete_snapshot" :: held 2.296s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:16:33 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-3e1210f6-f110-4d2f-8b45-98216d91c199 tempest-VolumesSnapshotTestJSON-825888665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:16:34 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-490e8443-3d0a-463b-8a42-a3c018cb9c01 tempest-VolumesGetTest-1325070593 None] Acquiring lock "cinder-90de3300-cba4-448e-a4a5-237131336da0-delete_volume" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:16:34 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-490e8443-3d0a-463b-8a42-a3c018cb9c01 tempest-VolumesGetTest-1325070593 None] Lock "cinder-90de3300-cba4-448e-a4a5-237131336da0-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:16:34 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-490e8443-3d0a-463b-8a42-a3c018cb9c01 tempest-VolumesGetTest-1325070593 None] Acquiring lock "cinder-quobyte-90de3300-cba4-448e-a4a5-237131336da0" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:16:34 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-490e8443-3d0a-463b-8a42-a3c018cb9c01 tempest-VolumesGetTest-1325070593 None] Lock "cinder-quobyte-90de3300-cba4-448e-a4a5-237131336da0" acquired by "delete_volume" :: waited 0.006s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:16:34 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[6425c3ea-f68c-4c12-bca7-48a732f37123]: (4, 'raw') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:16:34 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-490e8443-3d0a-463b-8a42-a3c018cb9c01 tempest-VolumesGetTest-1325070593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-90de3300-cba4-448e-a4a5-237131336da0 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:34 devstack sudo[88804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-90de3300-cba4-448e-a4a5-237131336da0
Apr 10 13:16:34 devstack sudo[88804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:34 devstack sudo[88802]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:34 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-a98beb93-2965-4f82-a8cf-3da00b903989 tempest-SnapshotsActionsTest-802738678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.4f5b55c6-a3ad-4794-8bb5-40a452cfc583 -F qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.ffad0697-3971-4016-9246-ae68b80cab9e" returned: 0 in 0.505s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:34 devstack cinder-volume[83345]: WARNING cinder.volume.drivers.remotefs [None req-a98beb93-2965-4f82-a8cf-3da00b903989 tempest-SnapshotsActionsTest-802738678 None] /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.ffad0697-3971-4016-9246-ae68b80cab9e is being set with open permissions: ugo+rw
Apr 10 13:16:34 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-a98beb93-2965-4f82-a8cf-3da00b903989 tempest-SnapshotsActionsTest-802738678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.ffad0697-3971-4016-9246-ae68b80cab9e {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:34 devstack sudo[88809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.ffad0697-3971-4016-9246-ae68b80cab9e
Apr 10 13:16:34 devstack sudo[88809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:34 devstack sudo[88804]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:34 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-490e8443-3d0a-463b-8a42-a3c018cb9c01 tempest-VolumesGetTest-1325070593 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-90de3300-cba4-448e-a4a5-237131336da0" returned: 0 in 0.510s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:34 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-490e8443-3d0a-463b-8a42-a3c018cb9c01 tempest-VolumesGetTest-1325070593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-90de3300-cba4-448e-a4a5-237131336da0 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:34 devstack sudo[88813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-90de3300-cba4-448e-a4a5-237131336da0
Apr 10 13:16:34 devstack sudo[88813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:34 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-ae64b0d7-813f-4917-94bd-4f2d858b46ed tempest-VolumesSnapshotListTestJSON-947768007 None] Acquiring lock "cinder-a87dfedb-457b-43a8-b901-2778173ca043-delete_snapshot" by "delete_snapshot" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:16:34 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-ae64b0d7-813f-4917-94bd-4f2d858b46ed tempest-VolumesSnapshotListTestJSON-947768007 None] Lock "cinder-a87dfedb-457b-43a8-b901-2778173ca043-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:16:34 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-ae64b0d7-813f-4917-94bd-4f2d858b46ed tempest-VolumesSnapshotListTestJSON-947768007 None] Acquiring lock "cinder-quobyte-4faf7785-29e6-4fbc-b559-705a84ceb769" by "delete_snapshot" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:16:34 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-ae64b0d7-813f-4917-94bd-4f2d858b46ed tempest-VolumesSnapshotListTestJSON-947768007 None] Lock "cinder-quobyte-4faf7785-29e6-4fbc-b559-705a84ceb769" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:16:34 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-ae64b0d7-813f-4917-94bd-4f2d858b46ed tempest-VolumesSnapshotListTestJSON-947768007 None] Acquiring lock "cinder-quobyte-a87dfedb-457b-43a8-b901-2778173ca043" by "_delete_snapshot" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:16:34 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-ae64b0d7-813f-4917-94bd-4f2d858b46ed tempest-VolumesSnapshotListTestJSON-947768007 None] Lock "cinder-quobyte-a87dfedb-457b-43a8-b901-2778173ca043" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:16:34 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-ae64b0d7-813f-4917-94bd-4f2d858b46ed tempest-VolumesSnapshotListTestJSON-947768007 None] Deleting offline snapshot a87dfedb-457b-43a8-b901-2778173ca043 of volume 4faf7785-29e6-4fbc-b559-705a84ceb769 {{(pid=83345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 10 13:16:34 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-ae64b0d7-813f-4917-94bd-4f2d858b46ed tempest-VolumesSnapshotListTestJSON-947768007 None] snapshot_file for this snap is: volume-4faf7785-29e6-4fbc-b559-705a84ceb769.a87dfedb-457b-43a8-b901-2778173ca043 {{(pid=83345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 10 13:16:34 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[909bc2c5-2b44-4d1b-929c-97d8ce252973]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:16:34 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ae64b0d7-813f-4917-94bd-4f2d858b46ed tempest-VolumesSnapshotListTestJSON-947768007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4faf7785-29e6-4fbc-b559-705a84ceb769.a87dfedb-457b-43a8-b901-2778173ca043 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:34 devstack sudo[88809]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:34 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-a98beb93-2965-4f82-a8cf-3da00b903989 tempest-SnapshotsActionsTest-802738678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.ffad0697-3971-4016-9246-ae68b80cab9e" returned: 0 in 0.543s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:34 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-a98beb93-2965-4f82-a8cf-3da00b903989 tempest-SnapshotsActionsTest-802738678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.195s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:16:34 devstack sudo[88816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4faf7785-29e6-4fbc-b559-705a84ceb769.a87dfedb-457b-43a8-b901-2778173ca043
Apr 10 13:16:34 devstack sudo[88816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:34 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-3e1210f6-f110-4d2f-8b45-98216d91c199 tempest-VolumesSnapshotTestJSON-825888665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.953s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:16:34 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-3e1210f6-f110-4d2f-8b45-98216d91c199 tempest-VolumesSnapshotTestJSON-825888665 None] Creating offline snapshot 02267f13-2e4f-484e-aa3e-599161ecea26 of volume c50dafa0-5ef5-44b3-8d74-4e87989cecb7 {{(pid=83345) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 10 13:16:34 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-a98beb93-2965-4f82-a8cf-3da00b903989 tempest-SnapshotsActionsTest-802738678 None] Create snapshot completed successfully
Apr 10 13:16:34 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[14eed550-49d3-4d00-a55c-eb3af772399a]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:16:34 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-3e1210f6-f110-4d2f-8b45-98216d91c199 tempest-VolumesSnapshotTestJSON-825888665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-c50dafa0-5ef5-44b3-8d74-4e87989cecb7 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:35 devstack sudo[88818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-c50dafa0-5ef5-44b3-8d74-4e87989cecb7
Apr 10 13:16:35 devstack sudo[88818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:35 devstack sudo[88813]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:35 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-490e8443-3d0a-463b-8a42-a3c018cb9c01 tempest-VolumesGetTest-1325070593 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-90de3300-cba4-448e-a4a5-237131336da0" returned: 1 in 0.538s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:35 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-490e8443-3d0a-463b-8a42-a3c018cb9c01 tempest-VolumesGetTest-1325070593 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-90de3300-cba4-448e-a4a5-237131336da0' failed. Not Retrying. {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 10 13:16:35 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-490e8443-3d0a-463b-8a42-a3c018cb9c01 tempest-VolumesGetTest-1325070593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-90de3300-cba4-448e-a4a5-237131336da0 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:35 devstack sudo[88823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-90de3300-cba4-448e-a4a5-237131336da0
Apr 10 13:16:35 devstack sudo[88823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:35 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-14f1c78b-331a-43bd-8908-08fffe0dd988 tempest-SnapshotsActionsTest-1189246844 None] Acquiring lock "cinder-ffad0697-3971-4016-9246-ae68b80cab9e-delete_snapshot" by "delete_snapshot" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:16:35 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-14f1c78b-331a-43bd-8908-08fffe0dd988 tempest-SnapshotsActionsTest-1189246844 None] Lock "cinder-ffad0697-3971-4016-9246-ae68b80cab9e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:16:35 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-14f1c78b-331a-43bd-8908-08fffe0dd988 tempest-SnapshotsActionsTest-1189246844 None] Acquiring lock "cinder-quobyte-4f013013-ffcb-4dd4-8e73-3e004e4c6f11" by "delete_snapshot" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:16:35 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-14f1c78b-331a-43bd-8908-08fffe0dd988 tempest-SnapshotsActionsTest-1189246844 None] Lock "cinder-quobyte-4f013013-ffcb-4dd4-8e73-3e004e4c6f11" acquired by "delete_snapshot" :: waited 0.007s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:16:35 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-14f1c78b-331a-43bd-8908-08fffe0dd988 tempest-SnapshotsActionsTest-1189246844 None] Acquiring lock "cinder-quobyte-ffad0697-3971-4016-9246-ae68b80cab9e" by "_delete_snapshot" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:16:35 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-14f1c78b-331a-43bd-8908-08fffe0dd988 tempest-SnapshotsActionsTest-1189246844 None] Lock "cinder-quobyte-ffad0697-3971-4016-9246-ae68b80cab9e" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:16:35 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-14f1c78b-331a-43bd-8908-08fffe0dd988 tempest-SnapshotsActionsTest-1189246844 None] Deleting offline snapshot ffad0697-3971-4016-9246-ae68b80cab9e of volume 4f013013-ffcb-4dd4-8e73-3e004e4c6f11 {{(pid=83345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 10 13:16:35 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-14f1c78b-331a-43bd-8908-08fffe0dd988 tempest-SnapshotsActionsTest-1189246844 None] snapshot_file for this snap is: volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.ffad0697-3971-4016-9246-ae68b80cab9e {{(pid=83345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 10 13:16:35 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd647ff8-7c59-4134-b039-fe90429569a7]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:16:35 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-14f1c78b-331a-43bd-8908-08fffe0dd988 tempest-SnapshotsActionsTest-1189246844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.ffad0697-3971-4016-9246-ae68b80cab9e {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:35 devstack sudo[88828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.ffad0697-3971-4016-9246-ae68b80cab9e
Apr 10 13:16:35 devstack sudo[88828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:35 devstack sudo[88816]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:35 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ae64b0d7-813f-4917-94bd-4f2d858b46ed tempest-VolumesSnapshotListTestJSON-947768007 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4faf7785-29e6-4fbc-b559-705a84ceb769.a87dfedb-457b-43a8-b901-2778173ca043" returned: 0 in 0.509s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:35 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-ae64b0d7-813f-4917-94bd-4f2d858b46ed tempest-VolumesSnapshotListTestJSON-947768007 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4faf7785-29e6-4fbc-b559-705a84ceb769(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 13:16:35 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[43cfa353-5880-483c-ad1a-929bd058fcd6]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:16:35 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ae64b0d7-813f-4917-94bd-4f2d858b46ed tempest-VolumesSnapshotListTestJSON-947768007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4faf7785-29e6-4fbc-b559-705a84ceb769.01c337fe-1254-4449-826b-4c9e702ab9b4 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:35 devstack sudo[88830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4faf7785-29e6-4fbc-b559-705a84ceb769.01c337fe-1254-4449-826b-4c9e702ab9b4
Apr 10 13:16:35 devstack sudo[88830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:35 devstack sudo[88818]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:35 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-3e1210f6-f110-4d2f-8b45-98216d91c199 tempest-VolumesSnapshotTestJSON-825888665 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-c50dafa0-5ef5-44b3-8d74-4e87989cecb7" returned: 0 in 0.582s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:35 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-3e1210f6-f110-4d2f-8b45-98216d91c199 tempest-VolumesSnapshotTestJSON-825888665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-c50dafa0-5ef5-44b3-8d74-4e87989cecb7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-c50dafa0-5ef5-44b3-8d74-4e87989cecb7.02267f13-2e4f-484e-aa3e-599161ecea26 1G {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:35 devstack sudo[88835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-c50dafa0-5ef5-44b3-8d74-4e87989cecb7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-c50dafa0-5ef5-44b3-8d74-4e87989cecb7.02267f13-2e4f-484e-aa3e-599161ecea26 1G
Apr 10 13:16:35 devstack sudo[88835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:35 devstack sudo[88823]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:35 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-490e8443-3d0a-463b-8a42-a3c018cb9c01 tempest-VolumesGetTest-1325070593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-90de3300-cba4-448e-a4a5-237131336da0" returned: 0 in 0.468s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:35 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-490e8443-3d0a-463b-8a42-a3c018cb9c01 tempest-VolumesGetTest-1325070593 None] Lock "cinder-quobyte-90de3300-cba4-448e-a4a5-237131336da0" released by "delete_volume" :: held 1.565s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:16:35 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-490e8443-3d0a-463b-8a42-a3c018cb9c01 tempest-VolumesGetTest-1325070593 None] Created reservations ['e7ad1397-315e-4b10-ae85-775ac28b7fa0', 'c20f6fc0-4e67-433a-b514-c8e215789f5a', '73efff52-a513-4c2d-a4c5-48ada4af61b4', 'b1e1bc9f-a595-4976-b08d-65af8c771612'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:16:35 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-490e8443-3d0a-463b-8a42-a3c018cb9c01 tempest-VolumesGetTest-1325070593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:16:35 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-490e8443-3d0a-463b-8a42-a3c018cb9c01 tempest-VolumesGetTest-1325070593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:16:35 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-490e8443-3d0a-463b-8a42-a3c018cb9c01 tempest-VolumesGetTest-1325070593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:16:35 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-490e8443-3d0a-463b-8a42-a3c018cb9c01 tempest-VolumesGetTest-1325070593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:16:35 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-490e8443-3d0a-463b-8a42-a3c018cb9c01 tempest-VolumesGetTest-1325070593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:16:35 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-490e8443-3d0a-463b-8a42-a3c018cb9c01 tempest-VolumesGetTest-1325070593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:35 devstack sudo[88828]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:35 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-14f1c78b-331a-43bd-8908-08fffe0dd988 tempest-SnapshotsActionsTest-1189246844 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.ffad0697-3971-4016-9246-ae68b80cab9e" returned: 0 in 0.478s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:35 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-14f1c78b-331a-43bd-8908-08fffe0dd988 tempest-SnapshotsActionsTest-1189246844 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 13:16:35 devstack sudo[88841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:16:35 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[250e0d56-2ad5-4be7-b296-c74090f3d567]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:16:35 devstack sudo[88841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:35 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-14f1c78b-331a-43bd-8908-08fffe0dd988 tempest-SnapshotsActionsTest-1189246844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.4f5b55c6-a3ad-4794-8bb5-40a452cfc583 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:35 devstack sudo[88844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.4f5b55c6-a3ad-4794-8bb5-40a452cfc583
Apr 10 13:16:35 devstack sudo[88844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:35 devstack sudo[88830]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:35 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ae64b0d7-813f-4917-94bd-4f2d858b46ed tempest-VolumesSnapshotListTestJSON-947768007 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4faf7785-29e6-4fbc-b559-705a84ceb769.01c337fe-1254-4449-826b-4c9e702ab9b4" returned: 0 in 0.499s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:35 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-ae64b0d7-813f-4917-94bd-4f2d858b46ed tempest-VolumesSnapshotListTestJSON-947768007 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4faf7785-29e6-4fbc-b559-705a84ceb769(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 13:16:35 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ae64b0d7-813f-4917-94bd-4f2d858b46ed tempest-VolumesSnapshotListTestJSON-947768007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4faf7785-29e6-4fbc-b559-705a84ceb769.a87dfedb-457b-43a8-b901-2778173ca043 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:35 devstack sudo[88848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4faf7785-29e6-4fbc-b559-705a84ceb769.a87dfedb-457b-43a8-b901-2778173ca043
Apr 10 13:16:35 devstack sudo[88848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:36 devstack sudo[88835]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:36 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-3e1210f6-f110-4d2f-8b45-98216d91c199 tempest-VolumesSnapshotTestJSON-825888665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-c50dafa0-5ef5-44b3-8d74-4e87989cecb7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-c50dafa0-5ef5-44b3-8d74-4e87989cecb7.02267f13-2e4f-484e-aa3e-599161ecea26 1G" returned: 0 in 0.550s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:36 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-3e1210f6-f110-4d2f-8b45-98216d91c199 tempest-VolumesSnapshotTestJSON-825888665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c50dafa0-5ef5-44b3-8d74-4e87989cecb7 -F qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-c50dafa0-5ef5-44b3-8d74-4e87989cecb7.02267f13-2e4f-484e-aa3e-599161ecea26 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:36 devstack sudo[88854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c50dafa0-5ef5-44b3-8d74-4e87989cecb7 -F qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-c50dafa0-5ef5-44b3-8d74-4e87989cecb7.02267f13-2e4f-484e-aa3e-599161ecea26
Apr 10 13:16:36 devstack sudo[88854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:36 devstack sudo[88841]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:36 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-490e8443-3d0a-463b-8a42-a3c018cb9c01 tempest-VolumesGetTest-1325070593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.440s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:36 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-490e8443-3d0a-463b-8a42-a3c018cb9c01 tempest-VolumesGetTest-1325070593 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:16:36 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-490e8443-3d0a-463b-8a42-a3c018cb9c01 tempest-VolumesGetTest-1325070593 None] Deleted volume successfully.
Apr 10 13:16:36 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-490e8443-3d0a-463b-8a42-a3c018cb9c01 tempest-VolumesGetTest-1325070593 None] Lock "cinder-90de3300-cba4-448e-a4a5-237131336da0-delete_volume" released by "delete_volume" :: held 2.132s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:16:36 devstack sudo[88844]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:36 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-14f1c78b-331a-43bd-8908-08fffe0dd988 tempest-SnapshotsActionsTest-1189246844 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.4f5b55c6-a3ad-4794-8bb5-40a452cfc583" returned: 0 in 0.608s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:36 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-14f1c78b-331a-43bd-8908-08fffe0dd988 tempest-SnapshotsActionsTest-1189246844 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 13:16:36 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-14f1c78b-331a-43bd-8908-08fffe0dd988 tempest-SnapshotsActionsTest-1189246844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.ffad0697-3971-4016-9246-ae68b80cab9e {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:36 devstack sudo[88862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.ffad0697-3971-4016-9246-ae68b80cab9e
Apr 10 13:16:36 devstack sudo[88862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:36 devstack sudo[88848]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:36 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ae64b0d7-813f-4917-94bd-4f2d858b46ed tempest-VolumesSnapshotListTestJSON-947768007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4faf7785-29e6-4fbc-b559-705a84ceb769.a87dfedb-457b-43a8-b901-2778173ca043" returned: 0 in 0.546s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:36 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ae64b0d7-813f-4917-94bd-4f2d858b46ed tempest-VolumesSnapshotListTestJSON-947768007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4faf7785-29e6-4fbc-b559-705a84ceb769.a87dfedb-457b-43a8-b901-2778173ca043 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:36 devstack sudo[88864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4faf7785-29e6-4fbc-b559-705a84ceb769.a87dfedb-457b-43a8-b901-2778173ca043
Apr 10 13:16:36 devstack sudo[88864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:36 devstack sudo[88854]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:36 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-3e1210f6-f110-4d2f-8b45-98216d91c199 tempest-VolumesSnapshotTestJSON-825888665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c50dafa0-5ef5-44b3-8d74-4e87989cecb7 -F qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-c50dafa0-5ef5-44b3-8d74-4e87989cecb7.02267f13-2e4f-484e-aa3e-599161ecea26" returned: 0 in 0.560s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:36 devstack cinder-volume[83345]: WARNING cinder.volume.drivers.remotefs [None req-3e1210f6-f110-4d2f-8b45-98216d91c199 tempest-VolumesSnapshotTestJSON-825888665 None] /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-c50dafa0-5ef5-44b3-8d74-4e87989cecb7.02267f13-2e4f-484e-aa3e-599161ecea26 is being set with open permissions: ugo+rw
Apr 10 13:16:36 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-3e1210f6-f110-4d2f-8b45-98216d91c199 tempest-VolumesSnapshotTestJSON-825888665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-c50dafa0-5ef5-44b3-8d74-4e87989cecb7.02267f13-2e4f-484e-aa3e-599161ecea26 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:36 devstack sudo[88869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-c50dafa0-5ef5-44b3-8d74-4e87989cecb7.02267f13-2e4f-484e-aa3e-599161ecea26
Apr 10 13:16:36 devstack sudo[88869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:36 devstack sudo[88862]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:36 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-14f1c78b-331a-43bd-8908-08fffe0dd988 tempest-SnapshotsActionsTest-1189246844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.ffad0697-3971-4016-9246-ae68b80cab9e" returned: 0 in 0.514s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:36 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-14f1c78b-331a-43bd-8908-08fffe0dd988 tempest-SnapshotsActionsTest-1189246844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.ffad0697-3971-4016-9246-ae68b80cab9e {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:36 devstack sudo[88875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.ffad0697-3971-4016-9246-ae68b80cab9e
Apr 10 13:16:36 devstack sudo[88875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:36 devstack sudo[88864]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:36 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ae64b0d7-813f-4917-94bd-4f2d858b46ed tempest-VolumesSnapshotListTestJSON-947768007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4faf7785-29e6-4fbc-b559-705a84ceb769.a87dfedb-457b-43a8-b901-2778173ca043" returned: 0 in 0.539s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:36 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-ae64b0d7-813f-4917-94bd-4f2d858b46ed tempest-VolumesSnapshotListTestJSON-947768007 None] Lock "cinder-quobyte-a87dfedb-457b-43a8-b901-2778173ca043" released by "_delete_snapshot" :: held 2.145s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:16:36 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-ae64b0d7-813f-4917-94bd-4f2d858b46ed tempest-VolumesSnapshotListTestJSON-947768007 None] Lock "cinder-quobyte-4faf7785-29e6-4fbc-b559-705a84ceb769" released by "delete_snapshot" :: held 2.156s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:16:37 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-ae64b0d7-813f-4917-94bd-4f2d858b46ed tempest-VolumesSnapshotListTestJSON-947768007 None] Created reservations ['71155d12-65c9-425f-9ebc-c50cc3494041', '50d73eec-0d63-4f4e-84ae-5ec16f8216a5', '10f7b309-0ed3-493f-b1c6-f9332464573c', 'aaabcd1c-7629-4990-8926-bcfc84ff9def'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:16:37 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-ae64b0d7-813f-4917-94bd-4f2d858b46ed tempest-VolumesSnapshotListTestJSON-947768007 None] Delete snapshot completed successfully.
Apr 10 13:16:37 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-ae64b0d7-813f-4917-94bd-4f2d858b46ed tempest-VolumesSnapshotListTestJSON-947768007 None] Lock "cinder-a87dfedb-457b-43a8-b901-2778173ca043-delete_snapshot" released by "delete_snapshot" :: held 2.258s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:16:37 devstack sudo[88869]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:37 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-3e1210f6-f110-4d2f-8b45-98216d91c199 tempest-VolumesSnapshotTestJSON-825888665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-c50dafa0-5ef5-44b3-8d74-4e87989cecb7.02267f13-2e4f-484e-aa3e-599161ecea26" returned: 0 in 0.572s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:37 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-3e1210f6-f110-4d2f-8b45-98216d91c199 tempest-VolumesSnapshotTestJSON-825888665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-c50dafa0-5ef5-44b3-8d74-4e87989cecb7.info {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:37 devstack sudo[88879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-c50dafa0-5ef5-44b3-8d74-4e87989cecb7.info
Apr 10 13:16:37 devstack sudo[88879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:37 devstack sudo[88875]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:37 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-14f1c78b-331a-43bd-8908-08fffe0dd988 tempest-SnapshotsActionsTest-1189246844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.ffad0697-3971-4016-9246-ae68b80cab9e" returned: 0 in 0.456s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:37 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-14f1c78b-331a-43bd-8908-08fffe0dd988 tempest-SnapshotsActionsTest-1189246844 None] Lock "cinder-quobyte-ffad0697-3971-4016-9246-ae68b80cab9e" released by "_delete_snapshot" :: held 2.104s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:16:37 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-14f1c78b-331a-43bd-8908-08fffe0dd988 tempest-SnapshotsActionsTest-1189246844 None] Lock "cinder-quobyte-4f013013-ffcb-4dd4-8e73-3e004e4c6f11" released by "delete_snapshot" :: held 2.118s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:16:37 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-14f1c78b-331a-43bd-8908-08fffe0dd988 tempest-SnapshotsActionsTest-1189246844 None] Created reservations ['6af9dc7f-eac5-4bd5-9863-ef19e0d43568', '6ac14e3d-0b88-4673-aa9d-ce9cd3d09662', 'e1868a3c-adc5-47e5-8fb7-f3d7ed87640d', '356b3803-af1d-49fe-ac81-56cab98f769a'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:16:37 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-14f1c78b-331a-43bd-8908-08fffe0dd988 tempest-SnapshotsActionsTest-1189246844 None] Delete snapshot completed successfully.
Apr 10 13:16:37 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-14f1c78b-331a-43bd-8908-08fffe0dd988 tempest-SnapshotsActionsTest-1189246844 None] Lock "cinder-ffad0697-3971-4016-9246-ae68b80cab9e-delete_snapshot" released by "delete_snapshot" :: held 2.207s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:16:37 devstack sudo[88879]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:37 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-3e1210f6-f110-4d2f-8b45-98216d91c199 tempest-VolumesSnapshotTestJSON-825888665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-c50dafa0-5ef5-44b3-8d74-4e87989cecb7.info" returned: 0 in 0.453s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:37 devstack cinder-volume[83345]: WARNING cinder.volume.drivers.remotefs [None req-3e1210f6-f110-4d2f-8b45-98216d91c199 tempest-VolumesSnapshotTestJSON-825888665 None] /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-c50dafa0-5ef5-44b3-8d74-4e87989cecb7.info is being set with open permissions: ugo+rw
Apr 10 13:16:37 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-3e1210f6-f110-4d2f-8b45-98216d91c199 tempest-VolumesSnapshotTestJSON-825888665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-c50dafa0-5ef5-44b3-8d74-4e87989cecb7.info {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:37 devstack sudo[88882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-c50dafa0-5ef5-44b3-8d74-4e87989cecb7.info
Apr 10 13:16:37 devstack sudo[88882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:37 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-a14d6563-acef-4a77-a2c4-b6e90db703cf tempest-VolumesSnapshotListTestJSON-947768007 None] Acquiring lock "cinder-01c337fe-1254-4449-826b-4c9e702ab9b4-delete_snapshot" by "delete_snapshot" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:16:37 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-a14d6563-acef-4a77-a2c4-b6e90db703cf tempest-VolumesSnapshotListTestJSON-947768007 None] Lock "cinder-01c337fe-1254-4449-826b-4c9e702ab9b4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:16:37 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-a14d6563-acef-4a77-a2c4-b6e90db703cf tempest-VolumesSnapshotListTestJSON-947768007 None] Acquiring lock "cinder-quobyte-4faf7785-29e6-4fbc-b559-705a84ceb769" by "delete_snapshot" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:16:37 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-a14d6563-acef-4a77-a2c4-b6e90db703cf tempest-VolumesSnapshotListTestJSON-947768007 None] Lock "cinder-quobyte-4faf7785-29e6-4fbc-b559-705a84ceb769" acquired by "delete_snapshot" :: waited 0.018s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:16:37 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-a14d6563-acef-4a77-a2c4-b6e90db703cf tempest-VolumesSnapshotListTestJSON-947768007 None] Acquiring lock "cinder-quobyte-01c337fe-1254-4449-826b-4c9e702ab9b4" by "_delete_snapshot" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:16:37 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-a14d6563-acef-4a77-a2c4-b6e90db703cf tempest-VolumesSnapshotListTestJSON-947768007 None] Lock "cinder-quobyte-01c337fe-1254-4449-826b-4c9e702ab9b4" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:16:38 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-a14d6563-acef-4a77-a2c4-b6e90db703cf tempest-VolumesSnapshotListTestJSON-947768007 None] Deleting offline snapshot 01c337fe-1254-4449-826b-4c9e702ab9b4 of volume 4faf7785-29e6-4fbc-b559-705a84ceb769 {{(pid=83345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 10 13:16:38 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-a14d6563-acef-4a77-a2c4-b6e90db703cf tempest-VolumesSnapshotListTestJSON-947768007 None] snapshot_file for this snap is: volume-4faf7785-29e6-4fbc-b559-705a84ceb769.01c337fe-1254-4449-826b-4c9e702ab9b4 {{(pid=83345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 10 13:16:38 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ba94e9e-5798-4440-8d40-c779aa80faea]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:16:38 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-a14d6563-acef-4a77-a2c4-b6e90db703cf tempest-VolumesSnapshotListTestJSON-947768007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4faf7785-29e6-4fbc-b559-705a84ceb769.01c337fe-1254-4449-826b-4c9e702ab9b4 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:38 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-b622b5ec-4941-4cdc-8aca-6291f6c4f7ec tempest-VolumesNegativeTest-1186901150 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:16:38 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-b622b5ec-4941-4cdc-8aca-6291f6c4f7ec tempest-VolumesNegativeTest-1186901150 None] Flow 'volume_create_manager' (cee18cb8-da36-4d8b-8015-423b6bab5088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:16:38 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-b622b5ec-4941-4cdc-8aca-6291f6c4f7ec tempest-VolumesNegativeTest-1186901150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (529b33b6-961d-44f0-ab82-361231ce8899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:16:38 devstack sudo[88884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4faf7785-29e6-4fbc-b559-705a84ceb769.01c337fe-1254-4449-826b-4c9e702ab9b4
Apr 10 13:16:38 devstack sudo[88884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:38 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-b622b5ec-4941-4cdc-8aca-6291f6c4f7ec tempest-VolumesNegativeTest-1186901150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (529b33b6-961d-44f0-ab82-361231ce8899) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:16:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-912291343',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c98ef5b2-c9eb-4799-825b-d1f844c1390b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91964e00d4c84e1c929f11e223ce0da9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:16:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:16:38Z,use_quota=True,user_id='9e5498115dcd48dfa1a1df2411dc493c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:16:38 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-b622b5ec-4941-4cdc-8aca-6291f6c4f7ec tempest-VolumesNegativeTest-1186901150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66a2ec4a-969b-45d7-befc-86baa50b076a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:16:38 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-b622b5ec-4941-4cdc-8aca-6291f6c4f7ec tempest-VolumesNegativeTest-1186901150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66a2ec4a-969b-45d7-befc-86baa50b076a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:16:38 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-b622b5ec-4941-4cdc-8aca-6291f6c4f7ec tempest-VolumesNegativeTest-1186901150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc1025e1-1355-40cf-9a57-f8ae05a350a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:16:38 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-b622b5ec-4941-4cdc-8aca-6291f6c4f7ec tempest-VolumesNegativeTest-1186901150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc1025e1-1355-40cf-9a57-f8ae05a350a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c98ef5b2-c9eb-4799-825b-d1f844c1390b', 'volume_name': 'volume-c98ef5b2-c9eb-4799-825b-d1f844c1390b', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:16:38 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-b622b5ec-4941-4cdc-8aca-6291f6c4f7ec tempest-VolumesNegativeTest-1186901150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a852602-7670-4e75-8923-c3425cf29fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:16:38 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-b622b5ec-4941-4cdc-8aca-6291f6c4f7ec tempest-VolumesNegativeTest-1186901150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a852602-7670-4e75-8923-c3425cf29fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:16:38 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-b622b5ec-4941-4cdc-8aca-6291f6c4f7ec tempest-VolumesNegativeTest-1186901150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad062c7f-9db5-4c88-ab90-3ee7a26ecadb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:16:38 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-b622b5ec-4941-4cdc-8aca-6291f6c4f7ec tempest-VolumesNegativeTest-1186901150 None] Volume c98ef5b2-c9eb-4799-825b-d1f844c1390b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c98ef5b2-c9eb-4799-825b-d1f844c1390b', 'volume_size': 1}
Apr 10 13:16:38 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-b622b5ec-4941-4cdc-8aca-6291f6c4f7ec tempest-VolumesNegativeTest-1186901150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:16:38 devstack sudo[88882]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:38 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-3e1210f6-f110-4d2f-8b45-98216d91c199 tempest-VolumesSnapshotTestJSON-825888665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-c50dafa0-5ef5-44b3-8d74-4e87989cecb7.info" returned: 0 in 0.467s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:38 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-3e1210f6-f110-4d2f-8b45-98216d91c199 tempest-VolumesSnapshotTestJSON-825888665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.258s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:16:38 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-b622b5ec-4941-4cdc-8aca-6291f6c4f7ec tempest-VolumesNegativeTest-1186901150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.064s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:16:38 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-b622b5ec-4941-4cdc-8aca-6291f6c4f7ec tempest-VolumesNegativeTest-1186901150 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f252bf08b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:16:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-912291343',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c98ef5b2-c9eb-4799-825b-d1f844c1390b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91964e00d4c84e1c929f11e223ce0da9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:16:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:16:38Z,use_quota=True,user_id='9e5498115dcd48dfa1a1df2411dc493c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)}" {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 13:16:38 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-b622b5ec-4941-4cdc-8aca-6291f6c4f7ec tempest-VolumesNegativeTest-1186901150 None] Creating volume c98ef5b2-c9eb-4799-825b-d1f844c1390b {{(pid=83345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 13:16:38 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-b622b5ec-4941-4cdc-8aca-6291f6c4f7ec tempest-VolumesNegativeTest-1186901150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:16:38 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-b622b5ec-4941-4cdc-8aca-6291f6c4f7ec tempest-VolumesNegativeTest-1186901150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:16:38 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-b622b5ec-4941-4cdc-8aca-6291f6c4f7ec tempest-VolumesNegativeTest-1186901150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:16:38 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-b622b5ec-4941-4cdc-8aca-6291f6c4f7ec tempest-VolumesNegativeTest-1186901150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:16:38 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-b622b5ec-4941-4cdc-8aca-6291f6c4f7ec tempest-VolumesNegativeTest-1186901150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:16:38 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-b622b5ec-4941-4cdc-8aca-6291f6c4f7ec tempest-VolumesNegativeTest-1186901150 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:16:38 devstack cinder-volume[83345]: INFO cinder.volume.drivers.remotefs [None req-b622b5ec-4941-4cdc-8aca-6291f6c4f7ec tempest-VolumesNegativeTest-1186901150 None] casted to osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331
Apr 10 13:16:38 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-b622b5ec-4941-4cdc-8aca-6291f6c4f7ec tempest-VolumesNegativeTest-1186901150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-c98ef5b2-c9eb-4799-825b-d1f844c1390b 1073741824 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:38 devstack sudo[88887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-c98ef5b2-c9eb-4799-825b-d1f844c1390b 1073741824
Apr 10 13:16:38 devstack sudo[88887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:38 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-3e1210f6-f110-4d2f-8b45-98216d91c199 tempest-VolumesSnapshotTestJSON-825888665 None] Create snapshot completed successfully
Apr 10 13:16:38 devstack sudo[88884]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:38 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-a14d6563-acef-4a77-a2c4-b6e90db703cf tempest-VolumesSnapshotListTestJSON-947768007 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4faf7785-29e6-4fbc-b559-705a84ceb769.01c337fe-1254-4449-826b-4c9e702ab9b4" returned: 0 in 0.522s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:38 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-a14d6563-acef-4a77-a2c4-b6e90db703cf tempest-VolumesSnapshotListTestJSON-947768007 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4faf7785-29e6-4fbc-b559-705a84ceb769(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 13:16:38 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f5822a2-652d-4598-a1e2-dd41ef931105]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:16:38 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-a14d6563-acef-4a77-a2c4-b6e90db703cf tempest-VolumesSnapshotListTestJSON-947768007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4faf7785-29e6-4fbc-b559-705a84ceb769 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:38 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-596f1a81-4848-4c64-91f1-b303277b4abc tempest-SnapshotsActionsTest-802738678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:16:38 devstack sudo[88894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4faf7785-29e6-4fbc-b559-705a84ceb769
Apr 10 13:16:38 devstack sudo[88894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:38 devstack sudo[88887]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:38 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-b622b5ec-4941-4cdc-8aca-6291f6c4f7ec tempest-VolumesNegativeTest-1186901150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-c98ef5b2-c9eb-4799-825b-d1f844c1390b 1073741824" returned: 0 in 0.507s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:38 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-b622b5ec-4941-4cdc-8aca-6291f6c4f7ec tempest-VolumesNegativeTest-1186901150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-c98ef5b2-c9eb-4799-825b-d1f844c1390b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:38 devstack sudo[88897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-c98ef5b2-c9eb-4799-825b-d1f844c1390b
Apr 10 13:16:38 devstack sudo[88897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:39 devstack sudo[88894]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:39 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-a14d6563-acef-4a77-a2c4-b6e90db703cf tempest-VolumesSnapshotListTestJSON-947768007 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4faf7785-29e6-4fbc-b559-705a84ceb769" returned: 0 in 0.523s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:39 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-a14d6563-acef-4a77-a2c4-b6e90db703cf tempest-VolumesSnapshotListTestJSON-947768007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4faf7785-29e6-4fbc-b559-705a84ceb769.01c337fe-1254-4449-826b-4c9e702ab9b4 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:39 devstack sudo[88903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4faf7785-29e6-4fbc-b559-705a84ceb769.01c337fe-1254-4449-826b-4c9e702ab9b4
Apr 10 13:16:39 devstack sudo[88903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:39 devstack sudo[88897]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:39 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-b622b5ec-4941-4cdc-8aca-6291f6c4f7ec tempest-VolumesNegativeTest-1186901150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-c98ef5b2-c9eb-4799-825b-d1f844c1390b" returned: 0 in 0.458s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:39 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-b622b5ec-4941-4cdc-8aca-6291f6c4f7ec tempest-VolumesNegativeTest-1186901150 None] <== create_volume: return (990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'} {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 13:16:39 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-b622b5ec-4941-4cdc-8aca-6291f6c4f7ec tempest-VolumesNegativeTest-1186901150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.993s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:16:39 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-596f1a81-4848-4c64-91f1-b303277b4abc tempest-SnapshotsActionsTest-802738678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.601s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:16:39 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-b622b5ec-4941-4cdc-8aca-6291f6c4f7ec tempest-VolumesNegativeTest-1186901150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad062c7f-9db5-4c88-ab90-3ee7a26ecadb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c98ef5b2-c9eb-4799-825b-d1f844c1390b', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:16:39 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-b622b5ec-4941-4cdc-8aca-6291f6c4f7ec tempest-VolumesNegativeTest-1186901150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee6f9176-1471-49ae-8f2d-a47e6f7beb25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:16:39 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-596f1a81-4848-4c64-91f1-b303277b4abc tempest-SnapshotsActionsTest-802738678 None] Creating offline snapshot c1674960-231a-4828-aa21-d490df79b708 of volume 4f013013-ffcb-4dd4-8e73-3e004e4c6f11 {{(pid=83345) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 10 13:16:39 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-b622b5ec-4941-4cdc-8aca-6291f6c4f7ec tempest-VolumesNegativeTest-1186901150 None] Volume volume-c98ef5b2-c9eb-4799-825b-d1f844c1390b (c98ef5b2-c9eb-4799-825b-d1f844c1390b): created successfully
Apr 10 13:16:39 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-b622b5ec-4941-4cdc-8aca-6291f6c4f7ec tempest-VolumesNegativeTest-1186901150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee6f9176-1471-49ae-8f2d-a47e6f7beb25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:16:39 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-b622b5ec-4941-4cdc-8aca-6291f6c4f7ec tempest-VolumesNegativeTest-1186901150 None] Flow 'volume_create_manager' (cee18cb8-da36-4d8b-8015-423b6bab5088) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:16:39 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[60947ecc-7f29-4d16-a71b-1f6f3c73d53f]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:16:39 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-596f1a81-4848-4c64-91f1-b303277b4abc tempest-SnapshotsActionsTest-802738678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.4f5b55c6-a3ad-4794-8bb5-40a452cfc583 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:39 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-b622b5ec-4941-4cdc-8aca-6291f6c4f7ec tempest-VolumesNegativeTest-1186901150 None] Created volume successfully.
Apr 10 13:16:39 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-e3f35498-5f23-402c-ad4f-afdd10107102 tempest-VolumesSnapshotTestJSON-825888665 None] Acquiring lock "cinder-02267f13-2e4f-484e-aa3e-599161ecea26-delete_snapshot" by "delete_snapshot" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:16:39 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-e3f35498-5f23-402c-ad4f-afdd10107102 tempest-VolumesSnapshotTestJSON-825888665 None] Lock "cinder-02267f13-2e4f-484e-aa3e-599161ecea26-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:16:39 devstack sudo[88905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.4f5b55c6-a3ad-4794-8bb5-40a452cfc583
Apr 10 13:16:39 devstack sudo[88905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:39 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-e3f35498-5f23-402c-ad4f-afdd10107102 tempest-VolumesSnapshotTestJSON-825888665 None] Acquiring lock "cinder-quobyte-c50dafa0-5ef5-44b3-8d74-4e87989cecb7" by "delete_snapshot" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:16:39 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-e3f35498-5f23-402c-ad4f-afdd10107102 tempest-VolumesSnapshotTestJSON-825888665 None] Lock "cinder-quobyte-c50dafa0-5ef5-44b3-8d74-4e87989cecb7" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:16:39 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-e3f35498-5f23-402c-ad4f-afdd10107102 tempest-VolumesSnapshotTestJSON-825888665 None] Acquiring lock "cinder-quobyte-02267f13-2e4f-484e-aa3e-599161ecea26" by "_delete_snapshot" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:16:39 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-e3f35498-5f23-402c-ad4f-afdd10107102 tempest-VolumesSnapshotTestJSON-825888665 None] Lock "cinder-quobyte-02267f13-2e4f-484e-aa3e-599161ecea26" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:16:39 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-e3f35498-5f23-402c-ad4f-afdd10107102 tempest-VolumesSnapshotTestJSON-825888665 None] Deleting offline snapshot 02267f13-2e4f-484e-aa3e-599161ecea26 of volume c50dafa0-5ef5-44b3-8d74-4e87989cecb7 {{(pid=83345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 10 13:16:39 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-e3f35498-5f23-402c-ad4f-afdd10107102 tempest-VolumesSnapshotTestJSON-825888665 None] snapshot_file for this snap is: volume-c50dafa0-5ef5-44b3-8d74-4e87989cecb7.02267f13-2e4f-484e-aa3e-599161ecea26 {{(pid=83345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 10 13:16:39 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a3a7e41-7946-4ec4-a36b-055d8dd6467c]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:16:39 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-e3f35498-5f23-402c-ad4f-afdd10107102 tempest-VolumesSnapshotTestJSON-825888665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-c50dafa0-5ef5-44b3-8d74-4e87989cecb7.02267f13-2e4f-484e-aa3e-599161ecea26 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:39 devstack sudo[88907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-c50dafa0-5ef5-44b3-8d74-4e87989cecb7.02267f13-2e4f-484e-aa3e-599161ecea26
Apr 10 13:16:39 devstack sudo[88907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:39 devstack sudo[88903]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:39 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-a14d6563-acef-4a77-a2c4-b6e90db703cf tempest-VolumesSnapshotListTestJSON-947768007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4faf7785-29e6-4fbc-b559-705a84ceb769.01c337fe-1254-4449-826b-4c9e702ab9b4" returned: 0 in 0.457s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:39 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-a14d6563-acef-4a77-a2c4-b6e90db703cf tempest-VolumesSnapshotListTestJSON-947768007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4faf7785-29e6-4fbc-b559-705a84ceb769.01c337fe-1254-4449-826b-4c9e702ab9b4 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:39 devstack sudo[88912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4faf7785-29e6-4fbc-b559-705a84ceb769.01c337fe-1254-4449-826b-4c9e702ab9b4
Apr 10 13:16:39 devstack sudo[88912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:39 devstack sudo[88905]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:39 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-596f1a81-4848-4c64-91f1-b303277b4abc tempest-SnapshotsActionsTest-802738678 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.4f5b55c6-a3ad-4794-8bb5-40a452cfc583" returned: 0 in 0.494s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:39 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-596f1a81-4848-4c64-91f1-b303277b4abc tempest-SnapshotsActionsTest-802738678 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 13:16:39 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-596f1a81-4848-4c64-91f1-b303277b4abc tempest-SnapshotsActionsTest-802738678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.4f5b55c6-a3ad-4794-8bb5-40a452cfc583,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.c1674960-231a-4828-aa21-d490df79b708 1G {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:39 devstack sudo[88917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.4f5b55c6-a3ad-4794-8bb5-40a452cfc583,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.c1674960-231a-4828-aa21-d490df79b708 1G
Apr 10 13:16:39 devstack sudo[88917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:39 devstack sudo[88907]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:39 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-e3f35498-5f23-402c-ad4f-afdd10107102 tempest-VolumesSnapshotTestJSON-825888665 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-c50dafa0-5ef5-44b3-8d74-4e87989cecb7.02267f13-2e4f-484e-aa3e-599161ecea26" returned: 0 in 0.506s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:39 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-e3f35498-5f23-402c-ad4f-afdd10107102 tempest-VolumesSnapshotTestJSON-825888665 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c50dafa0-5ef5-44b3-8d74-4e87989cecb7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 13:16:39 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c6af671-c875-4a43-897c-10b4101a77f5]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:16:39 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-e3f35498-5f23-402c-ad4f-afdd10107102 tempest-VolumesSnapshotTestJSON-825888665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-c50dafa0-5ef5-44b3-8d74-4e87989cecb7 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:39 devstack sudo[88922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-c50dafa0-5ef5-44b3-8d74-4e87989cecb7
Apr 10 13:16:39 devstack sudo[88922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:39 devstack sudo[88912]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:39 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-a14d6563-acef-4a77-a2c4-b6e90db703cf tempest-VolumesSnapshotListTestJSON-947768007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4faf7785-29e6-4fbc-b559-705a84ceb769.01c337fe-1254-4449-826b-4c9e702ab9b4" returned: 0 in 0.442s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:40 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-a14d6563-acef-4a77-a2c4-b6e90db703cf tempest-VolumesSnapshotListTestJSON-947768007 None] Lock "cinder-quobyte-01c337fe-1254-4449-826b-4c9e702ab9b4" released by "_delete_snapshot" :: held 2.024s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:16:40 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-a14d6563-acef-4a77-a2c4-b6e90db703cf tempest-VolumesSnapshotListTestJSON-947768007 None] Lock "cinder-quobyte-4faf7785-29e6-4fbc-b559-705a84ceb769" released by "delete_snapshot" :: held 2.045s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:16:40 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-a14d6563-acef-4a77-a2c4-b6e90db703cf tempest-VolumesSnapshotListTestJSON-947768007 None] Created reservations ['5e9f3233-aa12-46da-a060-5cb4a732b4c6', 'e9ce8fcc-cba6-4bfc-abc7-b728da4d4e66', 'bd41a73a-91cf-426f-a9c1-51050e1737dc', '65b6e76c-a98b-423d-9c56-74ac38693480'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:16:40 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-a14d6563-acef-4a77-a2c4-b6e90db703cf tempest-VolumesSnapshotListTestJSON-947768007 None] Delete snapshot completed successfully.
Apr 10 13:16:40 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-a14d6563-acef-4a77-a2c4-b6e90db703cf tempest-VolumesSnapshotListTestJSON-947768007 None] Lock "cinder-01c337fe-1254-4449-826b-4c9e702ab9b4-delete_snapshot" released by "delete_snapshot" :: held 2.136s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:16:40 devstack sudo[88917]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:40 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-596f1a81-4848-4c64-91f1-b303277b4abc tempest-SnapshotsActionsTest-802738678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.4f5b55c6-a3ad-4794-8bb5-40a452cfc583,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.c1674960-231a-4828-aa21-d490df79b708 1G" returned: 0 in 0.579s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:40 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-596f1a81-4848-4c64-91f1-b303277b4abc tempest-SnapshotsActionsTest-802738678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.4f5b55c6-a3ad-4794-8bb5-40a452cfc583 -F qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.c1674960-231a-4828-aa21-d490df79b708 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:40 devstack sudo[88928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.4f5b55c6-a3ad-4794-8bb5-40a452cfc583 -F qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.c1674960-231a-4828-aa21-d490df79b708
Apr 10 13:16:40 devstack sudo[88928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:40 devstack sudo[88922]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:40 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-e3f35498-5f23-402c-ad4f-afdd10107102 tempest-VolumesSnapshotTestJSON-825888665 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-c50dafa0-5ef5-44b3-8d74-4e87989cecb7" returned: 0 in 0.570s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:40 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-e3f35498-5f23-402c-ad4f-afdd10107102 tempest-VolumesSnapshotTestJSON-825888665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-c50dafa0-5ef5-44b3-8d74-4e87989cecb7.02267f13-2e4f-484e-aa3e-599161ecea26 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:40 devstack sudo[88933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-c50dafa0-5ef5-44b3-8d74-4e87989cecb7.02267f13-2e4f-484e-aa3e-599161ecea26
Apr 10 13:16:40 devstack sudo[88933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:41 devstack sudo[88928]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:41 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-596f1a81-4848-4c64-91f1-b303277b4abc tempest-SnapshotsActionsTest-802738678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.4f5b55c6-a3ad-4794-8bb5-40a452cfc583 -F qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.c1674960-231a-4828-aa21-d490df79b708" returned: 0 in 0.684s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:41 devstack cinder-volume[83345]: WARNING cinder.volume.drivers.remotefs [None req-596f1a81-4848-4c64-91f1-b303277b4abc tempest-SnapshotsActionsTest-802738678 None] /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.c1674960-231a-4828-aa21-d490df79b708 is being set with open permissions: ugo+rw
Apr 10 13:16:41 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-596f1a81-4848-4c64-91f1-b303277b4abc tempest-SnapshotsActionsTest-802738678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.c1674960-231a-4828-aa21-d490df79b708 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:41 devstack sudo[88944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.c1674960-231a-4828-aa21-d490df79b708
Apr 10 13:16:41 devstack sudo[88944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:41 devstack sudo[88933]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:41 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-e3f35498-5f23-402c-ad4f-afdd10107102 tempest-VolumesSnapshotTestJSON-825888665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-c50dafa0-5ef5-44b3-8d74-4e87989cecb7.02267f13-2e4f-484e-aa3e-599161ecea26" returned: 0 in 0.573s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:41 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-e3f35498-5f23-402c-ad4f-afdd10107102 tempest-VolumesSnapshotTestJSON-825888665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-c50dafa0-5ef5-44b3-8d74-4e87989cecb7.02267f13-2e4f-484e-aa3e-599161ecea26 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:41 devstack sudo[88946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-c50dafa0-5ef5-44b3-8d74-4e87989cecb7.02267f13-2e4f-484e-aa3e-599161ecea26
Apr 10 13:16:41 devstack sudo[88946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:41 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-5be67972-88e9-421c-a011-738709c1b25b tempest-VolumesSnapshotListTestJSON-947768007 None] Acquiring lock "cinder-4faf7785-29e6-4fbc-b559-705a84ceb769-delete_volume" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:16:41 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-5be67972-88e9-421c-a011-738709c1b25b tempest-VolumesSnapshotListTestJSON-947768007 None] Lock "cinder-4faf7785-29e6-4fbc-b559-705a84ceb769-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:16:41 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-5be67972-88e9-421c-a011-738709c1b25b tempest-VolumesSnapshotListTestJSON-947768007 None] Acquiring lock "cinder-quobyte-4faf7785-29e6-4fbc-b559-705a84ceb769" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:16:41 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-5be67972-88e9-421c-a011-738709c1b25b tempest-VolumesSnapshotListTestJSON-947768007 None] Lock "cinder-quobyte-4faf7785-29e6-4fbc-b559-705a84ceb769" acquired by "delete_volume" :: waited 0.011s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:16:41 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aae5e32-e0fb-415c-b347-5dabb2567d0e]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:16:41 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-5be67972-88e9-421c-a011-738709c1b25b tempest-VolumesSnapshotListTestJSON-947768007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4faf7785-29e6-4fbc-b559-705a84ceb769 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:41 devstack sudo[88949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4faf7785-29e6-4fbc-b559-705a84ceb769
Apr 10 13:16:41 devstack sudo[88949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:41 devstack sudo[88944]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:41 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-596f1a81-4848-4c64-91f1-b303277b4abc tempest-SnapshotsActionsTest-802738678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.c1674960-231a-4828-aa21-d490df79b708" returned: 0 in 0.493s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:41 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-596f1a81-4848-4c64-91f1-b303277b4abc tempest-SnapshotsActionsTest-802738678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.322s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:16:41 devstack sudo[88946]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:41 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-e3f35498-5f23-402c-ad4f-afdd10107102 tempest-VolumesSnapshotTestJSON-825888665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-c50dafa0-5ef5-44b3-8d74-4e87989cecb7.02267f13-2e4f-484e-aa3e-599161ecea26" returned: 0 in 0.505s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:41 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-596f1a81-4848-4c64-91f1-b303277b4abc tempest-SnapshotsActionsTest-802738678 None] Create snapshot completed successfully
Apr 10 13:16:41 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-e3f35498-5f23-402c-ad4f-afdd10107102 tempest-VolumesSnapshotTestJSON-825888665 None] Lock "cinder-quobyte-02267f13-2e4f-484e-aa3e-599161ecea26" released by "_delete_snapshot" :: held 2.208s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:16:41 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-e3f35498-5f23-402c-ad4f-afdd10107102 tempest-VolumesSnapshotTestJSON-825888665 None] Lock "cinder-quobyte-c50dafa0-5ef5-44b3-8d74-4e87989cecb7" released by "delete_snapshot" :: held 2.218s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:16:41 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-e3f35498-5f23-402c-ad4f-afdd10107102 tempest-VolumesSnapshotTestJSON-825888665 None] Created reservations ['648172c9-fc69-433f-b222-adcf8ced047e', '49e3a2e3-6c5f-4a83-be22-a39fd947da9f', 'e564a521-c513-4274-9519-fec02cc86601', '7f4573d0-a791-4b38-8b1b-99f2e3a85bb5'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:16:41 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-e3f35498-5f23-402c-ad4f-afdd10107102 tempest-VolumesSnapshotTestJSON-825888665 None] Delete snapshot completed successfully.
Apr 10 13:16:41 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-e3f35498-5f23-402c-ad4f-afdd10107102 tempest-VolumesSnapshotTestJSON-825888665 None] Lock "cinder-02267f13-2e4f-484e-aa3e-599161ecea26-delete_snapshot" released by "delete_snapshot" :: held 2.323s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:16:41 devstack sudo[88949]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:41 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-5be67972-88e9-421c-a011-738709c1b25b tempest-VolumesSnapshotListTestJSON-947768007 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4faf7785-29e6-4fbc-b559-705a84ceb769" returned: 0 in 0.508s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:41 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-5be67972-88e9-421c-a011-738709c1b25b tempest-VolumesSnapshotListTestJSON-947768007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4faf7785-29e6-4fbc-b559-705a84ceb769 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:41 devstack sudo[88957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4faf7785-29e6-4fbc-b559-705a84ceb769
Apr 10 13:16:41 devstack sudo[88957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:41 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-0ac35f70-ee9b-4ba5-831a-fe73c7af653d tempest-SnapshotsActionsTest-1189246844 None] Acquiring lock "cinder-c1674960-231a-4828-aa21-d490df79b708-delete_snapshot" by "delete_snapshot" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:16:41 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-0ac35f70-ee9b-4ba5-831a-fe73c7af653d tempest-SnapshotsActionsTest-1189246844 None] Lock "cinder-c1674960-231a-4828-aa21-d490df79b708-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:16:41 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-0ac35f70-ee9b-4ba5-831a-fe73c7af653d tempest-SnapshotsActionsTest-1189246844 None] Acquiring lock "cinder-quobyte-4f013013-ffcb-4dd4-8e73-3e004e4c6f11" by "delete_snapshot" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:16:41 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-0ac35f70-ee9b-4ba5-831a-fe73c7af653d tempest-SnapshotsActionsTest-1189246844 None] Lock "cinder-quobyte-4f013013-ffcb-4dd4-8e73-3e004e4c6f11" acquired by "delete_snapshot" :: waited 0.013s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:16:41 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-0ac35f70-ee9b-4ba5-831a-fe73c7af653d tempest-SnapshotsActionsTest-1189246844 None] Acquiring lock "cinder-quobyte-c1674960-231a-4828-aa21-d490df79b708" by "_delete_snapshot" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:16:41 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-0ac35f70-ee9b-4ba5-831a-fe73c7af653d tempest-SnapshotsActionsTest-1189246844 None] Lock "cinder-quobyte-c1674960-231a-4828-aa21-d490df79b708" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:16:41 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-0ac35f70-ee9b-4ba5-831a-fe73c7af653d tempest-SnapshotsActionsTest-1189246844 None] Deleting offline snapshot c1674960-231a-4828-aa21-d490df79b708 of volume 4f013013-ffcb-4dd4-8e73-3e004e4c6f11 {{(pid=83345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 10 13:16:41 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-0ac35f70-ee9b-4ba5-831a-fe73c7af653d tempest-SnapshotsActionsTest-1189246844 None] snapshot_file for this snap is: volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.c1674960-231a-4828-aa21-d490df79b708 {{(pid=83345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 10 13:16:41 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd880a94-1f32-4cef-ae00-cc305c04cfa9]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:16:41 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-0ac35f70-ee9b-4ba5-831a-fe73c7af653d tempest-SnapshotsActionsTest-1189246844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.c1674960-231a-4828-aa21-d490df79b708 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:41 devstack sudo[88959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.c1674960-231a-4828-aa21-d490df79b708
Apr 10 13:16:41 devstack sudo[88959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:42 devstack sudo[88957]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:42 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-5be67972-88e9-421c-a011-738709c1b25b tempest-VolumesSnapshotListTestJSON-947768007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4faf7785-29e6-4fbc-b559-705a84ceb769" returned: 0 in 0.453s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:42 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-5be67972-88e9-421c-a011-738709c1b25b tempest-VolumesSnapshotListTestJSON-947768007 None] Lock "cinder-quobyte-4faf7785-29e6-4fbc-b559-705a84ceb769" released by "delete_volume" :: held 0.995s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:16:42 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-5be67972-88e9-421c-a011-738709c1b25b tempest-VolumesSnapshotListTestJSON-947768007 None] Created reservations ['fafb7054-cae1-47b6-8b6f-8b5a52b777d3', '57a76123-a07e-41eb-a6bf-a275de9499b5', '7265c67e-366f-4516-be1b-9b63c95382f7', 'f423cc43-72a7-442b-97c5-6231caf612c6'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:16:42 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-5be67972-88e9-421c-a011-738709c1b25b tempest-VolumesSnapshotListTestJSON-947768007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:16:42 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-5be67972-88e9-421c-a011-738709c1b25b tempest-VolumesSnapshotListTestJSON-947768007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:16:42 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-5be67972-88e9-421c-a011-738709c1b25b tempest-VolumesSnapshotListTestJSON-947768007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:16:42 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-5be67972-88e9-421c-a011-738709c1b25b tempest-VolumesSnapshotListTestJSON-947768007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:16:42 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-5be67972-88e9-421c-a011-738709c1b25b tempest-VolumesSnapshotListTestJSON-947768007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:16:42 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-5be67972-88e9-421c-a011-738709c1b25b tempest-VolumesSnapshotListTestJSON-947768007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:42 devstack sudo[88965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:16:42 devstack sudo[88965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:42 devstack sudo[88959]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:42 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-0ac35f70-ee9b-4ba5-831a-fe73c7af653d tempest-SnapshotsActionsTest-1189246844 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.c1674960-231a-4828-aa21-d490df79b708" returned: 0 in 0.517s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:42 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-0ac35f70-ee9b-4ba5-831a-fe73c7af653d tempest-SnapshotsActionsTest-1189246844 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 13:16:42 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[21a250bf-226c-4fbc-a27c-b4031be79fda]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:16:42 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-0ac35f70-ee9b-4ba5-831a-fe73c7af653d tempest-SnapshotsActionsTest-1189246844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.4f5b55c6-a3ad-4794-8bb5-40a452cfc583 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:42 devstack sudo[88967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.4f5b55c6-a3ad-4794-8bb5-40a452cfc583
Apr 10 13:16:42 devstack sudo[88967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:42 devstack sudo[88965]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:42 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-5be67972-88e9-421c-a011-738709c1b25b tempest-VolumesSnapshotListTestJSON-947768007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.442s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:42 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-5be67972-88e9-421c-a011-738709c1b25b tempest-VolumesSnapshotListTestJSON-947768007 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:16:42 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-5be67972-88e9-421c-a011-738709c1b25b tempest-VolumesSnapshotListTestJSON-947768007 None] Deleted volume successfully.
Apr 10 13:16:42 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e36523f-635e-4baf-bd9f-3db5691eedc1 tempest-VolumesSnapshotTestJSON-825888665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:16:42 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-1e36523f-635e-4baf-bd9f-3db5691eedc1 tempest-VolumesSnapshotTestJSON-825888665 None] Flow 'volume_create_manager' (699061d2-e46e-4ea4-9272-b6f434a5d8a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:16:42 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-1e36523f-635e-4baf-bd9f-3db5691eedc1 tempest-VolumesSnapshotTestJSON-825888665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a297822-419a-4fc2-8bc0-4e744747f692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:16:42 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-1e36523f-635e-4baf-bd9f-3db5691eedc1 tempest-VolumesSnapshotTestJSON-825888665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a297822-419a-4fc2-8bc0-4e744747f692) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:16:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-616873121',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ec7d664-77c0-4f7d-b41b-5b716a5f5a47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a23589ebdac46368f1e33de5aeb8af1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:16:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:16:43Z,use_quota=True,user_id='5bb118cb04cc4be28306326a911fb71f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:16:42 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-1e36523f-635e-4baf-bd9f-3db5691eedc1 tempest-VolumesSnapshotTestJSON-825888665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1202061c-2437-49d3-b474-8438ee9ac036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:16:42 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-1e36523f-635e-4baf-bd9f-3db5691eedc1 tempest-VolumesSnapshotTestJSON-825888665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1202061c-2437-49d3-b474-8438ee9ac036) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:16:42 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-1e36523f-635e-4baf-bd9f-3db5691eedc1 tempest-VolumesSnapshotTestJSON-825888665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c15c6903-2e83-4dc8-b4cc-ff13ae8b0499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:16:42 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-1e36523f-635e-4baf-bd9f-3db5691eedc1 tempest-VolumesSnapshotTestJSON-825888665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c15c6903-2e83-4dc8-b4cc-ff13ae8b0499) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ec7d664-77c0-4f7d-b41b-5b716a5f5a47', 'volume_name': 'volume-7ec7d664-77c0-4f7d-b41b-5b716a5f5a47', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:16:42 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-1e36523f-635e-4baf-bd9f-3db5691eedc1 tempest-VolumesSnapshotTestJSON-825888665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee9f8876-6a7a-4f0d-beaf-09ec1fb6ed32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:16:42 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-1e36523f-635e-4baf-bd9f-3db5691eedc1 tempest-VolumesSnapshotTestJSON-825888665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee9f8876-6a7a-4f0d-beaf-09ec1fb6ed32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:16:42 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-1e36523f-635e-4baf-bd9f-3db5691eedc1 tempest-VolumesSnapshotTestJSON-825888665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0f07d18-327d-4320-a6b5-d4a057508a4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:16:42 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-1e36523f-635e-4baf-bd9f-3db5691eedc1 tempest-VolumesSnapshotTestJSON-825888665 None] Volume 7ec7d664-77c0-4f7d-b41b-5b716a5f5a47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ec7d664-77c0-4f7d-b41b-5b716a5f5a47', 'volume_size': 1}
Apr 10 13:16:42 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-1e36523f-635e-4baf-bd9f-3db5691eedc1 tempest-VolumesSnapshotTestJSON-825888665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:16:42 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-1e36523f-635e-4baf-bd9f-3db5691eedc1 tempest-VolumesSnapshotTestJSON-825888665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:16:42 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-1e36523f-635e-4baf-bd9f-3db5691eedc1 tempest-VolumesSnapshotTestJSON-825888665 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f252bf08b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:16:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-616873121',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ec7d664-77c0-4f7d-b41b-5b716a5f5a47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a23589ebdac46368f1e33de5aeb8af1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:16:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:16:43Z,use_quota=True,user_id='5bb118cb04cc4be28306326a911fb71f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)}" {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 13:16:42 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-1e36523f-635e-4baf-bd9f-3db5691eedc1 tempest-VolumesSnapshotTestJSON-825888665 None] Creating volume 7ec7d664-77c0-4f7d-b41b-5b716a5f5a47 {{(pid=83345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 13:16:42 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-1e36523f-635e-4baf-bd9f-3db5691eedc1 tempest-VolumesSnapshotTestJSON-825888665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:16:42 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-1e36523f-635e-4baf-bd9f-3db5691eedc1 tempest-VolumesSnapshotTestJSON-825888665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:16:42 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-1e36523f-635e-4baf-bd9f-3db5691eedc1 tempest-VolumesSnapshotTestJSON-825888665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:16:42 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-1e36523f-635e-4baf-bd9f-3db5691eedc1 tempest-VolumesSnapshotTestJSON-825888665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:16:42 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-1e36523f-635e-4baf-bd9f-3db5691eedc1 tempest-VolumesSnapshotTestJSON-825888665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:16:42 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-1e36523f-635e-4baf-bd9f-3db5691eedc1 tempest-VolumesSnapshotTestJSON-825888665 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:16:42 devstack cinder-volume[83345]: INFO cinder.volume.drivers.remotefs [None req-1e36523f-635e-4baf-bd9f-3db5691eedc1 tempest-VolumesSnapshotTestJSON-825888665 None] casted to osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331
Apr 10 13:16:42 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-1e36523f-635e-4baf-bd9f-3db5691eedc1 tempest-VolumesSnapshotTestJSON-825888665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7ec7d664-77c0-4f7d-b41b-5b716a5f5a47 1073741824 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:42 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-5be67972-88e9-421c-a011-738709c1b25b tempest-VolumesSnapshotListTestJSON-947768007 None] Lock "cinder-4faf7785-29e6-4fbc-b559-705a84ceb769-delete_volume" released by "delete_volume" :: held 1.697s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:16:42 devstack sudo[88973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7ec7d664-77c0-4f7d-b41b-5b716a5f5a47 1073741824
Apr 10 13:16:42 devstack sudo[88973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:42 devstack sudo[88967]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:42 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-0ac35f70-ee9b-4ba5-831a-fe73c7af653d tempest-SnapshotsActionsTest-1189246844 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.4f5b55c6-a3ad-4794-8bb5-40a452cfc583" returned: 0 in 0.541s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:42 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-0ac35f70-ee9b-4ba5-831a-fe73c7af653d tempest-SnapshotsActionsTest-1189246844 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 13:16:42 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-0ac35f70-ee9b-4ba5-831a-fe73c7af653d tempest-SnapshotsActionsTest-1189246844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.c1674960-231a-4828-aa21-d490df79b708 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:42 devstack sudo[88975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.c1674960-231a-4828-aa21-d490df79b708
Apr 10 13:16:42 devstack sudo[88975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:43 devstack sudo[88973]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:43 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-1e36523f-635e-4baf-bd9f-3db5691eedc1 tempest-VolumesSnapshotTestJSON-825888665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7ec7d664-77c0-4f7d-b41b-5b716a5f5a47 1073741824" returned: 0 in 0.527s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:43 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-1e36523f-635e-4baf-bd9f-3db5691eedc1 tempest-VolumesSnapshotTestJSON-825888665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7ec7d664-77c0-4f7d-b41b-5b716a5f5a47 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:43 devstack sudo[88983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7ec7d664-77c0-4f7d-b41b-5b716a5f5a47
Apr 10 13:16:43 devstack sudo[88983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:43 devstack sudo[88975]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:43 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-0ac35f70-ee9b-4ba5-831a-fe73c7af653d tempest-SnapshotsActionsTest-1189246844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.c1674960-231a-4828-aa21-d490df79b708" returned: 0 in 0.572s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:43 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-0ac35f70-ee9b-4ba5-831a-fe73c7af653d tempest-SnapshotsActionsTest-1189246844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.c1674960-231a-4828-aa21-d490df79b708 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:43 devstack sudo[88985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.c1674960-231a-4828-aa21-d490df79b708
Apr 10 13:16:43 devstack sudo[88985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:43 devstack sudo[88983]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:43 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-1e36523f-635e-4baf-bd9f-3db5691eedc1 tempest-VolumesSnapshotTestJSON-825888665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7ec7d664-77c0-4f7d-b41b-5b716a5f5a47" returned: 0 in 0.487s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:43 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-1e36523f-635e-4baf-bd9f-3db5691eedc1 tempest-VolumesSnapshotTestJSON-825888665 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'} {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 13:16:43 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-1e36523f-635e-4baf-bd9f-3db5691eedc1 tempest-VolumesSnapshotTestJSON-825888665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.046s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:16:43 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-1e36523f-635e-4baf-bd9f-3db5691eedc1 tempest-VolumesSnapshotTestJSON-825888665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0f07d18-327d-4320-a6b5-d4a057508a4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ec7d664-77c0-4f7d-b41b-5b716a5f5a47', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:16:43 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-1e36523f-635e-4baf-bd9f-3db5691eedc1 tempest-VolumesSnapshotTestJSON-825888665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98356b90-6aef-47b4-886f-ec7803f78e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:16:43 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-1e36523f-635e-4baf-bd9f-3db5691eedc1 tempest-VolumesSnapshotTestJSON-825888665 None] Volume volume-7ec7d664-77c0-4f7d-b41b-5b716a5f5a47 (7ec7d664-77c0-4f7d-b41b-5b716a5f5a47): created successfully
Apr 10 13:16:43 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-1e36523f-635e-4baf-bd9f-3db5691eedc1 tempest-VolumesSnapshotTestJSON-825888665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98356b90-6aef-47b4-886f-ec7803f78e1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:16:43 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-1e36523f-635e-4baf-bd9f-3db5691eedc1 tempest-VolumesSnapshotTestJSON-825888665 None] Flow 'volume_create_manager' (699061d2-e46e-4ea4-9272-b6f434a5d8a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:16:43 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-1e36523f-635e-4baf-bd9f-3db5691eedc1 tempest-VolumesSnapshotTestJSON-825888665 None] Created volume successfully.
Apr 10 13:16:44 devstack sudo[88985]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:44 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-0ac35f70-ee9b-4ba5-831a-fe73c7af653d tempest-SnapshotsActionsTest-1189246844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.c1674960-231a-4828-aa21-d490df79b708" returned: 0 in 0.508s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:44 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-0ac35f70-ee9b-4ba5-831a-fe73c7af653d tempest-SnapshotsActionsTest-1189246844 None] Lock "cinder-quobyte-c1674960-231a-4828-aa21-d490df79b708" released by "_delete_snapshot" :: held 2.192s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:16:44 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-0ac35f70-ee9b-4ba5-831a-fe73c7af653d tempest-SnapshotsActionsTest-1189246844 None] Lock "cinder-quobyte-4f013013-ffcb-4dd4-8e73-3e004e4c6f11" released by "delete_snapshot" :: held 2.204s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:16:44 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-0ac35f70-ee9b-4ba5-831a-fe73c7af653d tempest-SnapshotsActionsTest-1189246844 None] Created reservations ['e1c66bc9-f259-47ae-b718-fb3e8ae1bbac', '6eb2ecd6-e05f-41f9-b8cf-236eaf3e4357', 'cb2cc31d-ae06-45a6-849a-69accee215d6', '02ed163f-d350-4b25-8926-7bc6b46e8d7e'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:16:44 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-0ac35f70-ee9b-4ba5-831a-fe73c7af653d tempest-SnapshotsActionsTest-1189246844 None] Delete snapshot completed successfully.
Apr 10 13:16:44 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-0ac35f70-ee9b-4ba5-831a-fe73c7af653d tempest-SnapshotsActionsTest-1189246844 None] Lock "cinder-c1674960-231a-4828-aa21-d490df79b708-delete_snapshot" released by "delete_snapshot" :: held 2.326s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:16:44 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-79e40db5-0f56-4c53-ad66-ed4626edced1 tempest-VolumesSnapshotTestJSON-825888665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:16:44 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-79e40db5-0f56-4c53-ad66-ed4626edced1 tempest-VolumesSnapshotTestJSON-825888665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:16:44 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-79e40db5-0f56-4c53-ad66-ed4626edced1 tempest-VolumesSnapshotTestJSON-825888665 None] Creating offline snapshot 58aa5b51-39ab-45ac-b690-03ef6e1dfda0 of volume 7ec7d664-77c0-4f7d-b41b-5b716a5f5a47 {{(pid=83345) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 10 13:16:44 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[0599d6a9-a362-4cd0-b0dc-418a761e2d37]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:16:44 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-79e40db5-0f56-4c53-ad66-ed4626edced1 tempest-VolumesSnapshotTestJSON-825888665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7ec7d664-77c0-4f7d-b41b-5b716a5f5a47 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:45 devstack sudo[88990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7ec7d664-77c0-4f7d-b41b-5b716a5f5a47
Apr 10 13:16:45 devstack sudo[88990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:45 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-66191c06-569d-4845-be71-02ce0166386f tempest-SnapshotsActionsTest-802738678 None] Acquiring lock "cinder-4f5b55c6-a3ad-4794-8bb5-40a452cfc583-delete_snapshot" by "delete_snapshot" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:16:45 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-66191c06-569d-4845-be71-02ce0166386f tempest-SnapshotsActionsTest-802738678 None] Lock "cinder-4f5b55c6-a3ad-4794-8bb5-40a452cfc583-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:16:45 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-66191c06-569d-4845-be71-02ce0166386f tempest-SnapshotsActionsTest-802738678 None] Acquiring lock "cinder-quobyte-4f013013-ffcb-4dd4-8e73-3e004e4c6f11" by "delete_snapshot" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:16:45 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-66191c06-569d-4845-be71-02ce0166386f tempest-SnapshotsActionsTest-802738678 None] Lock "cinder-quobyte-4f013013-ffcb-4dd4-8e73-3e004e4c6f11" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:16:45 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-66191c06-569d-4845-be71-02ce0166386f tempest-SnapshotsActionsTest-802738678 None] Acquiring lock "cinder-quobyte-4f5b55c6-a3ad-4794-8bb5-40a452cfc583" by "_delete_snapshot" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:16:45 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-66191c06-569d-4845-be71-02ce0166386f tempest-SnapshotsActionsTest-802738678 None] Lock "cinder-quobyte-4f5b55c6-a3ad-4794-8bb5-40a452cfc583" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:16:45 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-66191c06-569d-4845-be71-02ce0166386f tempest-SnapshotsActionsTest-802738678 None] Deleting offline snapshot 4f5b55c6-a3ad-4794-8bb5-40a452cfc583 of volume 4f013013-ffcb-4dd4-8e73-3e004e4c6f11 {{(pid=83345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 10 13:16:45 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-66191c06-569d-4845-be71-02ce0166386f tempest-SnapshotsActionsTest-802738678 None] snapshot_file for this snap is: volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.4f5b55c6-a3ad-4794-8bb5-40a452cfc583 {{(pid=83345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 10 13:16:45 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[76f4e1a4-0a05-43c0-8e74-b43a5af7b73c]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:16:45 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-66191c06-569d-4845-be71-02ce0166386f tempest-SnapshotsActionsTest-802738678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.4f5b55c6-a3ad-4794-8bb5-40a452cfc583 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:45 devstack sudo[88992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.4f5b55c6-a3ad-4794-8bb5-40a452cfc583
Apr 10 13:16:45 devstack sudo[88992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:45 devstack sudo[88990]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:45 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-79e40db5-0f56-4c53-ad66-ed4626edced1 tempest-VolumesSnapshotTestJSON-825888665 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7ec7d664-77c0-4f7d-b41b-5b716a5f5a47" returned: 0 in 0.586s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:45 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-79e40db5-0f56-4c53-ad66-ed4626edced1 tempest-VolumesSnapshotTestJSON-825888665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7ec7d664-77c0-4f7d-b41b-5b716a5f5a47,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7ec7d664-77c0-4f7d-b41b-5b716a5f5a47.58aa5b51-39ab-45ac-b690-03ef6e1dfda0 1G {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:45 devstack sudo[88997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7ec7d664-77c0-4f7d-b41b-5b716a5f5a47,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7ec7d664-77c0-4f7d-b41b-5b716a5f5a47.58aa5b51-39ab-45ac-b690-03ef6e1dfda0 1G
Apr 10 13:16:45 devstack sudo[88997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:45 devstack sudo[88992]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:45 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-66191c06-569d-4845-be71-02ce0166386f tempest-SnapshotsActionsTest-802738678 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.4f5b55c6-a3ad-4794-8bb5-40a452cfc583" returned: 0 in 0.555s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:45 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-66191c06-569d-4845-be71-02ce0166386f tempest-SnapshotsActionsTest-802738678 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 13:16:45 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[7afff964-3a05-4d30-85de-486a374b8dac]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:16:45 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-66191c06-569d-4845-be71-02ce0166386f tempest-SnapshotsActionsTest-802738678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:46 devstack sudo[89002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11
Apr 10 13:16:46 devstack sudo[89002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:46 devstack sudo[88997]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:46 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-79e40db5-0f56-4c53-ad66-ed4626edced1 tempest-VolumesSnapshotTestJSON-825888665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7ec7d664-77c0-4f7d-b41b-5b716a5f5a47,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7ec7d664-77c0-4f7d-b41b-5b716a5f5a47.58aa5b51-39ab-45ac-b690-03ef6e1dfda0 1G" returned: 0 in 0.610s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:46 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-79e40db5-0f56-4c53-ad66-ed4626edced1 tempest-VolumesSnapshotTestJSON-825888665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ec7d664-77c0-4f7d-b41b-5b716a5f5a47 -F qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7ec7d664-77c0-4f7d-b41b-5b716a5f5a47.58aa5b51-39ab-45ac-b690-03ef6e1dfda0 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:46 devstack sudo[89007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ec7d664-77c0-4f7d-b41b-5b716a5f5a47 -F qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7ec7d664-77c0-4f7d-b41b-5b716a5f5a47.58aa5b51-39ab-45ac-b690-03ef6e1dfda0
Apr 10 13:16:46 devstack sudo[89007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:46 devstack sudo[89002]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:46 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-66191c06-569d-4845-be71-02ce0166386f tempest-SnapshotsActionsTest-802738678 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11" returned: 0 in 0.624s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:46 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-66191c06-569d-4845-be71-02ce0166386f tempest-SnapshotsActionsTest-802738678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.4f5b55c6-a3ad-4794-8bb5-40a452cfc583 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:46 devstack sudo[89012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.4f5b55c6-a3ad-4794-8bb5-40a452cfc583
Apr 10 13:16:46 devstack sudo[89012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:46 devstack sudo[89007]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:46 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-79e40db5-0f56-4c53-ad66-ed4626edced1 tempest-VolumesSnapshotTestJSON-825888665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ec7d664-77c0-4f7d-b41b-5b716a5f5a47 -F qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7ec7d664-77c0-4f7d-b41b-5b716a5f5a47.58aa5b51-39ab-45ac-b690-03ef6e1dfda0" returned: 0 in 0.541s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:46 devstack cinder-volume[83345]: WARNING cinder.volume.drivers.remotefs [None req-79e40db5-0f56-4c53-ad66-ed4626edced1 tempest-VolumesSnapshotTestJSON-825888665 None] /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7ec7d664-77c0-4f7d-b41b-5b716a5f5a47.58aa5b51-39ab-45ac-b690-03ef6e1dfda0 is being set with open permissions: ugo+rw
Apr 10 13:16:46 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-79e40db5-0f56-4c53-ad66-ed4626edced1 tempest-VolumesSnapshotTestJSON-825888665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7ec7d664-77c0-4f7d-b41b-5b716a5f5a47.58aa5b51-39ab-45ac-b690-03ef6e1dfda0 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:46 devstack sudo[89019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7ec7d664-77c0-4f7d-b41b-5b716a5f5a47.58aa5b51-39ab-45ac-b690-03ef6e1dfda0
Apr 10 13:16:46 devstack sudo[89019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:47 devstack sudo[89012]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:47 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-66191c06-569d-4845-be71-02ce0166386f tempest-SnapshotsActionsTest-802738678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.4f5b55c6-a3ad-4794-8bb5-40a452cfc583" returned: 0 in 0.526s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:47 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-66191c06-569d-4845-be71-02ce0166386f tempest-SnapshotsActionsTest-802738678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.4f5b55c6-a3ad-4794-8bb5-40a452cfc583 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:47 devstack sudo[89034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.4f5b55c6-a3ad-4794-8bb5-40a452cfc583
Apr 10 13:16:47 devstack sudo[89034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:47 devstack sudo[89019]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:47 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-79e40db5-0f56-4c53-ad66-ed4626edced1 tempest-VolumesSnapshotTestJSON-825888665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7ec7d664-77c0-4f7d-b41b-5b716a5f5a47.58aa5b51-39ab-45ac-b690-03ef6e1dfda0" returned: 0 in 0.509s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:47 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-79e40db5-0f56-4c53-ad66-ed4626edced1 tempest-VolumesSnapshotTestJSON-825888665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7ec7d664-77c0-4f7d-b41b-5b716a5f5a47.info {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:47 devstack sudo[89043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7ec7d664-77c0-4f7d-b41b-5b716a5f5a47.info
Apr 10 13:16:47 devstack sudo[89043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:47 devstack sudo[89034]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:47 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-66191c06-569d-4845-be71-02ce0166386f tempest-SnapshotsActionsTest-802738678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11.4f5b55c6-a3ad-4794-8bb5-40a452cfc583" returned: 0 in 0.475s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:47 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-66191c06-569d-4845-be71-02ce0166386f tempest-SnapshotsActionsTest-802738678 None] Lock "cinder-quobyte-4f5b55c6-a3ad-4794-8bb5-40a452cfc583" released by "_delete_snapshot" :: held 2.250s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:16:47 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-66191c06-569d-4845-be71-02ce0166386f tempest-SnapshotsActionsTest-802738678 None] Lock "cinder-quobyte-4f013013-ffcb-4dd4-8e73-3e004e4c6f11" released by "delete_snapshot" :: held 2.266s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:16:47 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-66191c06-569d-4845-be71-02ce0166386f tempest-SnapshotsActionsTest-802738678 None] Created reservations ['5d92f420-f32e-433e-b5a4-cf42e3269103', '5d4e58e4-6a1a-45f7-923d-956f8378c8dd', 'bae216d9-49d8-4a55-afe0-16381e82bb7d', '38849f14-7b4e-4d08-8a49-2c73614361c4'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:16:47 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-66191c06-569d-4845-be71-02ce0166386f tempest-SnapshotsActionsTest-802738678 None] Delete snapshot completed successfully.
Apr 10 13:16:47 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-66191c06-569d-4845-be71-02ce0166386f tempest-SnapshotsActionsTest-802738678 None] Lock "cinder-4f5b55c6-a3ad-4794-8bb5-40a452cfc583-delete_snapshot" released by "delete_snapshot" :: held 2.361s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:16:47 devstack sudo[89043]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:47 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-79e40db5-0f56-4c53-ad66-ed4626edced1 tempest-VolumesSnapshotTestJSON-825888665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7ec7d664-77c0-4f7d-b41b-5b716a5f5a47.info" returned: 0 in 0.464s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:47 devstack cinder-volume[83345]: WARNING cinder.volume.drivers.remotefs [None req-79e40db5-0f56-4c53-ad66-ed4626edced1 tempest-VolumesSnapshotTestJSON-825888665 None] /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7ec7d664-77c0-4f7d-b41b-5b716a5f5a47.info is being set with open permissions: ugo+rw
Apr 10 13:16:47 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-79e40db5-0f56-4c53-ad66-ed4626edced1 tempest-VolumesSnapshotTestJSON-825888665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7ec7d664-77c0-4f7d-b41b-5b716a5f5a47.info {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:47 devstack sudo[89047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7ec7d664-77c0-4f7d-b41b-5b716a5f5a47.info
Apr 10 13:16:47 devstack sudo[89047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:48 devstack sudo[89047]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:48 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-79e40db5-0f56-4c53-ad66-ed4626edced1 tempest-VolumesSnapshotTestJSON-825888665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7ec7d664-77c0-4f7d-b41b-5b716a5f5a47.info" returned: 0 in 0.408s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:48 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-79e40db5-0f56-4c53-ad66-ed4626edced1 tempest-VolumesSnapshotTestJSON-825888665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.184s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:16:48 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-79e40db5-0f56-4c53-ad66-ed4626edced1 tempest-VolumesSnapshotTestJSON-825888665 None] Create snapshot completed successfully
Apr 10 13:16:48 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-6a80b149-47e8-454f-9b2c-94ff5aa18862 tempest-SnapshotsActionsTest-802738678 None] Acquiring lock "cinder-4f013013-ffcb-4dd4-8e73-3e004e4c6f11-delete_volume" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:16:48 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-6a80b149-47e8-454f-9b2c-94ff5aa18862 tempest-SnapshotsActionsTest-802738678 None] Lock "cinder-4f013013-ffcb-4dd4-8e73-3e004e4c6f11-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:16:48 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-6a80b149-47e8-454f-9b2c-94ff5aa18862 tempest-SnapshotsActionsTest-802738678 None] Acquiring lock "cinder-quobyte-4f013013-ffcb-4dd4-8e73-3e004e4c6f11" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:16:48 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-6a80b149-47e8-454f-9b2c-94ff5aa18862 tempest-SnapshotsActionsTest-802738678 None] Lock "cinder-quobyte-4f013013-ffcb-4dd4-8e73-3e004e4c6f11" acquired by "delete_volume" :: waited 0.008s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:16:48 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2db7591-3b83-4869-8518-e0e832aee27b]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:16:48 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-6a80b149-47e8-454f-9b2c-94ff5aa18862 tempest-SnapshotsActionsTest-802738678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:48 devstack sudo[89050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11
Apr 10 13:16:48 devstack sudo[89050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:49 devstack sudo[89050]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:49 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-6a80b149-47e8-454f-9b2c-94ff5aa18862 tempest-SnapshotsActionsTest-802738678 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11" returned: 0 in 0.506s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:49 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-6a80b149-47e8-454f-9b2c-94ff5aa18862 tempest-SnapshotsActionsTest-802738678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:49 devstack sudo[89055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11
Apr 10 13:16:49 devstack sudo[89055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:49 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-f903d05d-96aa-4953-ba91-78cd61cfd64c tempest-VolumesSnapshotTestJSON-825888665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:16:49 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-f903d05d-96aa-4953-ba91-78cd61cfd64c tempest-VolumesSnapshotTestJSON-825888665 None] Flow 'volume_create_manager' (d115d476-3c97-46ff-aec3-b9acee6a6f1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:16:49 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-f903d05d-96aa-4953-ba91-78cd61cfd64c tempest-VolumesSnapshotTestJSON-825888665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67e11d2c-747c-4766-99f6-c38901490a95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:16:49 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-f903d05d-96aa-4953-ba91-78cd61cfd64c tempest-VolumesSnapshotTestJSON-825888665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67e11d2c-747c-4766-99f6-c38901490a95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:16:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2127385737',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87ea5688-3a41-4972-a23f-39dfeaed8a35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a23589ebdac46368f1e33de5aeb8af1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:16:49Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=58aa5b51-39ab-45ac-b690-03ef6e1dfda0,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:16:49Z,use_quota=True,user_id='5bb118cb04cc4be28306326a911fb71f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:16:49 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-f903d05d-96aa-4953-ba91-78cd61cfd64c tempest-VolumesSnapshotTestJSON-825888665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3e8b300-38b3-4948-9ac0-131aa49ac5a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:16:49 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-f903d05d-96aa-4953-ba91-78cd61cfd64c tempest-VolumesSnapshotTestJSON-825888665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3e8b300-38b3-4948-9ac0-131aa49ac5a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:16:49 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-f903d05d-96aa-4953-ba91-78cd61cfd64c tempest-VolumesSnapshotTestJSON-825888665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8405d87d-3de4-45e9-ac09-1c0591cd7eaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:16:49 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-f903d05d-96aa-4953-ba91-78cd61cfd64c tempest-VolumesSnapshotTestJSON-825888665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8405d87d-3de4-45e9-ac09-1c0591cd7eaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '87ea5688-3a41-4972-a23f-39dfeaed8a35', 'volume_name': 'volume-87ea5688-3a41-4972-a23f-39dfeaed8a35', 'volume_size': 2, 'snapshot_id': '58aa5b51-39ab-45ac-b690-03ef6e1dfda0'}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:16:49 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-f903d05d-96aa-4953-ba91-78cd61cfd64c tempest-VolumesSnapshotTestJSON-825888665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fbe2782-7cba-4fd1-9b3f-a112a4b0cb81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:16:49 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-f903d05d-96aa-4953-ba91-78cd61cfd64c tempest-VolumesSnapshotTestJSON-825888665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fbe2782-7cba-4fd1-9b3f-a112a4b0cb81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:16:49 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-f903d05d-96aa-4953-ba91-78cd61cfd64c tempest-VolumesSnapshotTestJSON-825888665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c864d47-31b4-4fc2-be8a-352dcdd9abfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:16:49 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-f903d05d-96aa-4953-ba91-78cd61cfd64c tempest-VolumesSnapshotTestJSON-825888665 None] Volume 87ea5688-3a41-4972-a23f-39dfeaed8a35: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-87ea5688-3a41-4972-a23f-39dfeaed8a35', 'volume_size': 2, 'snapshot_id': '58aa5b51-39ab-45ac-b690-03ef6e1dfda0'}
Apr 10 13:16:49 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-f903d05d-96aa-4953-ba91-78cd61cfd64c tempest-VolumesSnapshotTestJSON-825888665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:16:49 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-f903d05d-96aa-4953-ba91-78cd61cfd64c tempest-VolumesSnapshotTestJSON-825888665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:16:49 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-f903d05d-96aa-4953-ba91-78cd61cfd64c tempest-VolumesSnapshotTestJSON-825888665 None] Acquiring lock "cinder-quobyte-58aa5b51-39ab-45ac-b690-03ef6e1dfda0-87ea5688-3a41-4972-a23f-39dfeaed8a35" by "_create_volume_from_snapshot" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:16:49 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-f903d05d-96aa-4953-ba91-78cd61cfd64c tempest-VolumesSnapshotTestJSON-825888665 None] Lock "cinder-quobyte-58aa5b51-39ab-45ac-b690-03ef6e1dfda0-87ea5688-3a41-4972-a23f-39dfeaed8a35" acquired by "_create_volume_from_snapshot" :: waited 0.008s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:16:49 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-f903d05d-96aa-4953-ba91-78cd61cfd64c tempest-VolumesSnapshotTestJSON-825888665 None] Creating volume 87ea5688-3a41-4972-a23f-39dfeaed8a35 from snapshot 58aa5b51-39ab-45ac-b690-03ef6e1dfda0 {{(pid=83345) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 10 13:16:49 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-f903d05d-96aa-4953-ba91-78cd61cfd64c tempest-VolumesSnapshotTestJSON-825888665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:16:49 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-f903d05d-96aa-4953-ba91-78cd61cfd64c tempest-VolumesSnapshotTestJSON-825888665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:16:49 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-f903d05d-96aa-4953-ba91-78cd61cfd64c tempest-VolumesSnapshotTestJSON-825888665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:16:49 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-f903d05d-96aa-4953-ba91-78cd61cfd64c tempest-VolumesSnapshotTestJSON-825888665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:16:49 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-f903d05d-96aa-4953-ba91-78cd61cfd64c tempest-VolumesSnapshotTestJSON-825888665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:16:49 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-f903d05d-96aa-4953-ba91-78cd61cfd64c tempest-VolumesSnapshotTestJSON-825888665 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:16:49 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-f903d05d-96aa-4953-ba91-78cd61cfd64c tempest-VolumesSnapshotTestJSON-825888665 None] Acquiring lock "cinder-quobyte-87ea5688-3a41-4972-a23f-39dfeaed8a35" by "_copy_volume_from_snapshot" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:16:49 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-f903d05d-96aa-4953-ba91-78cd61cfd64c tempest-VolumesSnapshotTestJSON-825888665 None] Lock "cinder-quobyte-87ea5688-3a41-4972-a23f-39dfeaed8a35" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:16:49 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-f903d05d-96aa-4953-ba91-78cd61cfd64c tempest-VolumesSnapshotTestJSON-825888665 None] snapshot: 58aa5b51-39ab-45ac-b690-03ef6e1dfda0, volume: 87ea5688-3a41-4972-a23f-39dfeaed8a35,  {{(pid=83345) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 10 13:16:49 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-f903d05d-96aa-4953-ba91-78cd61cfd64c tempest-VolumesSnapshotTestJSON-825888665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:16:49 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-f903d05d-96aa-4953-ba91-78cd61cfd64c tempest-VolumesSnapshotTestJSON-825888665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:16:49 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-f903d05d-96aa-4953-ba91-78cd61cfd64c tempest-VolumesSnapshotTestJSON-825888665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:16:49 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-f903d05d-96aa-4953-ba91-78cd61cfd64c tempest-VolumesSnapshotTestJSON-825888665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:16:49 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-f903d05d-96aa-4953-ba91-78cd61cfd64c tempest-VolumesSnapshotTestJSON-825888665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:16:49 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[761a3237-98ad-4a86-84fc-037dc038abf8]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:16:49 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-f903d05d-96aa-4953-ba91-78cd61cfd64c tempest-VolumesSnapshotTestJSON-825888665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7ec7d664-77c0-4f7d-b41b-5b716a5f5a47.58aa5b51-39ab-45ac-b690-03ef6e1dfda0 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:49 devstack sudo[89055]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:49 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-6a80b149-47e8-454f-9b2c-94ff5aa18862 tempest-SnapshotsActionsTest-802738678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f013013-ffcb-4dd4-8e73-3e004e4c6f11" returned: 0 in 0.475s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:49 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-6a80b149-47e8-454f-9b2c-94ff5aa18862 tempest-SnapshotsActionsTest-802738678 None] Lock "cinder-quobyte-4f013013-ffcb-4dd4-8e73-3e004e4c6f11" released by "delete_volume" :: held 1.013s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:16:49 devstack sudo[89059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7ec7d664-77c0-4f7d-b41b-5b716a5f5a47.58aa5b51-39ab-45ac-b690-03ef6e1dfda0
Apr 10 13:16:49 devstack sudo[89059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:49 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-6a80b149-47e8-454f-9b2c-94ff5aa18862 tempest-SnapshotsActionsTest-802738678 None] Created reservations ['d3f4b9a0-4ab7-4165-b05e-25f729da0bc4', 'cf1fdd16-ef36-4edf-ac59-899ae92178a4', '6fa617cb-96ba-49b1-a0b7-86a6765e0559', '219d1351-3801-45cb-a65b-47b6a4a5d961'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:16:49 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-6a80b149-47e8-454f-9b2c-94ff5aa18862 tempest-SnapshotsActionsTest-802738678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:16:49 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-6a80b149-47e8-454f-9b2c-94ff5aa18862 tempest-SnapshotsActionsTest-802738678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:16:49 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-6a80b149-47e8-454f-9b2c-94ff5aa18862 tempest-SnapshotsActionsTest-802738678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:16:49 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-6a80b149-47e8-454f-9b2c-94ff5aa18862 tempest-SnapshotsActionsTest-802738678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:16:49 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-6a80b149-47e8-454f-9b2c-94ff5aa18862 tempest-SnapshotsActionsTest-802738678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:16:49 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-6a80b149-47e8-454f-9b2c-94ff5aa18862 tempest-SnapshotsActionsTest-802738678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:49 devstack sudo[89061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:16:49 devstack sudo[89061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:50 devstack sudo[89059]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:50 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-f903d05d-96aa-4953-ba91-78cd61cfd64c tempest-VolumesSnapshotTestJSON-825888665 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7ec7d664-77c0-4f7d-b41b-5b716a5f5a47.58aa5b51-39ab-45ac-b690-03ef6e1dfda0" returned: 0 in 0.519s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:50 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-f903d05d-96aa-4953-ba91-78cd61cfd64c tempest-VolumesSnapshotTestJSON-825888665 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ec7d664-77c0-4f7d-b41b-5b716a5f5a47(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 13:16:50 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-f903d05d-96aa-4953-ba91-78cd61cfd64c tempest-VolumesSnapshotTestJSON-825888665 None] will copy from snapshot at /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7ec7d664-77c0-4f7d-b41b-5b716a5f5a47 {{(pid=83345) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 10 13:16:50 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-f903d05d-96aa-4953-ba91-78cd61cfd64c tempest-VolumesSnapshotTestJSON-825888665 None] Creating direct copy from snapshot {{(pid=83345) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 10 13:16:50 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5dec1c1-f20f-4333-b9c9-daddc85b0c3c]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:16:50 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-f903d05d-96aa-4953-ba91-78cd61cfd64c tempest-VolumesSnapshotTestJSON-825888665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7ec7d664-77c0-4f7d-b41b-5b716a5f5a47 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:50 devstack sudo[89061]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:50 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-6a80b149-47e8-454f-9b2c-94ff5aa18862 tempest-SnapshotsActionsTest-802738678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.445s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:50 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-6a80b149-47e8-454f-9b2c-94ff5aa18862 tempest-SnapshotsActionsTest-802738678 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:16:50 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-6a80b149-47e8-454f-9b2c-94ff5aa18862 tempest-SnapshotsActionsTest-802738678 None] Deleted volume successfully.
Apr 10 13:16:50 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-6a80b149-47e8-454f-9b2c-94ff5aa18862 tempest-SnapshotsActionsTest-802738678 None] Lock "cinder-4f013013-ffcb-4dd4-8e73-3e004e4c6f11-delete_volume" released by "delete_volume" :: held 1.600s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:16:50 devstack sudo[89070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7ec7d664-77c0-4f7d-b41b-5b716a5f5a47
Apr 10 13:16:50 devstack sudo[89070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:50 devstack sudo[89070]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:50 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-f903d05d-96aa-4953-ba91-78cd61cfd64c tempest-VolumesSnapshotTestJSON-825888665 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7ec7d664-77c0-4f7d-b41b-5b716a5f5a47" returned: 0 in 0.474s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:50 devstack cinder-volume[83345]: DEBUG cinder.utils [None req-f903d05d-96aa-4953-ba91-78cd61cfd64c tempest-VolumesSnapshotTestJSON-825888665 None] Path /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-87ea5688-3a41-4972-a23f-39dfeaed8a35 not found in is_blk_device check {{(pid=83345) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 10 13:16:50 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-f903d05d-96aa-4953-ba91-78cd61cfd64c tempest-VolumesSnapshotTestJSON-825888665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7ec7d664-77c0-4f7d-b41b-5b716a5f5a47 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-87ea5688-3a41-4972-a23f-39dfeaed8a35 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:50 devstack sudo[89075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7ec7d664-77c0-4f7d-b41b-5b716a5f5a47 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-87ea5688-3a41-4972-a23f-39dfeaed8a35
Apr 10 13:16:50 devstack sudo[89075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:53 devstack sudo[89075]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:53 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-f903d05d-96aa-4953-ba91-78cd61cfd64c tempest-VolumesSnapshotTestJSON-825888665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7ec7d664-77c0-4f7d-b41b-5b716a5f5a47 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-87ea5688-3a41-4972-a23f-39dfeaed8a35" returned: 0 in 2.945s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:53 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f372e53-b89e-4bf3-9bd7-f804f443d152]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:16:53 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-f903d05d-96aa-4953-ba91-78cd61cfd64c tempest-VolumesSnapshotTestJSON-825888665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7ec7d664-77c0-4f7d-b41b-5b716a5f5a47 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:53 devstack cinder-volume[83345]: DEBUG oslo_service.periodic_task [None req-c3f44832-ad7f-424b-a850-32c7352a19c5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83345) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 10 13:16:53 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-c3f44832-ad7f-424b-a850-32c7352a19c5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:16:53 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-c3f44832-ad7f-424b-a850-32c7352a19c5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:16:53 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-c3f44832-ad7f-424b-a850-32c7352a19c5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:16:53 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-c3f44832-ad7f-424b-a850-32c7352a19c5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:16:53 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-c3f44832-ad7f-424b-a850-32c7352a19c5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:16:53 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-c3f44832-ad7f-424b-a850-32c7352a19c5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:53 devstack sudo[89118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7ec7d664-77c0-4f7d-b41b-5b716a5f5a47
Apr 10 13:16:53 devstack sudo[89118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:53 devstack sudo[89119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:16:53 devstack sudo[89119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:54 devstack sudo[89119]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:54 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-c3f44832-ad7f-424b-a850-32c7352a19c5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.582s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:54 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-c3f44832-ad7f-424b-a850-32c7352a19c5 None None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:16:54 devstack sudo[89118]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:54 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-f903d05d-96aa-4953-ba91-78cd61cfd64c tempest-VolumesSnapshotTestJSON-825888665 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7ec7d664-77c0-4f7d-b41b-5b716a5f5a47" returned: 0 in 0.734s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:54 devstack cinder-volume[83345]: DEBUG cinder.image.image_utils [None req-f903d05d-96aa-4953-ba91-78cd61cfd64c tempest-VolumesSnapshotTestJSON-825888665 None] Image conversion details: src /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7ec7d664-77c0-4f7d-b41b-5b716a5f5a47, size 1024.00 MB, duration 2.95 sec, destination /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-87ea5688-3a41-4972-a23f-39dfeaed8a35 {{(pid=83345) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 10 13:16:54 devstack cinder-volume[83345]: INFO cinder.image.image_utils [None req-f903d05d-96aa-4953-ba91-78cd61cfd64c tempest-VolumesSnapshotTestJSON-825888665 None] Converted 1024.00 MB image at 347.46 MB/s
Apr 10 13:16:54 devstack cinder-volume[83345]: WARNING cinder.volume.drivers.remotefs [None req-f903d05d-96aa-4953-ba91-78cd61cfd64c tempest-VolumesSnapshotTestJSON-825888665 None] /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-87ea5688-3a41-4972-a23f-39dfeaed8a35 is being set with open permissions: ugo+rw
Apr 10 13:16:54 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-f903d05d-96aa-4953-ba91-78cd61cfd64c tempest-VolumesSnapshotTestJSON-825888665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-87ea5688-3a41-4972-a23f-39dfeaed8a35 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:54 devstack sudo[89126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-87ea5688-3a41-4972-a23f-39dfeaed8a35
Apr 10 13:16:54 devstack sudo[89126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:54 devstack sudo[89126]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:54 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-f903d05d-96aa-4953-ba91-78cd61cfd64c tempest-VolumesSnapshotTestJSON-825888665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-87ea5688-3a41-4972-a23f-39dfeaed8a35" returned: 0 in 0.696s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:54 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-f903d05d-96aa-4953-ba91-78cd61cfd64c tempest-VolumesSnapshotTestJSON-825888665 None] Lock "cinder-quobyte-87ea5688-3a41-4972-a23f-39dfeaed8a35" released by "_copy_volume_from_snapshot" :: held 5.432s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:16:54 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-f903d05d-96aa-4953-ba91-78cd61cfd64c tempest-VolumesSnapshotTestJSON-825888665 None] Lock "cinder-quobyte-58aa5b51-39ab-45ac-b690-03ef6e1dfda0-87ea5688-3a41-4972-a23f-39dfeaed8a35" released by "_create_volume_from_snapshot" :: held 5.450s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:16:54 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-f903d05d-96aa-4953-ba91-78cd61cfd64c tempest-VolumesSnapshotTestJSON-825888665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.459s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:16:54 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-f903d05d-96aa-4953-ba91-78cd61cfd64c tempest-VolumesSnapshotTestJSON-825888665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c864d47-31b4-4fc2-be8a-352dcdd9abfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87ea5688-3a41-4972-a23f-39dfeaed8a35', 'volume_size': 2, 'snapshot_id': '58aa5b51-39ab-45ac-b690-03ef6e1dfda0'}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:16:54 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-f903d05d-96aa-4953-ba91-78cd61cfd64c tempest-VolumesSnapshotTestJSON-825888665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f9bef9d-09a6-45bc-bcd7-817652dcf687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:16:54 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-f903d05d-96aa-4953-ba91-78cd61cfd64c tempest-VolumesSnapshotTestJSON-825888665 None] Volume volume-87ea5688-3a41-4972-a23f-39dfeaed8a35 (87ea5688-3a41-4972-a23f-39dfeaed8a35): created successfully
Apr 10 13:16:54 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-f903d05d-96aa-4953-ba91-78cd61cfd64c tempest-VolumesSnapshotTestJSON-825888665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f9bef9d-09a6-45bc-bcd7-817652dcf687) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:16:54 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-f903d05d-96aa-4953-ba91-78cd61cfd64c tempest-VolumesSnapshotTestJSON-825888665 None] Flow 'volume_create_manager' (d115d476-3c97-46ff-aec3-b9acee6a6f1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:16:55 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-f903d05d-96aa-4953-ba91-78cd61cfd64c tempest-VolumesSnapshotTestJSON-825888665 None] Created volume successfully.
Apr 10 13:16:55 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-84e254cb-0fa0-467c-9015-1b4372b0a560 tempest-VolumesSnapshotTestJSON-825888665 None] Acquiring lock "cinder-87ea5688-3a41-4972-a23f-39dfeaed8a35-delete_volume" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:16:55 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-84e254cb-0fa0-467c-9015-1b4372b0a560 tempest-VolumesSnapshotTestJSON-825888665 None] Lock "cinder-87ea5688-3a41-4972-a23f-39dfeaed8a35-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:16:56 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-84e254cb-0fa0-467c-9015-1b4372b0a560 tempest-VolumesSnapshotTestJSON-825888665 None] Acquiring lock "cinder-quobyte-87ea5688-3a41-4972-a23f-39dfeaed8a35" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:16:56 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-84e254cb-0fa0-467c-9015-1b4372b0a560 tempest-VolumesSnapshotTestJSON-825888665 None] Lock "cinder-quobyte-87ea5688-3a41-4972-a23f-39dfeaed8a35" acquired by "delete_volume" :: waited 0.011s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:16:56 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a8e4be8-480f-42ff-8838-448386eb5905]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:16:56 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-84e254cb-0fa0-467c-9015-1b4372b0a560 tempest-VolumesSnapshotTestJSON-825888665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-87ea5688-3a41-4972-a23f-39dfeaed8a35 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:56 devstack sudo[89159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-87ea5688-3a41-4972-a23f-39dfeaed8a35
Apr 10 13:16:56 devstack sudo[89159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:56 devstack sudo[89159]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:56 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-84e254cb-0fa0-467c-9015-1b4372b0a560 tempest-VolumesSnapshotTestJSON-825888665 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-87ea5688-3a41-4972-a23f-39dfeaed8a35" returned: 0 in 0.522s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:56 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-84e254cb-0fa0-467c-9015-1b4372b0a560 tempest-VolumesSnapshotTestJSON-825888665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-87ea5688-3a41-4972-a23f-39dfeaed8a35 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:56 devstack sudo[89165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-87ea5688-3a41-4972-a23f-39dfeaed8a35
Apr 10 13:16:56 devstack sudo[89165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:57 devstack sudo[89165]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:57 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-84e254cb-0fa0-467c-9015-1b4372b0a560 tempest-VolumesSnapshotTestJSON-825888665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-87ea5688-3a41-4972-a23f-39dfeaed8a35" returned: 0 in 0.433s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:57 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-84e254cb-0fa0-467c-9015-1b4372b0a560 tempest-VolumesSnapshotTestJSON-825888665 None] Lock "cinder-quobyte-87ea5688-3a41-4972-a23f-39dfeaed8a35" released by "delete_volume" :: held 0.989s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:16:57 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-84e254cb-0fa0-467c-9015-1b4372b0a560 tempest-VolumesSnapshotTestJSON-825888665 None] Created reservations ['0056965a-92e5-44f8-9b80-492912eac653', 'b848963e-1be8-4aec-8a05-c63bce41702d', '42819644-976d-45d6-9152-a02e4541267b', '57173922-2d46-426f-a9c2-39a5d7ce6d94'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:16:57 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-84e254cb-0fa0-467c-9015-1b4372b0a560 tempest-VolumesSnapshotTestJSON-825888665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:16:57 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-84e254cb-0fa0-467c-9015-1b4372b0a560 tempest-VolumesSnapshotTestJSON-825888665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:16:57 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-84e254cb-0fa0-467c-9015-1b4372b0a560 tempest-VolumesSnapshotTestJSON-825888665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:16:57 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-84e254cb-0fa0-467c-9015-1b4372b0a560 tempest-VolumesSnapshotTestJSON-825888665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:16:57 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-84e254cb-0fa0-467c-9015-1b4372b0a560 tempest-VolumesSnapshotTestJSON-825888665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:16:57 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-84e254cb-0fa0-467c-9015-1b4372b0a560 tempest-VolumesSnapshotTestJSON-825888665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:57 devstack sudo[89169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:16:57 devstack sudo[89169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:57 devstack sudo[89169]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:57 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-84e254cb-0fa0-467c-9015-1b4372b0a560 tempest-VolumesSnapshotTestJSON-825888665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.470s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:57 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-84e254cb-0fa0-467c-9015-1b4372b0a560 tempest-VolumesSnapshotTestJSON-825888665 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:16:57 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-84e254cb-0fa0-467c-9015-1b4372b0a560 tempest-VolumesSnapshotTestJSON-825888665 None] Deleted volume successfully.
Apr 10 13:16:57 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-84e254cb-0fa0-467c-9015-1b4372b0a560 tempest-VolumesSnapshotTestJSON-825888665 None] Lock "cinder-87ea5688-3a41-4972-a23f-39dfeaed8a35-delete_volume" released by "delete_volume" :: held 1.634s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:16:58 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-01d62908-4506-456c-9779-03996e46c4eb tempest-VolumesSnapshotTestJSON-825888665 None] Acquiring lock "cinder-58aa5b51-39ab-45ac-b690-03ef6e1dfda0-delete_snapshot" by "delete_snapshot" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:16:58 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-01d62908-4506-456c-9779-03996e46c4eb tempest-VolumesSnapshotTestJSON-825888665 None] Lock "cinder-58aa5b51-39ab-45ac-b690-03ef6e1dfda0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:16:58 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-01d62908-4506-456c-9779-03996e46c4eb tempest-VolumesSnapshotTestJSON-825888665 None] Acquiring lock "cinder-quobyte-7ec7d664-77c0-4f7d-b41b-5b716a5f5a47" by "delete_snapshot" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:16:58 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-01d62908-4506-456c-9779-03996e46c4eb tempest-VolumesSnapshotTestJSON-825888665 None] Lock "cinder-quobyte-7ec7d664-77c0-4f7d-b41b-5b716a5f5a47" acquired by "delete_snapshot" :: waited 0.007s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:16:58 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-01d62908-4506-456c-9779-03996e46c4eb tempest-VolumesSnapshotTestJSON-825888665 None] Acquiring lock "cinder-quobyte-58aa5b51-39ab-45ac-b690-03ef6e1dfda0" by "_delete_snapshot" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:16:58 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-01d62908-4506-456c-9779-03996e46c4eb tempest-VolumesSnapshotTestJSON-825888665 None] Lock "cinder-quobyte-58aa5b51-39ab-45ac-b690-03ef6e1dfda0" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:16:58 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-01d62908-4506-456c-9779-03996e46c4eb tempest-VolumesSnapshotTestJSON-825888665 None] Deleting offline snapshot 58aa5b51-39ab-45ac-b690-03ef6e1dfda0 of volume 7ec7d664-77c0-4f7d-b41b-5b716a5f5a47 {{(pid=83345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 10 13:16:58 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-01d62908-4506-456c-9779-03996e46c4eb tempest-VolumesSnapshotTestJSON-825888665 None] snapshot_file for this snap is: volume-7ec7d664-77c0-4f7d-b41b-5b716a5f5a47.58aa5b51-39ab-45ac-b690-03ef6e1dfda0 {{(pid=83345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 10 13:16:58 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[108a91ef-222a-43e4-a65a-9eade75641d4]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:16:58 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-01d62908-4506-456c-9779-03996e46c4eb tempest-VolumesSnapshotTestJSON-825888665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7ec7d664-77c0-4f7d-b41b-5b716a5f5a47.58aa5b51-39ab-45ac-b690-03ef6e1dfda0 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:58 devstack sudo[89173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7ec7d664-77c0-4f7d-b41b-5b716a5f5a47.58aa5b51-39ab-45ac-b690-03ef6e1dfda0
Apr 10 13:16:58 devstack sudo[89173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:58 devstack sudo[89173]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:58 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-01d62908-4506-456c-9779-03996e46c4eb tempest-VolumesSnapshotTestJSON-825888665 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7ec7d664-77c0-4f7d-b41b-5b716a5f5a47.58aa5b51-39ab-45ac-b690-03ef6e1dfda0" returned: 0 in 0.516s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:58 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-01d62908-4506-456c-9779-03996e46c4eb tempest-VolumesSnapshotTestJSON-825888665 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ec7d664-77c0-4f7d-b41b-5b716a5f5a47(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 13:16:58 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[7511e549-dcd5-47cf-bd4a-a0719e873fba]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:16:58 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-01d62908-4506-456c-9779-03996e46c4eb tempest-VolumesSnapshotTestJSON-825888665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7ec7d664-77c0-4f7d-b41b-5b716a5f5a47 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:58 devstack sudo[89178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7ec7d664-77c0-4f7d-b41b-5b716a5f5a47
Apr 10 13:16:58 devstack sudo[89178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:59 devstack sudo[89178]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:59 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-01d62908-4506-456c-9779-03996e46c4eb tempest-VolumesSnapshotTestJSON-825888665 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7ec7d664-77c0-4f7d-b41b-5b716a5f5a47" returned: 0 in 0.560s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:59 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-01d62908-4506-456c-9779-03996e46c4eb tempest-VolumesSnapshotTestJSON-825888665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7ec7d664-77c0-4f7d-b41b-5b716a5f5a47.58aa5b51-39ab-45ac-b690-03ef6e1dfda0 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:59 devstack sudo[89183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7ec7d664-77c0-4f7d-b41b-5b716a5f5a47.58aa5b51-39ab-45ac-b690-03ef6e1dfda0
Apr 10 13:16:59 devstack sudo[89183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:16:59 devstack sudo[89183]: pam_unix(sudo:session): session closed for user root
Apr 10 13:16:59 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-01d62908-4506-456c-9779-03996e46c4eb tempest-VolumesSnapshotTestJSON-825888665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7ec7d664-77c0-4f7d-b41b-5b716a5f5a47.58aa5b51-39ab-45ac-b690-03ef6e1dfda0" returned: 0 in 0.519s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:16:59 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-01d62908-4506-456c-9779-03996e46c4eb tempest-VolumesSnapshotTestJSON-825888665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7ec7d664-77c0-4f7d-b41b-5b716a5f5a47.58aa5b51-39ab-45ac-b690-03ef6e1dfda0 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:16:59 devstack sudo[89188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7ec7d664-77c0-4f7d-b41b-5b716a5f5a47.58aa5b51-39ab-45ac-b690-03ef6e1dfda0
Apr 10 13:16:59 devstack sudo[89188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:00 devstack sudo[89188]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:00 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-01d62908-4506-456c-9779-03996e46c4eb tempest-VolumesSnapshotTestJSON-825888665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7ec7d664-77c0-4f7d-b41b-5b716a5f5a47.58aa5b51-39ab-45ac-b690-03ef6e1dfda0" returned: 0 in 0.440s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:00 devstack cinder-volume[83345]: DEBUG dbcounter [-] [83345] Writing DB stats cinder:UPDATE=197,cinder:DELETE=14,cinder:INSERT=74,cinder:SELECT=174 {{(pid=83345) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 10 13:17:00 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-01d62908-4506-456c-9779-03996e46c4eb tempest-VolumesSnapshotTestJSON-825888665 None] Lock "cinder-quobyte-58aa5b51-39ab-45ac-b690-03ef6e1dfda0" released by "_delete_snapshot" :: held 2.108s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:17:00 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-01d62908-4506-456c-9779-03996e46c4eb tempest-VolumesSnapshotTestJSON-825888665 None] Lock "cinder-quobyte-7ec7d664-77c0-4f7d-b41b-5b716a5f5a47" released by "delete_snapshot" :: held 2.127s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:17:00 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-01d62908-4506-456c-9779-03996e46c4eb tempest-VolumesSnapshotTestJSON-825888665 None] Created reservations ['3f7a9711-7bca-45c8-8d6c-849503d333b2', '62f24d02-0f61-41b9-b3e1-847aecdf11a5', '5bd1e3c3-8d93-4a18-afd5-b3fbfcf2d7b2', '47c04b7d-229a-4a8f-9574-50ca04956206'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:17:00 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-01d62908-4506-456c-9779-03996e46c4eb tempest-VolumesSnapshotTestJSON-825888665 None] Delete snapshot completed successfully.
Apr 10 13:17:00 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-01d62908-4506-456c-9779-03996e46c4eb tempest-VolumesSnapshotTestJSON-825888665 None] Lock "cinder-58aa5b51-39ab-45ac-b690-03ef6e1dfda0-delete_snapshot" released by "delete_snapshot" :: held 2.201s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:17:00 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-b336351b-f72d-403e-99d9-f6af3355601a tempest-VolumeQuotasAdminTestJSON-2015979709 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:17:00 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-b336351b-f72d-403e-99d9-f6af3355601a tempest-VolumeQuotasAdminTestJSON-2015979709 None] Flow 'volume_create_manager' (5692f330-3e22-4250-90c6-20e9b24e7df3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:17:00 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-b336351b-f72d-403e-99d9-f6af3355601a tempest-VolumeQuotasAdminTestJSON-2015979709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a742116-bcfa-43b3-a52a-6acda0600391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:17:00 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-b336351b-f72d-403e-99d9-f6af3355601a tempest-VolumeQuotasAdminTestJSON-2015979709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a742116-bcfa-43b3-a52a-6acda0600391) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:17:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1668697985',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b40560c-678f-4a73-83fc-461a98ed4a9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2377a467198643ba9dc0f5a2f3818294',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:17:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:17:01Z,use_quota=True,user_id='e2e21410e52d4c89bc1e24559e83e98b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:17:00 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-b336351b-f72d-403e-99d9-f6af3355601a tempest-VolumeQuotasAdminTestJSON-2015979709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c17020b4-bd6d-49fe-8c72-835b88c31a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:17:00 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-b336351b-f72d-403e-99d9-f6af3355601a tempest-VolumeQuotasAdminTestJSON-2015979709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c17020b4-bd6d-49fe-8c72-835b88c31a23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:17:00 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-b336351b-f72d-403e-99d9-f6af3355601a tempest-VolumeQuotasAdminTestJSON-2015979709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46bb476e-a7db-4229-934e-5a0f0db067aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:17:00 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-b336351b-f72d-403e-99d9-f6af3355601a tempest-VolumeQuotasAdminTestJSON-2015979709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46bb476e-a7db-4229-934e-5a0f0db067aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b40560c-678f-4a73-83fc-461a98ed4a9d', 'volume_name': 'volume-8b40560c-678f-4a73-83fc-461a98ed4a9d', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:17:00 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-b336351b-f72d-403e-99d9-f6af3355601a tempest-VolumeQuotasAdminTestJSON-2015979709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (277df5f7-3212-4d66-ad38-3253a7027714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:17:00 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-b336351b-f72d-403e-99d9-f6af3355601a tempest-VolumeQuotasAdminTestJSON-2015979709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (277df5f7-3212-4d66-ad38-3253a7027714) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:17:00 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-b336351b-f72d-403e-99d9-f6af3355601a tempest-VolumeQuotasAdminTestJSON-2015979709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91d7bc00-dc10-4df2-8751-bc6e6396a9b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:17:00 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-b336351b-f72d-403e-99d9-f6af3355601a tempest-VolumeQuotasAdminTestJSON-2015979709 None] Volume 8b40560c-678f-4a73-83fc-461a98ed4a9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b40560c-678f-4a73-83fc-461a98ed4a9d', 'volume_size': 1}
Apr 10 13:17:00 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-b336351b-f72d-403e-99d9-f6af3355601a tempest-VolumeQuotasAdminTestJSON-2015979709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:17:00 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-b336351b-f72d-403e-99d9-f6af3355601a tempest-VolumeQuotasAdminTestJSON-2015979709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:17:00 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-b336351b-f72d-403e-99d9-f6af3355601a tempest-VolumeQuotasAdminTestJSON-2015979709 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f252bf08b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:17:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1668697985',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b40560c-678f-4a73-83fc-461a98ed4a9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2377a467198643ba9dc0f5a2f3818294',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:17:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:17:01Z,use_quota=True,user_id='e2e21410e52d4c89bc1e24559e83e98b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)}" {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 13:17:00 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-b336351b-f72d-403e-99d9-f6af3355601a tempest-VolumeQuotasAdminTestJSON-2015979709 None] Creating volume 8b40560c-678f-4a73-83fc-461a98ed4a9d {{(pid=83345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 13:17:00 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-b336351b-f72d-403e-99d9-f6af3355601a tempest-VolumeQuotasAdminTestJSON-2015979709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:17:00 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-b336351b-f72d-403e-99d9-f6af3355601a tempest-VolumeQuotasAdminTestJSON-2015979709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:17:00 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-b336351b-f72d-403e-99d9-f6af3355601a tempest-VolumeQuotasAdminTestJSON-2015979709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:17:00 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-b336351b-f72d-403e-99d9-f6af3355601a tempest-VolumeQuotasAdminTestJSON-2015979709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:17:00 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-b336351b-f72d-403e-99d9-f6af3355601a tempest-VolumeQuotasAdminTestJSON-2015979709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:17:00 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-b336351b-f72d-403e-99d9-f6af3355601a tempest-VolumeQuotasAdminTestJSON-2015979709 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:17:00 devstack cinder-volume[83345]: INFO cinder.volume.drivers.remotefs [None req-b336351b-f72d-403e-99d9-f6af3355601a tempest-VolumeQuotasAdminTestJSON-2015979709 None] casted to osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331
Apr 10 13:17:00 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-b336351b-f72d-403e-99d9-f6af3355601a tempest-VolumeQuotasAdminTestJSON-2015979709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-8b40560c-678f-4a73-83fc-461a98ed4a9d 1073741824 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:00 devstack sudo[89191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-8b40560c-678f-4a73-83fc-461a98ed4a9d 1073741824
Apr 10 13:17:00 devstack sudo[89191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:01 devstack sudo[89191]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:01 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-b336351b-f72d-403e-99d9-f6af3355601a tempest-VolumeQuotasAdminTestJSON-2015979709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-8b40560c-678f-4a73-83fc-461a98ed4a9d 1073741824" returned: 0 in 0.529s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:01 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-b336351b-f72d-403e-99d9-f6af3355601a tempest-VolumeQuotasAdminTestJSON-2015979709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-8b40560c-678f-4a73-83fc-461a98ed4a9d {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:01 devstack sudo[89199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-8b40560c-678f-4a73-83fc-461a98ed4a9d
Apr 10 13:17:01 devstack sudo[89199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:01 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-5852ca94-2a83-4c0f-8c40-9efb8b018add tempest-VolumesSnapshotTestJSON-825888665 None] Acquiring lock "cinder-7ec7d664-77c0-4f7d-b41b-5b716a5f5a47-delete_volume" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:17:01 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-5852ca94-2a83-4c0f-8c40-9efb8b018add tempest-VolumesSnapshotTestJSON-825888665 None] Lock "cinder-7ec7d664-77c0-4f7d-b41b-5b716a5f5a47-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:17:01 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-5852ca94-2a83-4c0f-8c40-9efb8b018add tempest-VolumesSnapshotTestJSON-825888665 None] Acquiring lock "cinder-quobyte-7ec7d664-77c0-4f7d-b41b-5b716a5f5a47" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:17:01 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-5852ca94-2a83-4c0f-8c40-9efb8b018add tempest-VolumesSnapshotTestJSON-825888665 None] Lock "cinder-quobyte-7ec7d664-77c0-4f7d-b41b-5b716a5f5a47" acquired by "delete_volume" :: waited 0.011s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:17:01 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2623219-4997-4bbb-a1cf-122171edc22d]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:17:01 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-5852ca94-2a83-4c0f-8c40-9efb8b018add tempest-VolumesSnapshotTestJSON-825888665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7ec7d664-77c0-4f7d-b41b-5b716a5f5a47 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:01 devstack sudo[89202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7ec7d664-77c0-4f7d-b41b-5b716a5f5a47
Apr 10 13:17:01 devstack sudo[89202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:01 devstack sudo[89199]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:01 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-b336351b-f72d-403e-99d9-f6af3355601a tempest-VolumeQuotasAdminTestJSON-2015979709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-8b40560c-678f-4a73-83fc-461a98ed4a9d" returned: 0 in 0.494s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:01 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-b336351b-f72d-403e-99d9-f6af3355601a tempest-VolumeQuotasAdminTestJSON-2015979709 None] <== create_volume: return (1058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'} {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 13:17:01 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-b336351b-f72d-403e-99d9-f6af3355601a tempest-VolumeQuotasAdminTestJSON-2015979709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.060s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:17:01 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-b336351b-f72d-403e-99d9-f6af3355601a tempest-VolumeQuotasAdminTestJSON-2015979709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91d7bc00-dc10-4df2-8751-bc6e6396a9b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b40560c-678f-4a73-83fc-461a98ed4a9d', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:17:01 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-b336351b-f72d-403e-99d9-f6af3355601a tempest-VolumeQuotasAdminTestJSON-2015979709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e3737eb-be11-4cd1-bf18-542a5aca6ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:17:01 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-b336351b-f72d-403e-99d9-f6af3355601a tempest-VolumeQuotasAdminTestJSON-2015979709 None] Volume volume-8b40560c-678f-4a73-83fc-461a98ed4a9d (8b40560c-678f-4a73-83fc-461a98ed4a9d): created successfully
Apr 10 13:17:01 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-b336351b-f72d-403e-99d9-f6af3355601a tempest-VolumeQuotasAdminTestJSON-2015979709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e3737eb-be11-4cd1-bf18-542a5aca6ae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:17:01 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-b336351b-f72d-403e-99d9-f6af3355601a tempest-VolumeQuotasAdminTestJSON-2015979709 None] Flow 'volume_create_manager' (5692f330-3e22-4250-90c6-20e9b24e7df3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:17:01 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-b336351b-f72d-403e-99d9-f6af3355601a tempest-VolumeQuotasAdminTestJSON-2015979709 None] Created volume successfully.
Apr 10 13:17:02 devstack sudo[89202]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:02 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-5852ca94-2a83-4c0f-8c40-9efb8b018add tempest-VolumesSnapshotTestJSON-825888665 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7ec7d664-77c0-4f7d-b41b-5b716a5f5a47" returned: 0 in 0.535s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:02 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-5852ca94-2a83-4c0f-8c40-9efb8b018add tempest-VolumesSnapshotTestJSON-825888665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7ec7d664-77c0-4f7d-b41b-5b716a5f5a47 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:02 devstack sudo[89208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7ec7d664-77c0-4f7d-b41b-5b716a5f5a47
Apr 10 13:17:02 devstack sudo[89208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:02 devstack sudo[89208]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:02 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-5852ca94-2a83-4c0f-8c40-9efb8b018add tempest-VolumesSnapshotTestJSON-825888665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7ec7d664-77c0-4f7d-b41b-5b716a5f5a47" returned: 0 in 0.436s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:02 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-5852ca94-2a83-4c0f-8c40-9efb8b018add tempest-VolumesSnapshotTestJSON-825888665 None] Lock "cinder-quobyte-7ec7d664-77c0-4f7d-b41b-5b716a5f5a47" released by "delete_volume" :: held 1.005s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:17:02 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-5852ca94-2a83-4c0f-8c40-9efb8b018add tempest-VolumesSnapshotTestJSON-825888665 None] Created reservations ['c7e819b6-fb6d-479d-b854-d2dcff0fa945', '333746c7-f043-4cba-8068-cc1182c7785f', 'c67b1fbf-d5b3-4087-9396-6bae4f933473', 'bf7162ef-3833-428a-922d-ccc963a53c9d'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:17:02 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-5852ca94-2a83-4c0f-8c40-9efb8b018add tempest-VolumesSnapshotTestJSON-825888665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:17:02 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-5852ca94-2a83-4c0f-8c40-9efb8b018add tempest-VolumesSnapshotTestJSON-825888665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:17:02 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-5852ca94-2a83-4c0f-8c40-9efb8b018add tempest-VolumesSnapshotTestJSON-825888665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:17:02 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-5852ca94-2a83-4c0f-8c40-9efb8b018add tempest-VolumesSnapshotTestJSON-825888665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:17:02 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-5852ca94-2a83-4c0f-8c40-9efb8b018add tempest-VolumesSnapshotTestJSON-825888665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:17:02 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-5852ca94-2a83-4c0f-8c40-9efb8b018add tempest-VolumesSnapshotTestJSON-825888665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:02 devstack sudo[89212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:17:02 devstack sudo[89212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:02 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-fe93fddc-9a26-45a8-928d-0e3ccb9d02fb tempest-VolumeQuotasAdminTestJSON-2015979709 None] Acquiring lock "cinder-8b40560c-678f-4a73-83fc-461a98ed4a9d-delete_volume" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:17:02 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-fe93fddc-9a26-45a8-928d-0e3ccb9d02fb tempest-VolumeQuotasAdminTestJSON-2015979709 None] Lock "cinder-8b40560c-678f-4a73-83fc-461a98ed4a9d-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:17:02 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-fe93fddc-9a26-45a8-928d-0e3ccb9d02fb tempest-VolumeQuotasAdminTestJSON-2015979709 None] Acquiring lock "cinder-quobyte-8b40560c-678f-4a73-83fc-461a98ed4a9d" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:17:02 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-fe93fddc-9a26-45a8-928d-0e3ccb9d02fb tempest-VolumeQuotasAdminTestJSON-2015979709 None] Lock "cinder-quobyte-8b40560c-678f-4a73-83fc-461a98ed4a9d" acquired by "delete_volume" :: waited 0.007s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:17:02 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[c589c3cd-9f5d-436c-9b65-ebc211ebbc54]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:17:02 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-fe93fddc-9a26-45a8-928d-0e3ccb9d02fb tempest-VolumeQuotasAdminTestJSON-2015979709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-8b40560c-678f-4a73-83fc-461a98ed4a9d {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:02 devstack sudo[89214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-8b40560c-678f-4a73-83fc-461a98ed4a9d
Apr 10 13:17:02 devstack sudo[89214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:03 devstack sudo[89212]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:03 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-5852ca94-2a83-4c0f-8c40-9efb8b018add tempest-VolumesSnapshotTestJSON-825888665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.465s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:03 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-5852ca94-2a83-4c0f-8c40-9efb8b018add tempest-VolumesSnapshotTestJSON-825888665 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:17:03 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-5852ca94-2a83-4c0f-8c40-9efb8b018add tempest-VolumesSnapshotTestJSON-825888665 None] Deleted volume successfully.
Apr 10 13:17:03 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-5852ca94-2a83-4c0f-8c40-9efb8b018add tempest-VolumesSnapshotTestJSON-825888665 None] Lock "cinder-7ec7d664-77c0-4f7d-b41b-5b716a5f5a47-delete_volume" released by "delete_volume" :: held 1.615s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:17:03 devstack sudo[89214]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:03 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-fe93fddc-9a26-45a8-928d-0e3ccb9d02fb tempest-VolumeQuotasAdminTestJSON-2015979709 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-8b40560c-678f-4a73-83fc-461a98ed4a9d" returned: 0 in 0.562s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:03 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-fe93fddc-9a26-45a8-928d-0e3ccb9d02fb tempest-VolumeQuotasAdminTestJSON-2015979709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-8b40560c-678f-4a73-83fc-461a98ed4a9d {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:03 devstack sudo[89220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-8b40560c-678f-4a73-83fc-461a98ed4a9d
Apr 10 13:17:03 devstack sudo[89220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:03 devstack sudo[89220]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:03 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-fe93fddc-9a26-45a8-928d-0e3ccb9d02fb tempest-VolumeQuotasAdminTestJSON-2015979709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-8b40560c-678f-4a73-83fc-461a98ed4a9d" returned: 0 in 0.458s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:03 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-fe93fddc-9a26-45a8-928d-0e3ccb9d02fb tempest-VolumeQuotasAdminTestJSON-2015979709 None] Lock "cinder-quobyte-8b40560c-678f-4a73-83fc-461a98ed4a9d" released by "delete_volume" :: held 1.064s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:17:03 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-fe93fddc-9a26-45a8-928d-0e3ccb9d02fb tempest-VolumeQuotasAdminTestJSON-2015979709 None] Created reservations ['049172e0-1501-4da9-9e41-6a3d6a99fe08', '94ea4bc1-5320-440b-ace6-f42fa667521c', '1105e395-a819-4658-b958-5bb692e49fa0', '24bba3eb-818e-462d-922b-163cc156336a'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:17:03 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-fe93fddc-9a26-45a8-928d-0e3ccb9d02fb tempest-VolumeQuotasAdminTestJSON-2015979709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:17:03 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-fe93fddc-9a26-45a8-928d-0e3ccb9d02fb tempest-VolumeQuotasAdminTestJSON-2015979709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:17:03 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-fe93fddc-9a26-45a8-928d-0e3ccb9d02fb tempest-VolumeQuotasAdminTestJSON-2015979709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:17:03 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-fe93fddc-9a26-45a8-928d-0e3ccb9d02fb tempest-VolumeQuotasAdminTestJSON-2015979709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:17:03 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-fe93fddc-9a26-45a8-928d-0e3ccb9d02fb tempest-VolumeQuotasAdminTestJSON-2015979709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:17:03 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-fe93fddc-9a26-45a8-928d-0e3ccb9d02fb tempest-VolumeQuotasAdminTestJSON-2015979709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:03 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed25a941-bb44-4c81-a6fd-1a2f9e9599cb tempest-VolumesSnapshotTestJSON-825888665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:17:03 devstack sudo[89223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:17:03 devstack sudo[89223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:03 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ed25a941-bb44-4c81-a6fd-1a2f9e9599cb tempest-VolumesSnapshotTestJSON-825888665 None] Flow 'volume_create_manager' (5179cd11-721f-45e2-bc7a-c5baa92041f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:17:03 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ed25a941-bb44-4c81-a6fd-1a2f9e9599cb tempest-VolumesSnapshotTestJSON-825888665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91b419fc-6d11-49d1-9b92-f88866d57c91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:17:04 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ed25a941-bb44-4c81-a6fd-1a2f9e9599cb tempest-VolumesSnapshotTestJSON-825888665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91b419fc-6d11-49d1-9b92-f88866d57c91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:17:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-387353925',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=227c8b49-d6ac-4def-82ee-5d650711c9a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a23589ebdac46368f1e33de5aeb8af1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:17:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:17:04Z,use_quota=True,user_id='5bb118cb04cc4be28306326a911fb71f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:17:04 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ed25a941-bb44-4c81-a6fd-1a2f9e9599cb tempest-VolumesSnapshotTestJSON-825888665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02b1f98f-15a6-4950-bad8-418fbe2cb9a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:17:04 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ed25a941-bb44-4c81-a6fd-1a2f9e9599cb tempest-VolumesSnapshotTestJSON-825888665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02b1f98f-15a6-4950-bad8-418fbe2cb9a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:17:04 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ed25a941-bb44-4c81-a6fd-1a2f9e9599cb tempest-VolumesSnapshotTestJSON-825888665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61e1938d-2d3c-4259-be47-286587fe514c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:17:04 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ed25a941-bb44-4c81-a6fd-1a2f9e9599cb tempest-VolumesSnapshotTestJSON-825888665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61e1938d-2d3c-4259-be47-286587fe514c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '227c8b49-d6ac-4def-82ee-5d650711c9a5', 'volume_name': 'volume-227c8b49-d6ac-4def-82ee-5d650711c9a5', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:17:04 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ed25a941-bb44-4c81-a6fd-1a2f9e9599cb tempest-VolumesSnapshotTestJSON-825888665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b6c49db-a46c-4b74-95a4-8103017d9b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:17:04 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ed25a941-bb44-4c81-a6fd-1a2f9e9599cb tempest-VolumesSnapshotTestJSON-825888665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b6c49db-a46c-4b74-95a4-8103017d9b89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:17:04 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ed25a941-bb44-4c81-a6fd-1a2f9e9599cb tempest-VolumesSnapshotTestJSON-825888665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b39dd154-5fd9-406a-bf3d-e21e0cb15c20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:17:04 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-ed25a941-bb44-4c81-a6fd-1a2f9e9599cb tempest-VolumesSnapshotTestJSON-825888665 None] Volume 227c8b49-d6ac-4def-82ee-5d650711c9a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-227c8b49-d6ac-4def-82ee-5d650711c9a5', 'volume_size': 1}
Apr 10 13:17:04 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-ed25a941-bb44-4c81-a6fd-1a2f9e9599cb tempest-VolumesSnapshotTestJSON-825888665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:17:04 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-ed25a941-bb44-4c81-a6fd-1a2f9e9599cb tempest-VolumesSnapshotTestJSON-825888665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:17:04 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-ed25a941-bb44-4c81-a6fd-1a2f9e9599cb tempest-VolumesSnapshotTestJSON-825888665 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f252bf08b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:17:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-387353925',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=227c8b49-d6ac-4def-82ee-5d650711c9a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a23589ebdac46368f1e33de5aeb8af1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:17:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:17:04Z,use_quota=True,user_id='5bb118cb04cc4be28306326a911fb71f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)}" {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 13:17:04 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-ed25a941-bb44-4c81-a6fd-1a2f9e9599cb tempest-VolumesSnapshotTestJSON-825888665 None] Creating volume 227c8b49-d6ac-4def-82ee-5d650711c9a5 {{(pid=83345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 13:17:04 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-ed25a941-bb44-4c81-a6fd-1a2f9e9599cb tempest-VolumesSnapshotTestJSON-825888665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:17:04 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-ed25a941-bb44-4c81-a6fd-1a2f9e9599cb tempest-VolumesSnapshotTestJSON-825888665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:17:04 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-ed25a941-bb44-4c81-a6fd-1a2f9e9599cb tempest-VolumesSnapshotTestJSON-825888665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:17:04 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-ed25a941-bb44-4c81-a6fd-1a2f9e9599cb tempest-VolumesSnapshotTestJSON-825888665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:17:04 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-ed25a941-bb44-4c81-a6fd-1a2f9e9599cb tempest-VolumesSnapshotTestJSON-825888665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:17:04 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-ed25a941-bb44-4c81-a6fd-1a2f9e9599cb tempest-VolumesSnapshotTestJSON-825888665 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:17:04 devstack cinder-volume[83345]: INFO cinder.volume.drivers.remotefs [None req-ed25a941-bb44-4c81-a6fd-1a2f9e9599cb tempest-VolumesSnapshotTestJSON-825888665 None] casted to osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331
Apr 10 13:17:04 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ed25a941-bb44-4c81-a6fd-1a2f9e9599cb tempest-VolumesSnapshotTestJSON-825888665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-227c8b49-d6ac-4def-82ee-5d650711c9a5 1073741824 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:04 devstack sudo[89225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-227c8b49-d6ac-4def-82ee-5d650711c9a5 1073741824
Apr 10 13:17:04 devstack sudo[89225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:04 devstack sudo[89223]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:04 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-fe93fddc-9a26-45a8-928d-0e3ccb9d02fb tempest-VolumeQuotasAdminTestJSON-2015979709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.457s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:04 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-fe93fddc-9a26-45a8-928d-0e3ccb9d02fb tempest-VolumeQuotasAdminTestJSON-2015979709 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:17:04 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-fe93fddc-9a26-45a8-928d-0e3ccb9d02fb tempest-VolumeQuotasAdminTestJSON-2015979709 None] Deleted volume successfully.
Apr 10 13:17:04 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-fe93fddc-9a26-45a8-928d-0e3ccb9d02fb tempest-VolumeQuotasAdminTestJSON-2015979709 None] Lock "cinder-8b40560c-678f-4a73-83fc-461a98ed4a9d-delete_volume" released by "delete_volume" :: held 1.683s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:17:04 devstack sudo[89225]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:04 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ed25a941-bb44-4c81-a6fd-1a2f9e9599cb tempest-VolumesSnapshotTestJSON-825888665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-227c8b49-d6ac-4def-82ee-5d650711c9a5 1073741824" returned: 0 in 0.522s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:04 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ed25a941-bb44-4c81-a6fd-1a2f9e9599cb tempest-VolumesSnapshotTestJSON-825888665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-227c8b49-d6ac-4def-82ee-5d650711c9a5 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:04 devstack sudo[89231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-227c8b49-d6ac-4def-82ee-5d650711c9a5
Apr 10 13:17:04 devstack sudo[89231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:04 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-9a581d6d-de78-497c-9c1e-ebb37160de27 tempest-VolumesNegativeTest-1186901150 None] Acquiring lock "cinder-c98ef5b2-c9eb-4799-825b-d1f844c1390b-delete_volume" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:17:04 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-9a581d6d-de78-497c-9c1e-ebb37160de27 tempest-VolumesNegativeTest-1186901150 None] Lock "cinder-c98ef5b2-c9eb-4799-825b-d1f844c1390b-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:17:04 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-9a581d6d-de78-497c-9c1e-ebb37160de27 tempest-VolumesNegativeTest-1186901150 None] Acquiring lock "cinder-quobyte-c98ef5b2-c9eb-4799-825b-d1f844c1390b" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:17:04 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-9a581d6d-de78-497c-9c1e-ebb37160de27 tempest-VolumesNegativeTest-1186901150 None] Lock "cinder-quobyte-c98ef5b2-c9eb-4799-825b-d1f844c1390b" acquired by "delete_volume" :: waited 0.009s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:17:04 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[5052d4d3-cff3-4bdc-8ba8-47b45b231678]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:17:04 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-9a581d6d-de78-497c-9c1e-ebb37160de27 tempest-VolumesNegativeTest-1186901150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-c98ef5b2-c9eb-4799-825b-d1f844c1390b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:04 devstack sudo[89233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-c98ef5b2-c9eb-4799-825b-d1f844c1390b
Apr 10 13:17:04 devstack sudo[89233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:05 devstack sudo[89231]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:05 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ed25a941-bb44-4c81-a6fd-1a2f9e9599cb tempest-VolumesSnapshotTestJSON-825888665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-227c8b49-d6ac-4def-82ee-5d650711c9a5" returned: 0 in 0.456s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:05 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-ed25a941-bb44-4c81-a6fd-1a2f9e9599cb tempest-VolumesSnapshotTestJSON-825888665 None] <== create_volume: return (1004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'} {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 13:17:05 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-ed25a941-bb44-4c81-a6fd-1a2f9e9599cb tempest-VolumesSnapshotTestJSON-825888665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.007s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:17:05 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ed25a941-bb44-4c81-a6fd-1a2f9e9599cb tempest-VolumesSnapshotTestJSON-825888665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b39dd154-5fd9-406a-bf3d-e21e0cb15c20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-227c8b49-d6ac-4def-82ee-5d650711c9a5', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:17:05 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ed25a941-bb44-4c81-a6fd-1a2f9e9599cb tempest-VolumesSnapshotTestJSON-825888665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad8c388d-0d23-4d8d-96dd-89d8a5bd67db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:17:05 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-ed25a941-bb44-4c81-a6fd-1a2f9e9599cb tempest-VolumesSnapshotTestJSON-825888665 None] Volume volume-227c8b49-d6ac-4def-82ee-5d650711c9a5 (227c8b49-d6ac-4def-82ee-5d650711c9a5): created successfully
Apr 10 13:17:05 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ed25a941-bb44-4c81-a6fd-1a2f9e9599cb tempest-VolumesSnapshotTestJSON-825888665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad8c388d-0d23-4d8d-96dd-89d8a5bd67db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:17:05 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ed25a941-bb44-4c81-a6fd-1a2f9e9599cb tempest-VolumesSnapshotTestJSON-825888665 None] Flow 'volume_create_manager' (5179cd11-721f-45e2-bc7a-c5baa92041f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:17:05 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-ed25a941-bb44-4c81-a6fd-1a2f9e9599cb tempest-VolumesSnapshotTestJSON-825888665 None] Created volume successfully.
Apr 10 13:17:05 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-46ea3118-d0dd-40ad-bbfd-fe6510baa597 tempest-VolumeQuotasAdminTestJSON-2015979709 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:17:05 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-46ea3118-d0dd-40ad-bbfd-fe6510baa597 tempest-VolumeQuotasAdminTestJSON-2015979709 None] Flow 'volume_create_manager' (b96828dd-bb26-4340-8ec2-9c6d3900416a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:17:05 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-46ea3118-d0dd-40ad-bbfd-fe6510baa597 tempest-VolumeQuotasAdminTestJSON-2015979709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (847ef50c-1639-4347-b1b4-e823626ed555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:17:05 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-46ea3118-d0dd-40ad-bbfd-fe6510baa597 tempest-VolumeQuotasAdminTestJSON-2015979709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (847ef50c-1639-4347-b1b4-e823626ed555) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:17:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-379876358',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70d5fbfa-cdce-44a5-8fd4-f28dc8e5f558,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2377a467198643ba9dc0f5a2f3818294',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:17:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:17:05Z,use_quota=True,user_id='e2e21410e52d4c89bc1e24559e83e98b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:17:05 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-46ea3118-d0dd-40ad-bbfd-fe6510baa597 tempest-VolumeQuotasAdminTestJSON-2015979709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (384d3047-8c3e-4178-8ef6-548238ef6fee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:17:05 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-46ea3118-d0dd-40ad-bbfd-fe6510baa597 tempest-VolumeQuotasAdminTestJSON-2015979709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (384d3047-8c3e-4178-8ef6-548238ef6fee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:17:05 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-46ea3118-d0dd-40ad-bbfd-fe6510baa597 tempest-VolumeQuotasAdminTestJSON-2015979709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acfebaa2-0ad4-4c16-94cc-b47b48c8b856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:17:05 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-46ea3118-d0dd-40ad-bbfd-fe6510baa597 tempest-VolumeQuotasAdminTestJSON-2015979709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acfebaa2-0ad4-4c16-94cc-b47b48c8b856) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70d5fbfa-cdce-44a5-8fd4-f28dc8e5f558', 'volume_name': 'volume-70d5fbfa-cdce-44a5-8fd4-f28dc8e5f558', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:17:05 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-46ea3118-d0dd-40ad-bbfd-fe6510baa597 tempest-VolumeQuotasAdminTestJSON-2015979709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d34a5a8-f7bb-4ba0-8c56-e9220f3894cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:17:05 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-46ea3118-d0dd-40ad-bbfd-fe6510baa597 tempest-VolumeQuotasAdminTestJSON-2015979709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d34a5a8-f7bb-4ba0-8c56-e9220f3894cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:17:05 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-46ea3118-d0dd-40ad-bbfd-fe6510baa597 tempest-VolumeQuotasAdminTestJSON-2015979709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68289569-9f8b-4f9e-9061-bbb66e22863e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:17:05 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-46ea3118-d0dd-40ad-bbfd-fe6510baa597 tempest-VolumeQuotasAdminTestJSON-2015979709 None] Volume 70d5fbfa-cdce-44a5-8fd4-f28dc8e5f558: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70d5fbfa-cdce-44a5-8fd4-f28dc8e5f558', 'volume_size': 1}
Apr 10 13:17:05 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-46ea3118-d0dd-40ad-bbfd-fe6510baa597 tempest-VolumeQuotasAdminTestJSON-2015979709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:17:05 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-46ea3118-d0dd-40ad-bbfd-fe6510baa597 tempest-VolumeQuotasAdminTestJSON-2015979709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:17:05 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-46ea3118-d0dd-40ad-bbfd-fe6510baa597 tempest-VolumeQuotasAdminTestJSON-2015979709 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f252bf08b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:17:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-379876358',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70d5fbfa-cdce-44a5-8fd4-f28dc8e5f558,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2377a467198643ba9dc0f5a2f3818294',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:17:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:17:05Z,use_quota=True,user_id='e2e21410e52d4c89bc1e24559e83e98b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)}" {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 13:17:05 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-46ea3118-d0dd-40ad-bbfd-fe6510baa597 tempest-VolumeQuotasAdminTestJSON-2015979709 None] Creating volume 70d5fbfa-cdce-44a5-8fd4-f28dc8e5f558 {{(pid=83345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 13:17:05 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-46ea3118-d0dd-40ad-bbfd-fe6510baa597 tempest-VolumeQuotasAdminTestJSON-2015979709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:17:05 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-46ea3118-d0dd-40ad-bbfd-fe6510baa597 tempest-VolumeQuotasAdminTestJSON-2015979709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:17:05 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-46ea3118-d0dd-40ad-bbfd-fe6510baa597 tempest-VolumeQuotasAdminTestJSON-2015979709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:17:05 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-46ea3118-d0dd-40ad-bbfd-fe6510baa597 tempest-VolumeQuotasAdminTestJSON-2015979709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:17:05 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-46ea3118-d0dd-40ad-bbfd-fe6510baa597 tempest-VolumeQuotasAdminTestJSON-2015979709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:17:05 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-46ea3118-d0dd-40ad-bbfd-fe6510baa597 tempest-VolumeQuotasAdminTestJSON-2015979709 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:17:05 devstack cinder-volume[83345]: INFO cinder.volume.drivers.remotefs [None req-46ea3118-d0dd-40ad-bbfd-fe6510baa597 tempest-VolumeQuotasAdminTestJSON-2015979709 None] casted to osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331
Apr 10 13:17:05 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-46ea3118-d0dd-40ad-bbfd-fe6510baa597 tempest-VolumeQuotasAdminTestJSON-2015979709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-70d5fbfa-cdce-44a5-8fd4-f28dc8e5f558 1073741824 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:05 devstack sudo[89236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-70d5fbfa-cdce-44a5-8fd4-f28dc8e5f558 1073741824
Apr 10 13:17:05 devstack sudo[89236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:05 devstack sudo[89233]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:05 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-9a581d6d-de78-497c-9c1e-ebb37160de27 tempest-VolumesNegativeTest-1186901150 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-c98ef5b2-c9eb-4799-825b-d1f844c1390b" returned: 0 in 0.521s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:05 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-9a581d6d-de78-497c-9c1e-ebb37160de27 tempest-VolumesNegativeTest-1186901150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-c98ef5b2-c9eb-4799-825b-d1f844c1390b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:05 devstack sudo[89241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-c98ef5b2-c9eb-4799-825b-d1f844c1390b
Apr 10 13:17:05 devstack sudo[89241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:05 devstack sudo[89236]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:05 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-46ea3118-d0dd-40ad-bbfd-fe6510baa597 tempest-VolumeQuotasAdminTestJSON-2015979709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-70d5fbfa-cdce-44a5-8fd4-f28dc8e5f558 1073741824" returned: 0 in 0.469s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:05 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-46ea3118-d0dd-40ad-bbfd-fe6510baa597 tempest-VolumeQuotasAdminTestJSON-2015979709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-70d5fbfa-cdce-44a5-8fd4-f28dc8e5f558 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:05 devstack sudo[89247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-70d5fbfa-cdce-44a5-8fd4-f28dc8e5f558
Apr 10 13:17:05 devstack sudo[89247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:05 devstack sudo[89241]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:05 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-9a581d6d-de78-497c-9c1e-ebb37160de27 tempest-VolumesNegativeTest-1186901150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-c98ef5b2-c9eb-4799-825b-d1f844c1390b" returned: 0 in 0.421s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:05 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-9a581d6d-de78-497c-9c1e-ebb37160de27 tempest-VolumesNegativeTest-1186901150 None] Lock "cinder-quobyte-c98ef5b2-c9eb-4799-825b-d1f844c1390b" released by "delete_volume" :: held 0.975s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:17:05 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-9a581d6d-de78-497c-9c1e-ebb37160de27 tempest-VolumesNegativeTest-1186901150 None] Created reservations ['7bbf8c4a-e55a-4dc3-b022-80ef69a36640', '9081e169-e120-4b9a-9cda-8387f64fb230', 'a541264d-dcd2-4eda-8d1b-8d2845f0e236', 'e6ce834c-6d07-4f81-bd5b-666b30379297'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:17:05 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-9a581d6d-de78-497c-9c1e-ebb37160de27 tempest-VolumesNegativeTest-1186901150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:17:05 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-9a581d6d-de78-497c-9c1e-ebb37160de27 tempest-VolumesNegativeTest-1186901150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:17:05 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-9a581d6d-de78-497c-9c1e-ebb37160de27 tempest-VolumesNegativeTest-1186901150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:17:05 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-9a581d6d-de78-497c-9c1e-ebb37160de27 tempest-VolumesNegativeTest-1186901150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:17:05 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-9a581d6d-de78-497c-9c1e-ebb37160de27 tempest-VolumesNegativeTest-1186901150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:17:05 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-9a581d6d-de78-497c-9c1e-ebb37160de27 tempest-VolumesNegativeTest-1186901150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:05 devstack sudo[89249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:17:05 devstack sudo[89249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:06 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-111486b5-1923-4b11-a56a-b1b8d081feae tempest-VolumesSnapshotTestJSON-825888665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:17:06 devstack sudo[89247]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:06 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-46ea3118-d0dd-40ad-bbfd-fe6510baa597 tempest-VolumeQuotasAdminTestJSON-2015979709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-70d5fbfa-cdce-44a5-8fd4-f28dc8e5f558" returned: 0 in 0.542s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:06 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-46ea3118-d0dd-40ad-bbfd-fe6510baa597 tempest-VolumeQuotasAdminTestJSON-2015979709 None] <== create_volume: return (1041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'} {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 13:17:06 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-46ea3118-d0dd-40ad-bbfd-fe6510baa597 tempest-VolumeQuotasAdminTestJSON-2015979709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.043s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:17:06 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-111486b5-1923-4b11-a56a-b1b8d081feae tempest-VolumesSnapshotTestJSON-825888665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.141s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:17:06 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-46ea3118-d0dd-40ad-bbfd-fe6510baa597 tempest-VolumeQuotasAdminTestJSON-2015979709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68289569-9f8b-4f9e-9061-bbb66e22863e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70d5fbfa-cdce-44a5-8fd4-f28dc8e5f558', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:17:06 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-46ea3118-d0dd-40ad-bbfd-fe6510baa597 tempest-VolumeQuotasAdminTestJSON-2015979709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b6dab3f-93e0-4ccb-b0bc-1eceee6047fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:17:06 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-111486b5-1923-4b11-a56a-b1b8d081feae tempest-VolumesSnapshotTestJSON-825888665 None] Creating offline snapshot be0f8955-bd5b-4f35-8d5b-6634f242afeb of volume 227c8b49-d6ac-4def-82ee-5d650711c9a5 {{(pid=83345) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 10 13:17:06 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-46ea3118-d0dd-40ad-bbfd-fe6510baa597 tempest-VolumeQuotasAdminTestJSON-2015979709 None] Volume volume-70d5fbfa-cdce-44a5-8fd4-f28dc8e5f558 (70d5fbfa-cdce-44a5-8fd4-f28dc8e5f558): created successfully
Apr 10 13:17:06 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-46ea3118-d0dd-40ad-bbfd-fe6510baa597 tempest-VolumeQuotasAdminTestJSON-2015979709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b6dab3f-93e0-4ccb-b0bc-1eceee6047fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:17:06 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-46ea3118-d0dd-40ad-bbfd-fe6510baa597 tempest-VolumeQuotasAdminTestJSON-2015979709 None] Flow 'volume_create_manager' (b96828dd-bb26-4340-8ec2-9c6d3900416a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:17:06 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[84d70521-d492-456f-9f54-9aa6ee88f4d9]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:17:06 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-111486b5-1923-4b11-a56a-b1b8d081feae tempest-VolumesSnapshotTestJSON-825888665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-227c8b49-d6ac-4def-82ee-5d650711c9a5 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:06 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-46ea3118-d0dd-40ad-bbfd-fe6510baa597 tempest-VolumeQuotasAdminTestJSON-2015979709 None] Created volume successfully.
Apr 10 13:17:06 devstack sudo[89253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-227c8b49-d6ac-4def-82ee-5d650711c9a5
Apr 10 13:17:06 devstack sudo[89253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:06 devstack sudo[89249]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:06 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-9a581d6d-de78-497c-9c1e-ebb37160de27 tempest-VolumesNegativeTest-1186901150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.548s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:06 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-9a581d6d-de78-497c-9c1e-ebb37160de27 tempest-VolumesNegativeTest-1186901150 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:17:06 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-9a581d6d-de78-497c-9c1e-ebb37160de27 tempest-VolumesNegativeTest-1186901150 None] Deleted volume successfully.
Apr 10 13:17:06 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-9a581d6d-de78-497c-9c1e-ebb37160de27 tempest-VolumesNegativeTest-1186901150 None] Lock "cinder-c98ef5b2-c9eb-4799-825b-d1f844c1390b-delete_volume" released by "delete_volume" :: held 1.655s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:17:06 devstack sudo[89253]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:06 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-111486b5-1923-4b11-a56a-b1b8d081feae tempest-VolumesSnapshotTestJSON-825888665 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-227c8b49-d6ac-4def-82ee-5d650711c9a5" returned: 0 in 0.534s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:06 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-111486b5-1923-4b11-a56a-b1b8d081feae tempest-VolumesSnapshotTestJSON-825888665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-227c8b49-d6ac-4def-82ee-5d650711c9a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-227c8b49-d6ac-4def-82ee-5d650711c9a5.be0f8955-bd5b-4f35-8d5b-6634f242afeb 1G {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:06 devstack sudo[89259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-227c8b49-d6ac-4def-82ee-5d650711c9a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-227c8b49-d6ac-4def-82ee-5d650711c9a5.be0f8955-bd5b-4f35-8d5b-6634f242afeb 1G
Apr 10 13:17:06 devstack sudo[89259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:07 devstack sudo[89259]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:07 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-111486b5-1923-4b11-a56a-b1b8d081feae tempest-VolumesSnapshotTestJSON-825888665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-227c8b49-d6ac-4def-82ee-5d650711c9a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-227c8b49-d6ac-4def-82ee-5d650711c9a5.be0f8955-bd5b-4f35-8d5b-6634f242afeb 1G" returned: 0 in 0.506s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:07 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-111486b5-1923-4b11-a56a-b1b8d081feae tempest-VolumesSnapshotTestJSON-825888665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-227c8b49-d6ac-4def-82ee-5d650711c9a5 -F qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-227c8b49-d6ac-4def-82ee-5d650711c9a5.be0f8955-bd5b-4f35-8d5b-6634f242afeb {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:07 devstack sudo[89264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-227c8b49-d6ac-4def-82ee-5d650711c9a5 -F qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-227c8b49-d6ac-4def-82ee-5d650711c9a5.be0f8955-bd5b-4f35-8d5b-6634f242afeb
Apr 10 13:17:07 devstack sudo[89264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:07 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-6ed01366-442b-44b0-b485-d848b1ff8f49 tempest-VolumeQuotasAdminTestJSON-78377086 None] Transfer volume completed successfully.
Apr 10 13:17:07 devstack sudo[89264]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:07 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-111486b5-1923-4b11-a56a-b1b8d081feae tempest-VolumesSnapshotTestJSON-825888665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-227c8b49-d6ac-4def-82ee-5d650711c9a5 -F qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-227c8b49-d6ac-4def-82ee-5d650711c9a5.be0f8955-bd5b-4f35-8d5b-6634f242afeb" returned: 0 in 0.445s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:07 devstack cinder-volume[83345]: WARNING cinder.volume.drivers.remotefs [None req-111486b5-1923-4b11-a56a-b1b8d081feae tempest-VolumesSnapshotTestJSON-825888665 None] /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-227c8b49-d6ac-4def-82ee-5d650711c9a5.be0f8955-bd5b-4f35-8d5b-6634f242afeb is being set with open permissions: ugo+rw
Apr 10 13:17:07 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-111486b5-1923-4b11-a56a-b1b8d081feae tempest-VolumesSnapshotTestJSON-825888665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-227c8b49-d6ac-4def-82ee-5d650711c9a5.be0f8955-bd5b-4f35-8d5b-6634f242afeb {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:07 devstack sudo[89269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-227c8b49-d6ac-4def-82ee-5d650711c9a5.be0f8955-bd5b-4f35-8d5b-6634f242afeb
Apr 10 13:17:07 devstack sudo[89269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:08 devstack sudo[89269]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:08 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-111486b5-1923-4b11-a56a-b1b8d081feae tempest-VolumesSnapshotTestJSON-825888665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-227c8b49-d6ac-4def-82ee-5d650711c9a5.be0f8955-bd5b-4f35-8d5b-6634f242afeb" returned: 0 in 0.417s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:08 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-111486b5-1923-4b11-a56a-b1b8d081feae tempest-VolumesSnapshotTestJSON-825888665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-227c8b49-d6ac-4def-82ee-5d650711c9a5.info {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:08 devstack sudo[89272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-227c8b49-d6ac-4def-82ee-5d650711c9a5.info
Apr 10 13:17:08 devstack sudo[89272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:08 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-9e27fbe5-d378-4fb9-bc6b-72ed3d5bdd7d tempest-VolumeQuotasAdminTestJSON-276788240 None] Acquiring lock "cinder-70d5fbfa-cdce-44a5-8fd4-f28dc8e5f558-delete_volume" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:17:08 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-9e27fbe5-d378-4fb9-bc6b-72ed3d5bdd7d tempest-VolumeQuotasAdminTestJSON-276788240 None] Lock "cinder-70d5fbfa-cdce-44a5-8fd4-f28dc8e5f558-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:17:08 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-9e27fbe5-d378-4fb9-bc6b-72ed3d5bdd7d tempest-VolumeQuotasAdminTestJSON-276788240 None] Acquiring lock "cinder-quobyte-70d5fbfa-cdce-44a5-8fd4-f28dc8e5f558" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:17:08 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-9e27fbe5-d378-4fb9-bc6b-72ed3d5bdd7d tempest-VolumeQuotasAdminTestJSON-276788240 None] Lock "cinder-quobyte-70d5fbfa-cdce-44a5-8fd4-f28dc8e5f558" acquired by "delete_volume" :: waited 0.009s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:17:08 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[99299d5e-e131-4c4f-a4d6-e118fcb692e4]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:17:08 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-9e27fbe5-d378-4fb9-bc6b-72ed3d5bdd7d tempest-VolumeQuotasAdminTestJSON-276788240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-70d5fbfa-cdce-44a5-8fd4-f28dc8e5f558 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:08 devstack sudo[89274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-70d5fbfa-cdce-44a5-8fd4-f28dc8e5f558
Apr 10 13:17:08 devstack sudo[89274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:08 devstack sudo[89272]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:08 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-111486b5-1923-4b11-a56a-b1b8d081feae tempest-VolumesSnapshotTestJSON-825888665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-227c8b49-d6ac-4def-82ee-5d650711c9a5.info" returned: 0 in 0.458s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:08 devstack cinder-volume[83345]: WARNING cinder.volume.drivers.remotefs [None req-111486b5-1923-4b11-a56a-b1b8d081feae tempest-VolumesSnapshotTestJSON-825888665 None] /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-227c8b49-d6ac-4def-82ee-5d650711c9a5.info is being set with open permissions: ugo+rw
Apr 10 13:17:08 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-111486b5-1923-4b11-a56a-b1b8d081feae tempest-VolumesSnapshotTestJSON-825888665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-227c8b49-d6ac-4def-82ee-5d650711c9a5.info {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:08 devstack sudo[89277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-227c8b49-d6ac-4def-82ee-5d650711c9a5.info
Apr 10 13:17:08 devstack sudo[89277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:09 devstack sudo[89274]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:09 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-9e27fbe5-d378-4fb9-bc6b-72ed3d5bdd7d tempest-VolumeQuotasAdminTestJSON-276788240 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-70d5fbfa-cdce-44a5-8fd4-f28dc8e5f558" returned: 0 in 0.459s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:09 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-9e27fbe5-d378-4fb9-bc6b-72ed3d5bdd7d tempest-VolumeQuotasAdminTestJSON-276788240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-70d5fbfa-cdce-44a5-8fd4-f28dc8e5f558 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:09 devstack sudo[89283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-70d5fbfa-cdce-44a5-8fd4-f28dc8e5f558
Apr 10 13:17:09 devstack sudo[89283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:09 devstack sudo[89277]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:09 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-111486b5-1923-4b11-a56a-b1b8d081feae tempest-VolumesSnapshotTestJSON-825888665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-227c8b49-d6ac-4def-82ee-5d650711c9a5.info" returned: 0 in 0.407s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:09 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-111486b5-1923-4b11-a56a-b1b8d081feae tempest-VolumesSnapshotTestJSON-825888665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.842s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:17:09 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-111486b5-1923-4b11-a56a-b1b8d081feae tempest-VolumesSnapshotTestJSON-825888665 None] Create snapshot completed successfully
Apr 10 13:17:09 devstack sudo[89283]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:09 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-9e27fbe5-d378-4fb9-bc6b-72ed3d5bdd7d tempest-VolumeQuotasAdminTestJSON-276788240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-70d5fbfa-cdce-44a5-8fd4-f28dc8e5f558" returned: 0 in 0.439s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:09 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-9e27fbe5-d378-4fb9-bc6b-72ed3d5bdd7d tempest-VolumeQuotasAdminTestJSON-276788240 None] Lock "cinder-quobyte-70d5fbfa-cdce-44a5-8fd4-f28dc8e5f558" released by "delete_volume" :: held 0.926s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:17:09 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-5416bbef-a73d-4051-9bf2-ea76052230f7 tempest-VolumesSnapshotTestJSON-825888665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:17:09 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-5416bbef-a73d-4051-9bf2-ea76052230f7 tempest-VolumesSnapshotTestJSON-825888665 None] Flow 'volume_create_manager' (ba7d1af4-2201-4129-a979-ef83b4e2c2cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:17:09 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-5416bbef-a73d-4051-9bf2-ea76052230f7 tempest-VolumesSnapshotTestJSON-825888665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3e411a4-56be-489d-86ba-2559c0b6d851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:17:09 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-5416bbef-a73d-4051-9bf2-ea76052230f7 tempest-VolumesSnapshotTestJSON-825888665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3e411a4-56be-489d-86ba-2559c0b6d851) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:17:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1725985991',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=923d419f-b7bb-48b1-bec7-a75f6818683b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a23589ebdac46368f1e33de5aeb8af1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:17:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=be0f8955-bd5b-4f35-8d5b-6634f242afeb,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:17:10Z,use_quota=True,user_id='5bb118cb04cc4be28306326a911fb71f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:17:09 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-5416bbef-a73d-4051-9bf2-ea76052230f7 tempest-VolumesSnapshotTestJSON-825888665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97732eb1-03a1-49dc-b156-b09407c9e605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:17:09 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-5416bbef-a73d-4051-9bf2-ea76052230f7 tempest-VolumesSnapshotTestJSON-825888665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97732eb1-03a1-49dc-b156-b09407c9e605) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:17:09 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-5416bbef-a73d-4051-9bf2-ea76052230f7 tempest-VolumesSnapshotTestJSON-825888665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca53b80f-31f5-495a-b7f2-14a36eb6bb2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:17:09 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-5416bbef-a73d-4051-9bf2-ea76052230f7 tempest-VolumesSnapshotTestJSON-825888665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca53b80f-31f5-495a-b7f2-14a36eb6bb2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '923d419f-b7bb-48b1-bec7-a75f6818683b', 'volume_name': 'volume-923d419f-b7bb-48b1-bec7-a75f6818683b', 'volume_size': 1, 'snapshot_id': 'be0f8955-bd5b-4f35-8d5b-6634f242afeb'}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:17:09 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-5416bbef-a73d-4051-9bf2-ea76052230f7 tempest-VolumesSnapshotTestJSON-825888665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fde9991b-b09e-48dd-aec9-b0b1102f021f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:17:09 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-5416bbef-a73d-4051-9bf2-ea76052230f7 tempest-VolumesSnapshotTestJSON-825888665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fde9991b-b09e-48dd-aec9-b0b1102f021f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:17:09 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-5416bbef-a73d-4051-9bf2-ea76052230f7 tempest-VolumesSnapshotTestJSON-825888665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d89613ca-423f-4844-b135-7ecc8330553e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:17:09 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-5416bbef-a73d-4051-9bf2-ea76052230f7 tempest-VolumesSnapshotTestJSON-825888665 None] Volume 923d419f-b7bb-48b1-bec7-a75f6818683b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-923d419f-b7bb-48b1-bec7-a75f6818683b', 'volume_size': 1, 'snapshot_id': 'be0f8955-bd5b-4f35-8d5b-6634f242afeb'}
Apr 10 13:17:09 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-5416bbef-a73d-4051-9bf2-ea76052230f7 tempest-VolumesSnapshotTestJSON-825888665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:17:09 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-5416bbef-a73d-4051-9bf2-ea76052230f7 tempest-VolumesSnapshotTestJSON-825888665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:17:09 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-5416bbef-a73d-4051-9bf2-ea76052230f7 tempest-VolumesSnapshotTestJSON-825888665 None] Acquiring lock "cinder-quobyte-be0f8955-bd5b-4f35-8d5b-6634f242afeb-923d419f-b7bb-48b1-bec7-a75f6818683b" by "_create_volume_from_snapshot" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:17:09 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-5416bbef-a73d-4051-9bf2-ea76052230f7 tempest-VolumesSnapshotTestJSON-825888665 None] Lock "cinder-quobyte-be0f8955-bd5b-4f35-8d5b-6634f242afeb-923d419f-b7bb-48b1-bec7-a75f6818683b" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:17:09 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-5416bbef-a73d-4051-9bf2-ea76052230f7 tempest-VolumesSnapshotTestJSON-825888665 None] Creating volume 923d419f-b7bb-48b1-bec7-a75f6818683b from snapshot be0f8955-bd5b-4f35-8d5b-6634f242afeb {{(pid=83345) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 10 13:17:09 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-5416bbef-a73d-4051-9bf2-ea76052230f7 tempest-VolumesSnapshotTestJSON-825888665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:17:09 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-5416bbef-a73d-4051-9bf2-ea76052230f7 tempest-VolumesSnapshotTestJSON-825888665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:17:09 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-5416bbef-a73d-4051-9bf2-ea76052230f7 tempest-VolumesSnapshotTestJSON-825888665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:17:09 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-5416bbef-a73d-4051-9bf2-ea76052230f7 tempest-VolumesSnapshotTestJSON-825888665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:17:09 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-5416bbef-a73d-4051-9bf2-ea76052230f7 tempest-VolumesSnapshotTestJSON-825888665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:17:09 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-5416bbef-a73d-4051-9bf2-ea76052230f7 tempest-VolumesSnapshotTestJSON-825888665 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:17:09 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-5416bbef-a73d-4051-9bf2-ea76052230f7 tempest-VolumesSnapshotTestJSON-825888665 None] Acquiring lock "cinder-quobyte-923d419f-b7bb-48b1-bec7-a75f6818683b" by "_copy_volume_from_snapshot" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:17:09 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-5416bbef-a73d-4051-9bf2-ea76052230f7 tempest-VolumesSnapshotTestJSON-825888665 None] Lock "cinder-quobyte-923d419f-b7bb-48b1-bec7-a75f6818683b" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:17:09 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-5416bbef-a73d-4051-9bf2-ea76052230f7 tempest-VolumesSnapshotTestJSON-825888665 None] snapshot: be0f8955-bd5b-4f35-8d5b-6634f242afeb, volume: 923d419f-b7bb-48b1-bec7-a75f6818683b,  {{(pid=83345) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 10 13:17:09 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-9e27fbe5-d378-4fb9-bc6b-72ed3d5bdd7d tempest-VolumeQuotasAdminTestJSON-276788240 None] Created reservations ['08a596e4-1594-4cd0-8aaa-11aa591c3105', '60093998-0371-411b-8e36-c131af421ad5', '50630176-dde3-402a-a5d5-c863f8fae5a9', '7ffed595-e09d-43cd-a75c-04bd90b7d1c2'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:17:09 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-5416bbef-a73d-4051-9bf2-ea76052230f7 tempest-VolumesSnapshotTestJSON-825888665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:17:09 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-5416bbef-a73d-4051-9bf2-ea76052230f7 tempest-VolumesSnapshotTestJSON-825888665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:17:09 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-5416bbef-a73d-4051-9bf2-ea76052230f7 tempest-VolumesSnapshotTestJSON-825888665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:17:09 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-5416bbef-a73d-4051-9bf2-ea76052230f7 tempest-VolumesSnapshotTestJSON-825888665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:17:09 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-5416bbef-a73d-4051-9bf2-ea76052230f7 tempest-VolumesSnapshotTestJSON-825888665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:17:09 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[9478b078-6f22-45c8-8982-559e09f6fc29]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:17:09 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-5416bbef-a73d-4051-9bf2-ea76052230f7 tempest-VolumesSnapshotTestJSON-825888665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-227c8b49-d6ac-4def-82ee-5d650711c9a5.be0f8955-bd5b-4f35-8d5b-6634f242afeb {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:09 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-9e27fbe5-d378-4fb9-bc6b-72ed3d5bdd7d tempest-VolumeQuotasAdminTestJSON-276788240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:17:09 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-9e27fbe5-d378-4fb9-bc6b-72ed3d5bdd7d tempest-VolumeQuotasAdminTestJSON-276788240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:17:09 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-9e27fbe5-d378-4fb9-bc6b-72ed3d5bdd7d tempest-VolumeQuotasAdminTestJSON-276788240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:17:09 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-9e27fbe5-d378-4fb9-bc6b-72ed3d5bdd7d tempest-VolumeQuotasAdminTestJSON-276788240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:17:09 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-9e27fbe5-d378-4fb9-bc6b-72ed3d5bdd7d tempest-VolumeQuotasAdminTestJSON-276788240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:17:09 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-9e27fbe5-d378-4fb9-bc6b-72ed3d5bdd7d tempest-VolumeQuotasAdminTestJSON-276788240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:09 devstack sudo[89286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-227c8b49-d6ac-4def-82ee-5d650711c9a5.be0f8955-bd5b-4f35-8d5b-6634f242afeb
Apr 10 13:17:09 devstack sudo[89286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:09 devstack sudo[89287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:17:09 devstack sudo[89287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:10 devstack sudo[89287]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:10 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-9e27fbe5-d378-4fb9-bc6b-72ed3d5bdd7d tempest-VolumeQuotasAdminTestJSON-276788240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.400s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:10 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-9e27fbe5-d378-4fb9-bc6b-72ed3d5bdd7d tempest-VolumeQuotasAdminTestJSON-276788240 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:17:10 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-9e27fbe5-d378-4fb9-bc6b-72ed3d5bdd7d tempest-VolumeQuotasAdminTestJSON-276788240 None] Deleted volume successfully.
Apr 10 13:17:10 devstack sudo[89286]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:10 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-5416bbef-a73d-4051-9bf2-ea76052230f7 tempest-VolumesSnapshotTestJSON-825888665 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-227c8b49-d6ac-4def-82ee-5d650711c9a5.be0f8955-bd5b-4f35-8d5b-6634f242afeb" returned: 0 in 0.471s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:10 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-5416bbef-a73d-4051-9bf2-ea76052230f7 tempest-VolumesSnapshotTestJSON-825888665 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-227c8b49-d6ac-4def-82ee-5d650711c9a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 13:17:10 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-5416bbef-a73d-4051-9bf2-ea76052230f7 tempest-VolumesSnapshotTestJSON-825888665 None] will copy from snapshot at /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-227c8b49-d6ac-4def-82ee-5d650711c9a5 {{(pid=83345) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 10 13:17:10 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-5416bbef-a73d-4051-9bf2-ea76052230f7 tempest-VolumesSnapshotTestJSON-825888665 None] Creating direct copy from snapshot {{(pid=83345) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 10 13:17:10 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-9e27fbe5-d378-4fb9-bc6b-72ed3d5bdd7d tempest-VolumeQuotasAdminTestJSON-276788240 None] Lock "cinder-70d5fbfa-cdce-44a5-8fd4-f28dc8e5f558-delete_volume" released by "delete_volume" :: held 1.597s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:17:10 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eed8fa3-31dc-44b2-b59b-d7baa60bbe96]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:17:10 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-5416bbef-a73d-4051-9bf2-ea76052230f7 tempest-VolumesSnapshotTestJSON-825888665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-227c8b49-d6ac-4def-82ee-5d650711c9a5 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:10 devstack sudo[89294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-227c8b49-d6ac-4def-82ee-5d650711c9a5
Apr 10 13:17:10 devstack sudo[89294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:10 devstack sudo[89294]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:10 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-5416bbef-a73d-4051-9bf2-ea76052230f7 tempest-VolumesSnapshotTestJSON-825888665 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-227c8b49-d6ac-4def-82ee-5d650711c9a5" returned: 0 in 0.459s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:10 devstack cinder-volume[83345]: DEBUG cinder.utils [None req-5416bbef-a73d-4051-9bf2-ea76052230f7 tempest-VolumesSnapshotTestJSON-825888665 None] Path /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-923d419f-b7bb-48b1-bec7-a75f6818683b not found in is_blk_device check {{(pid=83345) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 10 13:17:10 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-5416bbef-a73d-4051-9bf2-ea76052230f7 tempest-VolumesSnapshotTestJSON-825888665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-227c8b49-d6ac-4def-82ee-5d650711c9a5 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-923d419f-b7bb-48b1-bec7-a75f6818683b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:10 devstack sudo[89299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-227c8b49-d6ac-4def-82ee-5d650711c9a5 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-923d419f-b7bb-48b1-bec7-a75f6818683b
Apr 10 13:17:10 devstack sudo[89299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:12 devstack sudo[89299]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:12 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-5416bbef-a73d-4051-9bf2-ea76052230f7 tempest-VolumesSnapshotTestJSON-825888665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-227c8b49-d6ac-4def-82ee-5d650711c9a5 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-923d419f-b7bb-48b1-bec7-a75f6818683b" returned: 0 in 1.923s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:12 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cf2c204-bd88-48cd-8eee-db0fac3dc13d]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:17:12 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-5416bbef-a73d-4051-9bf2-ea76052230f7 tempest-VolumesSnapshotTestJSON-825888665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-227c8b49-d6ac-4def-82ee-5d650711c9a5 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:12 devstack sudo[89312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-227c8b49-d6ac-4def-82ee-5d650711c9a5
Apr 10 13:17:12 devstack sudo[89312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:13 devstack sudo[89312]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:13 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-5416bbef-a73d-4051-9bf2-ea76052230f7 tempest-VolumesSnapshotTestJSON-825888665 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-227c8b49-d6ac-4def-82ee-5d650711c9a5" returned: 0 in 0.700s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:13 devstack cinder-volume[83345]: DEBUG cinder.image.image_utils [None req-5416bbef-a73d-4051-9bf2-ea76052230f7 tempest-VolumesSnapshotTestJSON-825888665 None] Image conversion details: src /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-227c8b49-d6ac-4def-82ee-5d650711c9a5, size 1024.00 MB, duration 1.93 sec, destination /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-923d419f-b7bb-48b1-bec7-a75f6818683b {{(pid=83345) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 10 13:17:13 devstack cinder-volume[83345]: INFO cinder.image.image_utils [None req-5416bbef-a73d-4051-9bf2-ea76052230f7 tempest-VolumesSnapshotTestJSON-825888665 None] Converted 1024.00 MB image at 531.93 MB/s
Apr 10 13:17:13 devstack cinder-volume[83345]: WARNING cinder.volume.drivers.remotefs [None req-5416bbef-a73d-4051-9bf2-ea76052230f7 tempest-VolumesSnapshotTestJSON-825888665 None] /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-923d419f-b7bb-48b1-bec7-a75f6818683b is being set with open permissions: ugo+rw
Apr 10 13:17:13 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-5416bbef-a73d-4051-9bf2-ea76052230f7 tempest-VolumesSnapshotTestJSON-825888665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-923d419f-b7bb-48b1-bec7-a75f6818683b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:13 devstack sudo[89317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-923d419f-b7bb-48b1-bec7-a75f6818683b
Apr 10 13:17:13 devstack sudo[89317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:13 devstack sudo[89317]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:13 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-5416bbef-a73d-4051-9bf2-ea76052230f7 tempest-VolumesSnapshotTestJSON-825888665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-923d419f-b7bb-48b1-bec7-a75f6818683b" returned: 0 in 0.460s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:13 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-5416bbef-a73d-4051-9bf2-ea76052230f7 tempest-VolumesSnapshotTestJSON-825888665 None] Lock "cinder-quobyte-923d419f-b7bb-48b1-bec7-a75f6818683b" released by "_copy_volume_from_snapshot" :: held 4.072s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:17:13 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-5416bbef-a73d-4051-9bf2-ea76052230f7 tempest-VolumesSnapshotTestJSON-825888665 None] Lock "cinder-quobyte-be0f8955-bd5b-4f35-8d5b-6634f242afeb-923d419f-b7bb-48b1-bec7-a75f6818683b" released by "_create_volume_from_snapshot" :: held 4.093s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:17:13 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-5416bbef-a73d-4051-9bf2-ea76052230f7 tempest-VolumesSnapshotTestJSON-825888665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.108s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:17:13 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-5416bbef-a73d-4051-9bf2-ea76052230f7 tempest-VolumesSnapshotTestJSON-825888665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d89613ca-423f-4844-b135-7ecc8330553e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-923d419f-b7bb-48b1-bec7-a75f6818683b', 'volume_size': 1, 'snapshot_id': 'be0f8955-bd5b-4f35-8d5b-6634f242afeb'}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:17:13 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-5416bbef-a73d-4051-9bf2-ea76052230f7 tempest-VolumesSnapshotTestJSON-825888665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b534f99e-7708-4cad-961b-9514597718e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:17:13 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-5416bbef-a73d-4051-9bf2-ea76052230f7 tempest-VolumesSnapshotTestJSON-825888665 None] Volume volume-923d419f-b7bb-48b1-bec7-a75f6818683b (923d419f-b7bb-48b1-bec7-a75f6818683b): created successfully
Apr 10 13:17:13 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-5416bbef-a73d-4051-9bf2-ea76052230f7 tempest-VolumesSnapshotTestJSON-825888665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b534f99e-7708-4cad-961b-9514597718e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:17:13 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-5416bbef-a73d-4051-9bf2-ea76052230f7 tempest-VolumesSnapshotTestJSON-825888665 None] Flow 'volume_create_manager' (ba7d1af4-2201-4129-a979-ef83b4e2c2cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:17:13 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-5416bbef-a73d-4051-9bf2-ea76052230f7 tempest-VolumesSnapshotTestJSON-825888665 None] Created volume successfully.
Apr 10 13:17:14 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-08185273-dfb5-4271-af21-a7352e89e3fc tempest-VolumesSnapshotTestJSON-825888665 None] Acquiring lock "cinder-923d419f-b7bb-48b1-bec7-a75f6818683b-delete_volume" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:17:14 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-08185273-dfb5-4271-af21-a7352e89e3fc tempest-VolumesSnapshotTestJSON-825888665 None] Lock "cinder-923d419f-b7bb-48b1-bec7-a75f6818683b-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:17:14 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-08185273-dfb5-4271-af21-a7352e89e3fc tempest-VolumesSnapshotTestJSON-825888665 None] Acquiring lock "cinder-quobyte-923d419f-b7bb-48b1-bec7-a75f6818683b" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:17:14 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-08185273-dfb5-4271-af21-a7352e89e3fc tempest-VolumesSnapshotTestJSON-825888665 None] Lock "cinder-quobyte-923d419f-b7bb-48b1-bec7-a75f6818683b" acquired by "delete_volume" :: waited 0.008s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:17:14 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c65bbb9-07bb-45dd-901d-118fc4d4095a]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:17:14 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-08185273-dfb5-4271-af21-a7352e89e3fc tempest-VolumesSnapshotTestJSON-825888665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-923d419f-b7bb-48b1-bec7-a75f6818683b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:15 devstack sudo[89320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-923d419f-b7bb-48b1-bec7-a75f6818683b
Apr 10 13:17:15 devstack sudo[89320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:15 devstack sudo[89320]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:15 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-08185273-dfb5-4271-af21-a7352e89e3fc tempest-VolumesSnapshotTestJSON-825888665 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-923d419f-b7bb-48b1-bec7-a75f6818683b" returned: 0 in 0.470s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:15 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-08185273-dfb5-4271-af21-a7352e89e3fc tempest-VolumesSnapshotTestJSON-825888665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-923d419f-b7bb-48b1-bec7-a75f6818683b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:15 devstack sudo[89325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-923d419f-b7bb-48b1-bec7-a75f6818683b
Apr 10 13:17:15 devstack sudo[89325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:15 devstack sudo[89325]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:15 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-08185273-dfb5-4271-af21-a7352e89e3fc tempest-VolumesSnapshotTestJSON-825888665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-923d419f-b7bb-48b1-bec7-a75f6818683b" returned: 0 in 0.448s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:15 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-08185273-dfb5-4271-af21-a7352e89e3fc tempest-VolumesSnapshotTestJSON-825888665 None] Lock "cinder-quobyte-923d419f-b7bb-48b1-bec7-a75f6818683b" released by "delete_volume" :: held 0.945s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:17:15 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e5e66b5-4086-40d7-abf8-7ce0cc1785ad tempest-VolumeSnapshotQuotasNegativeTestJSON-464202690 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:17:15 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-5e5e66b5-4086-40d7-abf8-7ce0cc1785ad tempest-VolumeSnapshotQuotasNegativeTestJSON-464202690 None] Flow 'volume_create_manager' (4b7c5b9e-4b59-4b60-b096-21c181f42112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:17:15 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-5e5e66b5-4086-40d7-abf8-7ce0cc1785ad tempest-VolumeSnapshotQuotasNegativeTestJSON-464202690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8df9609c-f4ab-4e58-832b-243875eb357e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:17:15 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-5e5e66b5-4086-40d7-abf8-7ce0cc1785ad tempest-VolumeSnapshotQuotasNegativeTestJSON-464202690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8df9609c-f4ab-4e58-832b-243875eb357e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:17:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-487611849',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59fd6015-7e4e-47e3-b227-e60fcc8d19c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87099e2d9cfd4e6b8b70dad91d0a465a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:17:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:17:16Z,use_quota=True,user_id='44830894578145489d9a563840e617fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:17:15 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-5e5e66b5-4086-40d7-abf8-7ce0cc1785ad tempest-VolumeSnapshotQuotasNegativeTestJSON-464202690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e3b4583-c557-47e2-a20e-ccba8cd78dca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:17:15 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-5e5e66b5-4086-40d7-abf8-7ce0cc1785ad tempest-VolumeSnapshotQuotasNegativeTestJSON-464202690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e3b4583-c557-47e2-a20e-ccba8cd78dca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:17:15 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-5e5e66b5-4086-40d7-abf8-7ce0cc1785ad tempest-VolumeSnapshotQuotasNegativeTestJSON-464202690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d711067e-6dff-4cdc-bb34-cda731bf5249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:17:15 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-5e5e66b5-4086-40d7-abf8-7ce0cc1785ad tempest-VolumeSnapshotQuotasNegativeTestJSON-464202690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d711067e-6dff-4cdc-bb34-cda731bf5249) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59fd6015-7e4e-47e3-b227-e60fcc8d19c7', 'volume_name': 'volume-59fd6015-7e4e-47e3-b227-e60fcc8d19c7', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:17:16 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-5e5e66b5-4086-40d7-abf8-7ce0cc1785ad tempest-VolumeSnapshotQuotasNegativeTestJSON-464202690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f97f53f-f549-40d4-ba62-f3372c2762e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:17:16 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-5e5e66b5-4086-40d7-abf8-7ce0cc1785ad tempest-VolumeSnapshotQuotasNegativeTestJSON-464202690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f97f53f-f549-40d4-ba62-f3372c2762e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:17:16 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-5e5e66b5-4086-40d7-abf8-7ce0cc1785ad tempest-VolumeSnapshotQuotasNegativeTestJSON-464202690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (331e9600-e8b6-4999-8236-92f148cf3aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:17:16 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-5e5e66b5-4086-40d7-abf8-7ce0cc1785ad tempest-VolumeSnapshotQuotasNegativeTestJSON-464202690 None] Volume 59fd6015-7e4e-47e3-b227-e60fcc8d19c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59fd6015-7e4e-47e3-b227-e60fcc8d19c7', 'volume_size': 1}
Apr 10 13:17:16 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-5e5e66b5-4086-40d7-abf8-7ce0cc1785ad tempest-VolumeSnapshotQuotasNegativeTestJSON-464202690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:17:16 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-5e5e66b5-4086-40d7-abf8-7ce0cc1785ad tempest-VolumeSnapshotQuotasNegativeTestJSON-464202690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:17:16 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-5e5e66b5-4086-40d7-abf8-7ce0cc1785ad tempest-VolumeSnapshotQuotasNegativeTestJSON-464202690 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f252bf08b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:17:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-487611849',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59fd6015-7e4e-47e3-b227-e60fcc8d19c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87099e2d9cfd4e6b8b70dad91d0a465a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:17:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:17:16Z,use_quota=True,user_id='44830894578145489d9a563840e617fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)}" {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 13:17:16 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-5e5e66b5-4086-40d7-abf8-7ce0cc1785ad tempest-VolumeSnapshotQuotasNegativeTestJSON-464202690 None] Creating volume 59fd6015-7e4e-47e3-b227-e60fcc8d19c7 {{(pid=83345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 13:17:16 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-5e5e66b5-4086-40d7-abf8-7ce0cc1785ad tempest-VolumeSnapshotQuotasNegativeTestJSON-464202690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:17:16 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-5e5e66b5-4086-40d7-abf8-7ce0cc1785ad tempest-VolumeSnapshotQuotasNegativeTestJSON-464202690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:17:16 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-5e5e66b5-4086-40d7-abf8-7ce0cc1785ad tempest-VolumeSnapshotQuotasNegativeTestJSON-464202690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:17:16 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-5e5e66b5-4086-40d7-abf8-7ce0cc1785ad tempest-VolumeSnapshotQuotasNegativeTestJSON-464202690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:17:16 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-5e5e66b5-4086-40d7-abf8-7ce0cc1785ad tempest-VolumeSnapshotQuotasNegativeTestJSON-464202690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:17:16 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-5e5e66b5-4086-40d7-abf8-7ce0cc1785ad tempest-VolumeSnapshotQuotasNegativeTestJSON-464202690 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:17:16 devstack cinder-volume[83345]: INFO cinder.volume.drivers.remotefs [None req-5e5e66b5-4086-40d7-abf8-7ce0cc1785ad tempest-VolumeSnapshotQuotasNegativeTestJSON-464202690 None] casted to osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331
Apr 10 13:17:16 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-5e5e66b5-4086-40d7-abf8-7ce0cc1785ad tempest-VolumeSnapshotQuotasNegativeTestJSON-464202690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-59fd6015-7e4e-47e3-b227-e60fcc8d19c7 1073741824 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:16 devstack sudo[89328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-59fd6015-7e4e-47e3-b227-e60fcc8d19c7 1073741824
Apr 10 13:17:16 devstack sudo[89328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:16 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-08185273-dfb5-4271-af21-a7352e89e3fc tempest-VolumesSnapshotTestJSON-825888665 None] Created reservations ['b2fd1c0b-da64-4f4a-aa88-ce6a40a9ec2d', '044f388d-393e-4d01-a425-9f7b39c92426', 'ae3a96cd-ad8c-40c5-b980-8ba54d71ed3f', 'e41a4c0a-9fbc-4310-930e-410ea1c673a4'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:17:16 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-08185273-dfb5-4271-af21-a7352e89e3fc tempest-VolumesSnapshotTestJSON-825888665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:17:16 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-08185273-dfb5-4271-af21-a7352e89e3fc tempest-VolumesSnapshotTestJSON-825888665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:17:16 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-08185273-dfb5-4271-af21-a7352e89e3fc tempest-VolumesSnapshotTestJSON-825888665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:17:16 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-08185273-dfb5-4271-af21-a7352e89e3fc tempest-VolumesSnapshotTestJSON-825888665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:17:16 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-08185273-dfb5-4271-af21-a7352e89e3fc tempest-VolumesSnapshotTestJSON-825888665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:17:16 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-08185273-dfb5-4271-af21-a7352e89e3fc tempest-VolumesSnapshotTestJSON-825888665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:16 devstack sudo[89330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:17:16 devstack sudo[89330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:16 devstack sudo[89328]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:16 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-5e5e66b5-4086-40d7-abf8-7ce0cc1785ad tempest-VolumeSnapshotQuotasNegativeTestJSON-464202690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-59fd6015-7e4e-47e3-b227-e60fcc8d19c7 1073741824" returned: 0 in 0.468s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:16 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-5e5e66b5-4086-40d7-abf8-7ce0cc1785ad tempest-VolumeSnapshotQuotasNegativeTestJSON-464202690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-59fd6015-7e4e-47e3-b227-e60fcc8d19c7 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:16 devstack sudo[89330]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:16 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-08185273-dfb5-4271-af21-a7352e89e3fc tempest-VolumesSnapshotTestJSON-825888665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.443s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:16 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-08185273-dfb5-4271-af21-a7352e89e3fc tempest-VolumesSnapshotTestJSON-825888665 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:17:16 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-08185273-dfb5-4271-af21-a7352e89e3fc tempest-VolumesSnapshotTestJSON-825888665 None] Deleted volume successfully.
Apr 10 13:17:16 devstack sudo[89336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-59fd6015-7e4e-47e3-b227-e60fcc8d19c7
Apr 10 13:17:16 devstack sudo[89336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:16 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-08185273-dfb5-4271-af21-a7352e89e3fc tempest-VolumesSnapshotTestJSON-825888665 None] Lock "cinder-923d419f-b7bb-48b1-bec7-a75f6818683b-delete_volume" released by "delete_volume" :: held 1.628s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:17:16 devstack sudo[89336]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:16 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-5e5e66b5-4086-40d7-abf8-7ce0cc1785ad tempest-VolumeSnapshotQuotasNegativeTestJSON-464202690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-59fd6015-7e4e-47e3-b227-e60fcc8d19c7" returned: 0 in 0.407s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:16 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-5e5e66b5-4086-40d7-abf8-7ce0cc1785ad tempest-VolumeSnapshotQuotasNegativeTestJSON-464202690 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'} {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 13:17:16 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-5e5e66b5-4086-40d7-abf8-7ce0cc1785ad tempest-VolumeSnapshotQuotasNegativeTestJSON-464202690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:17:16 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-5e5e66b5-4086-40d7-abf8-7ce0cc1785ad tempest-VolumeSnapshotQuotasNegativeTestJSON-464202690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (331e9600-e8b6-4999-8236-92f148cf3aed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59fd6015-7e4e-47e3-b227-e60fcc8d19c7', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:17:16 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-5e5e66b5-4086-40d7-abf8-7ce0cc1785ad tempest-VolumeSnapshotQuotasNegativeTestJSON-464202690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (742321cf-5722-4fe3-94d9-1743a8939fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:17:16 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-5e5e66b5-4086-40d7-abf8-7ce0cc1785ad tempest-VolumeSnapshotQuotasNegativeTestJSON-464202690 None] Volume volume-59fd6015-7e4e-47e3-b227-e60fcc8d19c7 (59fd6015-7e4e-47e3-b227-e60fcc8d19c7): created successfully
Apr 10 13:17:16 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-5e5e66b5-4086-40d7-abf8-7ce0cc1785ad tempest-VolumeSnapshotQuotasNegativeTestJSON-464202690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (742321cf-5722-4fe3-94d9-1743a8939fe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:17:16 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-5e5e66b5-4086-40d7-abf8-7ce0cc1785ad tempest-VolumeSnapshotQuotasNegativeTestJSON-464202690 None] Flow 'volume_create_manager' (4b7c5b9e-4b59-4b60-b096-21c181f42112) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:17:16 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-5e5e66b5-4086-40d7-abf8-7ce0cc1785ad tempest-VolumeSnapshotQuotasNegativeTestJSON-464202690 None] Created volume successfully.
Apr 10 13:17:17 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-f2b62cbd-fe39-485d-84bf-27ac88b9f871 tempest-VolumesSnapshotTestJSON-825888665 None] Acquiring lock "cinder-be0f8955-bd5b-4f35-8d5b-6634f242afeb-delete_snapshot" by "delete_snapshot" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:17:17 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-f2b62cbd-fe39-485d-84bf-27ac88b9f871 tempest-VolumesSnapshotTestJSON-825888665 None] Lock "cinder-be0f8955-bd5b-4f35-8d5b-6634f242afeb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:17:17 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-f2b62cbd-fe39-485d-84bf-27ac88b9f871 tempest-VolumesSnapshotTestJSON-825888665 None] Acquiring lock "cinder-quobyte-227c8b49-d6ac-4def-82ee-5d650711c9a5" by "delete_snapshot" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:17:17 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-f2b62cbd-fe39-485d-84bf-27ac88b9f871 tempest-VolumesSnapshotTestJSON-825888665 None] Lock "cinder-quobyte-227c8b49-d6ac-4def-82ee-5d650711c9a5" acquired by "delete_snapshot" :: waited 0.006s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:17:17 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-f2b62cbd-fe39-485d-84bf-27ac88b9f871 tempest-VolumesSnapshotTestJSON-825888665 None] Acquiring lock "cinder-quobyte-be0f8955-bd5b-4f35-8d5b-6634f242afeb" by "_delete_snapshot" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:17:17 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-f2b62cbd-fe39-485d-84bf-27ac88b9f871 tempest-VolumesSnapshotTestJSON-825888665 None] Lock "cinder-quobyte-be0f8955-bd5b-4f35-8d5b-6634f242afeb" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:17:17 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-f2b62cbd-fe39-485d-84bf-27ac88b9f871 tempest-VolumesSnapshotTestJSON-825888665 None] Deleting offline snapshot be0f8955-bd5b-4f35-8d5b-6634f242afeb of volume 227c8b49-d6ac-4def-82ee-5d650711c9a5 {{(pid=83345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 10 13:17:17 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-f2b62cbd-fe39-485d-84bf-27ac88b9f871 tempest-VolumesSnapshotTestJSON-825888665 None] snapshot_file for this snap is: volume-227c8b49-d6ac-4def-82ee-5d650711c9a5.be0f8955-bd5b-4f35-8d5b-6634f242afeb {{(pid=83345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 10 13:17:17 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[034284ac-7774-4eb7-bb64-a06adafc6bdb]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:17:17 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-f2b62cbd-fe39-485d-84bf-27ac88b9f871 tempest-VolumesSnapshotTestJSON-825888665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-227c8b49-d6ac-4def-82ee-5d650711c9a5.be0f8955-bd5b-4f35-8d5b-6634f242afeb {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:17 devstack sudo[89339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-227c8b49-d6ac-4def-82ee-5d650711c9a5.be0f8955-bd5b-4f35-8d5b-6634f242afeb
Apr 10 13:17:17 devstack sudo[89339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:17 devstack sudo[89339]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:17 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-f2b62cbd-fe39-485d-84bf-27ac88b9f871 tempest-VolumesSnapshotTestJSON-825888665 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-227c8b49-d6ac-4def-82ee-5d650711c9a5.be0f8955-bd5b-4f35-8d5b-6634f242afeb" returned: 0 in 0.450s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:17 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-f2b62cbd-fe39-485d-84bf-27ac88b9f871 tempest-VolumesSnapshotTestJSON-825888665 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-227c8b49-d6ac-4def-82ee-5d650711c9a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 13:17:17 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bfe732b-b5a3-4adc-b1dd-3f259e22535a]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:17:17 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-f2b62cbd-fe39-485d-84bf-27ac88b9f871 tempest-VolumesSnapshotTestJSON-825888665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-227c8b49-d6ac-4def-82ee-5d650711c9a5 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:17 devstack sudo[89344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-227c8b49-d6ac-4def-82ee-5d650711c9a5
Apr 10 13:17:17 devstack sudo[89344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:18 devstack sudo[89344]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:18 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-f2b62cbd-fe39-485d-84bf-27ac88b9f871 tempest-VolumesSnapshotTestJSON-825888665 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-227c8b49-d6ac-4def-82ee-5d650711c9a5" returned: 0 in 0.469s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:18 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-f2b62cbd-fe39-485d-84bf-27ac88b9f871 tempest-VolumesSnapshotTestJSON-825888665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-227c8b49-d6ac-4def-82ee-5d650711c9a5.be0f8955-bd5b-4f35-8d5b-6634f242afeb {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:18 devstack sudo[89349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-227c8b49-d6ac-4def-82ee-5d650711c9a5.be0f8955-bd5b-4f35-8d5b-6634f242afeb
Apr 10 13:17:18 devstack sudo[89349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:18 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-79716470-6070-4ca5-93cd-c9ad0b6c3a98 tempest-VolumeSnapshotQuotasNegativeTestJSON-464202690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:17:18 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-79716470-6070-4ca5-93cd-c9ad0b6c3a98 tempest-VolumeSnapshotQuotasNegativeTestJSON-464202690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:17:18 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-79716470-6070-4ca5-93cd-c9ad0b6c3a98 tempest-VolumeSnapshotQuotasNegativeTestJSON-464202690 None] Creating offline snapshot 1bbd3734-129b-466e-98e9-6a095630f73a of volume 59fd6015-7e4e-47e3-b227-e60fcc8d19c7 {{(pid=83345) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 10 13:17:18 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e83c9fe-f858-41ef-bcd7-9ac2170a0bd7]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:17:18 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-79716470-6070-4ca5-93cd-c9ad0b6c3a98 tempest-VolumeSnapshotQuotasNegativeTestJSON-464202690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-59fd6015-7e4e-47e3-b227-e60fcc8d19c7 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:18 devstack sudo[89351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-59fd6015-7e4e-47e3-b227-e60fcc8d19c7
Apr 10 13:17:18 devstack sudo[89351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:18 devstack sudo[89349]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:18 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-f2b62cbd-fe39-485d-84bf-27ac88b9f871 tempest-VolumesSnapshotTestJSON-825888665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-227c8b49-d6ac-4def-82ee-5d650711c9a5.be0f8955-bd5b-4f35-8d5b-6634f242afeb" returned: 0 in 0.464s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:18 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-f2b62cbd-fe39-485d-84bf-27ac88b9f871 tempest-VolumesSnapshotTestJSON-825888665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-227c8b49-d6ac-4def-82ee-5d650711c9a5.be0f8955-bd5b-4f35-8d5b-6634f242afeb {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:18 devstack sudo[89356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-227c8b49-d6ac-4def-82ee-5d650711c9a5.be0f8955-bd5b-4f35-8d5b-6634f242afeb
Apr 10 13:17:18 devstack sudo[89356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:18 devstack sudo[89351]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:18 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-79716470-6070-4ca5-93cd-c9ad0b6c3a98 tempest-VolumeSnapshotQuotasNegativeTestJSON-464202690 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-59fd6015-7e4e-47e3-b227-e60fcc8d19c7" returned: 0 in 0.468s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:18 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-79716470-6070-4ca5-93cd-c9ad0b6c3a98 tempest-VolumeSnapshotQuotasNegativeTestJSON-464202690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-59fd6015-7e4e-47e3-b227-e60fcc8d19c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-59fd6015-7e4e-47e3-b227-e60fcc8d19c7.1bbd3734-129b-466e-98e9-6a095630f73a 1G {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:18 devstack sudo[89361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-59fd6015-7e4e-47e3-b227-e60fcc8d19c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-59fd6015-7e4e-47e3-b227-e60fcc8d19c7.1bbd3734-129b-466e-98e9-6a095630f73a 1G
Apr 10 13:17:18 devstack sudo[89361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:18 devstack sudo[89356]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:18 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-f2b62cbd-fe39-485d-84bf-27ac88b9f871 tempest-VolumesSnapshotTestJSON-825888665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-227c8b49-d6ac-4def-82ee-5d650711c9a5.be0f8955-bd5b-4f35-8d5b-6634f242afeb" returned: 0 in 0.430s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:18 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-f2b62cbd-fe39-485d-84bf-27ac88b9f871 tempest-VolumesSnapshotTestJSON-825888665 None] Lock "cinder-quobyte-be0f8955-bd5b-4f35-8d5b-6634f242afeb" released by "_delete_snapshot" :: held 1.870s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:17:19 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-f2b62cbd-fe39-485d-84bf-27ac88b9f871 tempest-VolumesSnapshotTestJSON-825888665 None] Lock "cinder-quobyte-227c8b49-d6ac-4def-82ee-5d650711c9a5" released by "delete_snapshot" :: held 1.887s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:17:19 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-f2b62cbd-fe39-485d-84bf-27ac88b9f871 tempest-VolumesSnapshotTestJSON-825888665 None] Created reservations ['dbb5769b-93f7-4ebe-b558-8845d0328a0d', '8e8aff09-4769-4ff2-bb09-d268ef4bbd99', '2c4342df-d980-4e0c-b66b-a49d61a025f7', 'bbd0b5bb-53e8-4c63-97f4-147de8853b91'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:17:19 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-f2b62cbd-fe39-485d-84bf-27ac88b9f871 tempest-VolumesSnapshotTestJSON-825888665 None] Delete snapshot completed successfully.
Apr 10 13:17:19 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-f2b62cbd-fe39-485d-84bf-27ac88b9f871 tempest-VolumesSnapshotTestJSON-825888665 None] Lock "cinder-be0f8955-bd5b-4f35-8d5b-6634f242afeb-delete_snapshot" released by "delete_snapshot" :: held 1.984s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:17:19 devstack sudo[89361]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:19 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-79716470-6070-4ca5-93cd-c9ad0b6c3a98 tempest-VolumeSnapshotQuotasNegativeTestJSON-464202690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-59fd6015-7e4e-47e3-b227-e60fcc8d19c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-59fd6015-7e4e-47e3-b227-e60fcc8d19c7.1bbd3734-129b-466e-98e9-6a095630f73a 1G" returned: 0 in 0.473s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:19 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-79716470-6070-4ca5-93cd-c9ad0b6c3a98 tempest-VolumeSnapshotQuotasNegativeTestJSON-464202690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59fd6015-7e4e-47e3-b227-e60fcc8d19c7 -F qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-59fd6015-7e4e-47e3-b227-e60fcc8d19c7.1bbd3734-129b-466e-98e9-6a095630f73a {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:19 devstack sudo[89373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59fd6015-7e4e-47e3-b227-e60fcc8d19c7 -F qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-59fd6015-7e4e-47e3-b227-e60fcc8d19c7.1bbd3734-129b-466e-98e9-6a095630f73a
Apr 10 13:17:19 devstack sudo[89373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:19 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-309d5465-950c-4c78-8652-a5465f8764c5 tempest-VolumesSnapshotTestJSON-825888665 None] Acquiring lock "cinder-227c8b49-d6ac-4def-82ee-5d650711c9a5-delete_volume" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:17:19 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-309d5465-950c-4c78-8652-a5465f8764c5 tempest-VolumesSnapshotTestJSON-825888665 None] Lock "cinder-227c8b49-d6ac-4def-82ee-5d650711c9a5-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:17:19 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-309d5465-950c-4c78-8652-a5465f8764c5 tempest-VolumesSnapshotTestJSON-825888665 None] Acquiring lock "cinder-quobyte-227c8b49-d6ac-4def-82ee-5d650711c9a5" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:17:19 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-309d5465-950c-4c78-8652-a5465f8764c5 tempest-VolumesSnapshotTestJSON-825888665 None] Lock "cinder-quobyte-227c8b49-d6ac-4def-82ee-5d650711c9a5" acquired by "delete_volume" :: waited 0.008s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:17:19 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[19056f82-f553-42f7-b60d-fb66352b1226]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:17:19 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-309d5465-950c-4c78-8652-a5465f8764c5 tempest-VolumesSnapshotTestJSON-825888665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-227c8b49-d6ac-4def-82ee-5d650711c9a5 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:19 devstack sudo[89375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-227c8b49-d6ac-4def-82ee-5d650711c9a5
Apr 10 13:17:19 devstack sudo[89375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:19 devstack sudo[89373]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:19 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-79716470-6070-4ca5-93cd-c9ad0b6c3a98 tempest-VolumeSnapshotQuotasNegativeTestJSON-464202690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59fd6015-7e4e-47e3-b227-e60fcc8d19c7 -F qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-59fd6015-7e4e-47e3-b227-e60fcc8d19c7.1bbd3734-129b-466e-98e9-6a095630f73a" returned: 0 in 0.498s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:19 devstack cinder-volume[83345]: WARNING cinder.volume.drivers.remotefs [None req-79716470-6070-4ca5-93cd-c9ad0b6c3a98 tempest-VolumeSnapshotQuotasNegativeTestJSON-464202690 None] /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-59fd6015-7e4e-47e3-b227-e60fcc8d19c7.1bbd3734-129b-466e-98e9-6a095630f73a is being set with open permissions: ugo+rw
Apr 10 13:17:19 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-79716470-6070-4ca5-93cd-c9ad0b6c3a98 tempest-VolumeSnapshotQuotasNegativeTestJSON-464202690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-59fd6015-7e4e-47e3-b227-e60fcc8d19c7.1bbd3734-129b-466e-98e9-6a095630f73a {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:19 devstack sudo[89380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-59fd6015-7e4e-47e3-b227-e60fcc8d19c7.1bbd3734-129b-466e-98e9-6a095630f73a
Apr 10 13:17:19 devstack sudo[89380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:19 devstack sudo[89375]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:19 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-309d5465-950c-4c78-8652-a5465f8764c5 tempest-VolumesSnapshotTestJSON-825888665 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-227c8b49-d6ac-4def-82ee-5d650711c9a5" returned: 0 in 0.453s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:19 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-309d5465-950c-4c78-8652-a5465f8764c5 tempest-VolumesSnapshotTestJSON-825888665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-227c8b49-d6ac-4def-82ee-5d650711c9a5 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:19 devstack sudo[89385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-227c8b49-d6ac-4def-82ee-5d650711c9a5
Apr 10 13:17:19 devstack sudo[89385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:20 devstack sudo[89380]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:20 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-79716470-6070-4ca5-93cd-c9ad0b6c3a98 tempest-VolumeSnapshotQuotasNegativeTestJSON-464202690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-59fd6015-7e4e-47e3-b227-e60fcc8d19c7.1bbd3734-129b-466e-98e9-6a095630f73a" returned: 0 in 0.398s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:20 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-79716470-6070-4ca5-93cd-c9ad0b6c3a98 tempest-VolumeSnapshotQuotasNegativeTestJSON-464202690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-59fd6015-7e4e-47e3-b227-e60fcc8d19c7.info {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:20 devstack sudo[89388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-59fd6015-7e4e-47e3-b227-e60fcc8d19c7.info
Apr 10 13:17:20 devstack sudo[89388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:20 devstack sudo[89385]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:20 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-309d5465-950c-4c78-8652-a5465f8764c5 tempest-VolumesSnapshotTestJSON-825888665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-227c8b49-d6ac-4def-82ee-5d650711c9a5" returned: 0 in 0.412s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:20 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-309d5465-950c-4c78-8652-a5465f8764c5 tempest-VolumesSnapshotTestJSON-825888665 None] Lock "cinder-quobyte-227c8b49-d6ac-4def-82ee-5d650711c9a5" released by "delete_volume" :: held 0.897s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:17:20 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-309d5465-950c-4c78-8652-a5465f8764c5 tempest-VolumesSnapshotTestJSON-825888665 None] Created reservations ['04ff627b-76d2-42da-bc8d-85cb4f67ee5d', 'e40e2117-59e0-43cc-a06e-2728e8e2ce8e', 'c251d335-456d-44c7-ad87-c431f01c1eae', '3f4225fd-40e7-4473-943c-2205dc0d8bf0'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:17:20 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-309d5465-950c-4c78-8652-a5465f8764c5 tempest-VolumesSnapshotTestJSON-825888665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:17:20 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-309d5465-950c-4c78-8652-a5465f8764c5 tempest-VolumesSnapshotTestJSON-825888665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:17:20 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-309d5465-950c-4c78-8652-a5465f8764c5 tempest-VolumesSnapshotTestJSON-825888665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:17:20 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-309d5465-950c-4c78-8652-a5465f8764c5 tempest-VolumesSnapshotTestJSON-825888665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:17:20 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-309d5465-950c-4c78-8652-a5465f8764c5 tempest-VolumesSnapshotTestJSON-825888665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:17:20 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-309d5465-950c-4c78-8652-a5465f8764c5 tempest-VolumesSnapshotTestJSON-825888665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:20 devstack sudo[89391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:17:20 devstack sudo[89391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:20 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-d967e7e9-7e58-4eb0-ac25-5cb1ddc05c72 tempest-VolumesSnapshotTestJSON-825888665 None] Acquiring lock "cinder-c50dafa0-5ef5-44b3-8d74-4e87989cecb7-delete_volume" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:17:20 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-d967e7e9-7e58-4eb0-ac25-5cb1ddc05c72 tempest-VolumesSnapshotTestJSON-825888665 None] Lock "cinder-c50dafa0-5ef5-44b3-8d74-4e87989cecb7-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:17:20 devstack sudo[89388]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:20 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-d967e7e9-7e58-4eb0-ac25-5cb1ddc05c72 tempest-VolumesSnapshotTestJSON-825888665 None] Acquiring lock "cinder-quobyte-c50dafa0-5ef5-44b3-8d74-4e87989cecb7" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:17:20 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-79716470-6070-4ca5-93cd-c9ad0b6c3a98 tempest-VolumeSnapshotQuotasNegativeTestJSON-464202690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-59fd6015-7e4e-47e3-b227-e60fcc8d19c7.info" returned: 0 in 0.436s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:20 devstack cinder-volume[83345]: WARNING cinder.volume.drivers.remotefs [None req-79716470-6070-4ca5-93cd-c9ad0b6c3a98 tempest-VolumeSnapshotQuotasNegativeTestJSON-464202690 None] /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-59fd6015-7e4e-47e3-b227-e60fcc8d19c7.info is being set with open permissions: ugo+rw
Apr 10 13:17:20 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-79716470-6070-4ca5-93cd-c9ad0b6c3a98 tempest-VolumeSnapshotQuotasNegativeTestJSON-464202690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-59fd6015-7e4e-47e3-b227-e60fcc8d19c7.info {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:20 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-d967e7e9-7e58-4eb0-ac25-5cb1ddc05c72 tempest-VolumesSnapshotTestJSON-825888665 None] Lock "cinder-quobyte-c50dafa0-5ef5-44b3-8d74-4e87989cecb7" acquired by "delete_volume" :: waited 0.020s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:17:20 devstack sudo[89394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-59fd6015-7e4e-47e3-b227-e60fcc8d19c7.info
Apr 10 13:17:20 devstack sudo[89394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:20 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f23d850-0c34-46ed-ac9f-4ced3d2b0dd1]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:17:20 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-d967e7e9-7e58-4eb0-ac25-5cb1ddc05c72 tempest-VolumesSnapshotTestJSON-825888665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-c50dafa0-5ef5-44b3-8d74-4e87989cecb7 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:20 devstack sudo[89396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-c50dafa0-5ef5-44b3-8d74-4e87989cecb7
Apr 10 13:17:20 devstack sudo[89396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:20 devstack sudo[89391]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:20 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-309d5465-950c-4c78-8652-a5465f8764c5 tempest-VolumesSnapshotTestJSON-825888665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.453s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:20 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-309d5465-950c-4c78-8652-a5465f8764c5 tempest-VolumesSnapshotTestJSON-825888665 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:17:20 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-309d5465-950c-4c78-8652-a5465f8764c5 tempest-VolumesSnapshotTestJSON-825888665 None] Deleted volume successfully.
Apr 10 13:17:20 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-309d5465-950c-4c78-8652-a5465f8764c5 tempest-VolumesSnapshotTestJSON-825888665 None] Lock "cinder-227c8b49-d6ac-4def-82ee-5d650711c9a5-delete_volume" released by "delete_volume" :: held 1.483s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:17:20 devstack sudo[89394]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:20 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-79716470-6070-4ca5-93cd-c9ad0b6c3a98 tempest-VolumeSnapshotQuotasNegativeTestJSON-464202690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-59fd6015-7e4e-47e3-b227-e60fcc8d19c7.info" returned: 0 in 0.403s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:20 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-79716470-6070-4ca5-93cd-c9ad0b6c3a98 tempest-VolumeSnapshotQuotasNegativeTestJSON-464202690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.729s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:17:20 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-79716470-6070-4ca5-93cd-c9ad0b6c3a98 tempest-VolumeSnapshotQuotasNegativeTestJSON-464202690 None] Create snapshot completed successfully
Apr 10 13:17:20 devstack sudo[89396]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:21 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-d967e7e9-7e58-4eb0-ac25-5cb1ddc05c72 tempest-VolumesSnapshotTestJSON-825888665 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-c50dafa0-5ef5-44b3-8d74-4e87989cecb7" returned: 0 in 0.490s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:21 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-d967e7e9-7e58-4eb0-ac25-5cb1ddc05c72 tempest-VolumesSnapshotTestJSON-825888665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-c50dafa0-5ef5-44b3-8d74-4e87989cecb7 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:21 devstack sudo[89403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-c50dafa0-5ef5-44b3-8d74-4e87989cecb7
Apr 10 13:17:21 devstack sudo[89403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:21 devstack sudo[89403]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:21 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-d967e7e9-7e58-4eb0-ac25-5cb1ddc05c72 tempest-VolumesSnapshotTestJSON-825888665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-c50dafa0-5ef5-44b3-8d74-4e87989cecb7" returned: 0 in 0.447s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:21 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-d967e7e9-7e58-4eb0-ac25-5cb1ddc05c72 tempest-VolumesSnapshotTestJSON-825888665 None] Lock "cinder-quobyte-c50dafa0-5ef5-44b3-8d74-4e87989cecb7" released by "delete_volume" :: held 0.980s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:17:21 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-37860960-a75e-4489-b4ad-2e231d5ad3dc tempest-VolumeSnapshotQuotasNegativeTestJSON-464202690 None] Acquiring lock "cinder-1bbd3734-129b-466e-98e9-6a095630f73a-delete_snapshot" by "delete_snapshot" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:17:21 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-d967e7e9-7e58-4eb0-ac25-5cb1ddc05c72 tempest-VolumesSnapshotTestJSON-825888665 None] Created reservations ['37c9ca3c-d665-4158-b2f0-a576eebbf1cb', 'ec01f250-f197-4638-b295-ef01738e96c4', 'b2c5f18b-a25a-405c-afbf-559d1f7bbb85', '4220e7ba-6af1-4ecd-8688-a59f6d1c8f71'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:17:21 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-37860960-a75e-4489-b4ad-2e231d5ad3dc tempest-VolumeSnapshotQuotasNegativeTestJSON-464202690 None] Lock "cinder-1bbd3734-129b-466e-98e9-6a095630f73a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:17:21 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-37860960-a75e-4489-b4ad-2e231d5ad3dc tempest-VolumeSnapshotQuotasNegativeTestJSON-464202690 None] Acquiring lock "cinder-quobyte-59fd6015-7e4e-47e3-b227-e60fcc8d19c7" by "delete_snapshot" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:17:21 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-37860960-a75e-4489-b4ad-2e231d5ad3dc tempest-VolumeSnapshotQuotasNegativeTestJSON-464202690 None] Lock "cinder-quobyte-59fd6015-7e4e-47e3-b227-e60fcc8d19c7" acquired by "delete_snapshot" :: waited 0.016s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:17:21 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-37860960-a75e-4489-b4ad-2e231d5ad3dc tempest-VolumeSnapshotQuotasNegativeTestJSON-464202690 None] Acquiring lock "cinder-quobyte-1bbd3734-129b-466e-98e9-6a095630f73a" by "_delete_snapshot" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:17:21 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-d967e7e9-7e58-4eb0-ac25-5cb1ddc05c72 tempest-VolumesSnapshotTestJSON-825888665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:17:21 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-d967e7e9-7e58-4eb0-ac25-5cb1ddc05c72 tempest-VolumesSnapshotTestJSON-825888665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:17:21 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-d967e7e9-7e58-4eb0-ac25-5cb1ddc05c72 tempest-VolumesSnapshotTestJSON-825888665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:17:21 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-d967e7e9-7e58-4eb0-ac25-5cb1ddc05c72 tempest-VolumesSnapshotTestJSON-825888665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:17:21 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-d967e7e9-7e58-4eb0-ac25-5cb1ddc05c72 tempest-VolumesSnapshotTestJSON-825888665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:17:21 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-d967e7e9-7e58-4eb0-ac25-5cb1ddc05c72 tempest-VolumesSnapshotTestJSON-825888665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:21 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-37860960-a75e-4489-b4ad-2e231d5ad3dc tempest-VolumeSnapshotQuotasNegativeTestJSON-464202690 None] Lock "cinder-quobyte-1bbd3734-129b-466e-98e9-6a095630f73a" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:17:21 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-37860960-a75e-4489-b4ad-2e231d5ad3dc tempest-VolumeSnapshotQuotasNegativeTestJSON-464202690 None] Deleting offline snapshot 1bbd3734-129b-466e-98e9-6a095630f73a of volume 59fd6015-7e4e-47e3-b227-e60fcc8d19c7 {{(pid=83345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 10 13:17:21 devstack sudo[89407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:17:21 devstack sudo[89407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:21 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-37860960-a75e-4489-b4ad-2e231d5ad3dc tempest-VolumeSnapshotQuotasNegativeTestJSON-464202690 None] snapshot_file for this snap is: volume-59fd6015-7e4e-47e3-b227-e60fcc8d19c7.1bbd3734-129b-466e-98e9-6a095630f73a {{(pid=83345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 10 13:17:21 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9f21aa6-5304-464b-a63a-1d70a28925de]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:17:21 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-37860960-a75e-4489-b4ad-2e231d5ad3dc tempest-VolumeSnapshotQuotasNegativeTestJSON-464202690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-59fd6015-7e4e-47e3-b227-e60fcc8d19c7.1bbd3734-129b-466e-98e9-6a095630f73a {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:21 devstack sudo[89409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-59fd6015-7e4e-47e3-b227-e60fcc8d19c7.1bbd3734-129b-466e-98e9-6a095630f73a
Apr 10 13:17:21 devstack sudo[89409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:21 devstack sudo[89407]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:21 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-d967e7e9-7e58-4eb0-ac25-5cb1ddc05c72 tempest-VolumesSnapshotTestJSON-825888665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.427s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:21 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-d967e7e9-7e58-4eb0-ac25-5cb1ddc05c72 tempest-VolumesSnapshotTestJSON-825888665 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:17:21 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-d967e7e9-7e58-4eb0-ac25-5cb1ddc05c72 tempest-VolumesSnapshotTestJSON-825888665 None] Deleted volume successfully.
Apr 10 13:17:22 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-d967e7e9-7e58-4eb0-ac25-5cb1ddc05c72 tempest-VolumesSnapshotTestJSON-825888665 None] Lock "cinder-c50dafa0-5ef5-44b3-8d74-4e87989cecb7-delete_volume" released by "delete_volume" :: held 1.568s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:17:22 devstack sudo[89409]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:22 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-37860960-a75e-4489-b4ad-2e231d5ad3dc tempest-VolumeSnapshotQuotasNegativeTestJSON-464202690 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-59fd6015-7e4e-47e3-b227-e60fcc8d19c7.1bbd3734-129b-466e-98e9-6a095630f73a" returned: 0 in 0.513s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:22 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-37860960-a75e-4489-b4ad-2e231d5ad3dc tempest-VolumeSnapshotQuotasNegativeTestJSON-464202690 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-59fd6015-7e4e-47e3-b227-e60fcc8d19c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 13:17:22 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[e38a3a2b-9009-4957-bb17-cd9681f46968]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:17:22 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-37860960-a75e-4489-b4ad-2e231d5ad3dc tempest-VolumeSnapshotQuotasNegativeTestJSON-464202690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-59fd6015-7e4e-47e3-b227-e60fcc8d19c7 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:22 devstack sudo[89415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-59fd6015-7e4e-47e3-b227-e60fcc8d19c7
Apr 10 13:17:22 devstack sudo[89415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:22 devstack sudo[89415]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:22 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-37860960-a75e-4489-b4ad-2e231d5ad3dc tempest-VolumeSnapshotQuotasNegativeTestJSON-464202690 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-59fd6015-7e4e-47e3-b227-e60fcc8d19c7" returned: 0 in 0.494s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:22 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-37860960-a75e-4489-b4ad-2e231d5ad3dc tempest-VolumeSnapshotQuotasNegativeTestJSON-464202690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-59fd6015-7e4e-47e3-b227-e60fcc8d19c7.1bbd3734-129b-466e-98e9-6a095630f73a {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:22 devstack sudo[89421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-59fd6015-7e4e-47e3-b227-e60fcc8d19c7.1bbd3734-129b-466e-98e9-6a095630f73a
Apr 10 13:17:22 devstack sudo[89421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:23 devstack sudo[89421]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:23 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-37860960-a75e-4489-b4ad-2e231d5ad3dc tempest-VolumeSnapshotQuotasNegativeTestJSON-464202690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-59fd6015-7e4e-47e3-b227-e60fcc8d19c7.1bbd3734-129b-466e-98e9-6a095630f73a" returned: 0 in 0.443s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:23 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-37860960-a75e-4489-b4ad-2e231d5ad3dc tempest-VolumeSnapshotQuotasNegativeTestJSON-464202690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-59fd6015-7e4e-47e3-b227-e60fcc8d19c7.1bbd3734-129b-466e-98e9-6a095630f73a {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:23 devstack sudo[89427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-59fd6015-7e4e-47e3-b227-e60fcc8d19c7.1bbd3734-129b-466e-98e9-6a095630f73a
Apr 10 13:17:23 devstack sudo[89427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:23 devstack sudo[89427]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:23 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-37860960-a75e-4489-b4ad-2e231d5ad3dc tempest-VolumeSnapshotQuotasNegativeTestJSON-464202690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-59fd6015-7e4e-47e3-b227-e60fcc8d19c7.1bbd3734-129b-466e-98e9-6a095630f73a" returned: 0 in 0.435s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:23 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-37860960-a75e-4489-b4ad-2e231d5ad3dc tempest-VolumeSnapshotQuotasNegativeTestJSON-464202690 None] Lock "cinder-quobyte-1bbd3734-129b-466e-98e9-6a095630f73a" released by "_delete_snapshot" :: held 1.941s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:17:23 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-37860960-a75e-4489-b4ad-2e231d5ad3dc tempest-VolumeSnapshotQuotasNegativeTestJSON-464202690 None] Lock "cinder-quobyte-59fd6015-7e4e-47e3-b227-e60fcc8d19c7" released by "delete_snapshot" :: held 1.968s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:17:23 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-37860960-a75e-4489-b4ad-2e231d5ad3dc tempest-VolumeSnapshotQuotasNegativeTestJSON-464202690 None] Created reservations ['7a58704a-621c-448c-a4fc-25cd7b4e5c39', '3b57839c-29ad-409c-bd0b-1bec30607ee7', '7b47bb72-94aa-4ebf-98c1-728aaa7cf62b', 'a4b9ab62-b5a5-4272-b3c6-f9a1a6d854bc'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:17:23 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-37860960-a75e-4489-b4ad-2e231d5ad3dc tempest-VolumeSnapshotQuotasNegativeTestJSON-464202690 None] Delete snapshot completed successfully.
Apr 10 13:17:23 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-37860960-a75e-4489-b4ad-2e231d5ad3dc tempest-VolumeSnapshotQuotasNegativeTestJSON-464202690 None] Lock "cinder-1bbd3734-129b-466e-98e9-6a095630f73a-delete_snapshot" released by "delete_snapshot" :: held 2.075s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:17:24 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-bc40b221-d500-436f-9d56-0cf10d7acbed tempest-VolumeSnapshotQuotasNegativeTestJSON-464202690 None] Acquiring lock "cinder-59fd6015-7e4e-47e3-b227-e60fcc8d19c7-delete_volume" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:17:24 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-bc40b221-d500-436f-9d56-0cf10d7acbed tempest-VolumeSnapshotQuotasNegativeTestJSON-464202690 None] Lock "cinder-59fd6015-7e4e-47e3-b227-e60fcc8d19c7-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:17:24 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-bc40b221-d500-436f-9d56-0cf10d7acbed tempest-VolumeSnapshotQuotasNegativeTestJSON-464202690 None] Acquiring lock "cinder-quobyte-59fd6015-7e4e-47e3-b227-e60fcc8d19c7" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:17:24 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-bc40b221-d500-436f-9d56-0cf10d7acbed tempest-VolumeSnapshotQuotasNegativeTestJSON-464202690 None] Lock "cinder-quobyte-59fd6015-7e4e-47e3-b227-e60fcc8d19c7" acquired by "delete_volume" :: waited 0.008s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:17:24 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce0c6cf2-032a-4b30-9166-fd1e766a9d5f]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:17:24 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-bc40b221-d500-436f-9d56-0cf10d7acbed tempest-VolumeSnapshotQuotasNegativeTestJSON-464202690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-59fd6015-7e4e-47e3-b227-e60fcc8d19c7 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:24 devstack sudo[89431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-59fd6015-7e4e-47e3-b227-e60fcc8d19c7
Apr 10 13:17:24 devstack sudo[89431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:25 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec61735f-1eb3-420e-92ca-485e065177a7 tempest-CreateVolumesFromImageTest-1723038988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:17:25 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ec61735f-1eb3-420e-92ca-485e065177a7 tempest-CreateVolumesFromImageTest-1723038988 None] Flow 'volume_create_manager' (304cb824-b9bd-4ee0-b6f1-2024358f2b1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:17:25 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ec61735f-1eb3-420e-92ca-485e065177a7 tempest-CreateVolumesFromImageTest-1723038988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ccd7348-c9fc-4921-bd82-c5685c6517de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:17:25 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ec61735f-1eb3-420e-92ca-485e065177a7 tempest-CreateVolumesFromImageTest-1723038988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ccd7348-c9fc-4921-bd82-c5685c6517de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:17:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-91247654',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8879e81-223a-4036-8ba4-4746fde10901,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42eddf0227d84c19b012dfefe1c1c565',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:17:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:17:25Z,use_quota=True,user_id='7ef4dd14c22646bcab724fbaf996b84f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:17:25 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ec61735f-1eb3-420e-92ca-485e065177a7 tempest-CreateVolumesFromImageTest-1723038988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e647e55b-1bac-437a-a921-0b4743ce7daa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:17:25 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ec61735f-1eb3-420e-92ca-485e065177a7 tempest-CreateVolumesFromImageTest-1723038988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e647e55b-1bac-437a-a921-0b4743ce7daa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:17:25 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ec61735f-1eb3-420e-92ca-485e065177a7 tempest-CreateVolumesFromImageTest-1723038988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (893319e3-716c-43bb-aa52-93a11907fa51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:17:25 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ec61735f-1eb3-420e-92ca-485e065177a7 tempest-CreateVolumesFromImageTest-1723038988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (893319e3-716c-43bb-aa52-93a11907fa51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8879e81-223a-4036-8ba4-4746fde10901', 'volume_name': 'volume-e8879e81-223a-4036-8ba4-4746fde10901', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:17:25 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ec61735f-1eb3-420e-92ca-485e065177a7 tempest-CreateVolumesFromImageTest-1723038988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d6b988d-9977-492f-b76f-bc567c730e00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:17:25 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ec61735f-1eb3-420e-92ca-485e065177a7 tempest-CreateVolumesFromImageTest-1723038988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d6b988d-9977-492f-b76f-bc567c730e00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:17:25 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ec61735f-1eb3-420e-92ca-485e065177a7 tempest-CreateVolumesFromImageTest-1723038988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1279edb-3c05-44bc-be82-81be877dd226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:17:25 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-ec61735f-1eb3-420e-92ca-485e065177a7 tempest-CreateVolumesFromImageTest-1723038988 None] Volume e8879e81-223a-4036-8ba4-4746fde10901: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8879e81-223a-4036-8ba4-4746fde10901', 'volume_size': 1}
Apr 10 13:17:25 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-ec61735f-1eb3-420e-92ca-485e065177a7 tempest-CreateVolumesFromImageTest-1723038988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:17:25 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-ec61735f-1eb3-420e-92ca-485e065177a7 tempest-CreateVolumesFromImageTest-1723038988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:17:25 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-ec61735f-1eb3-420e-92ca-485e065177a7 tempest-CreateVolumesFromImageTest-1723038988 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f252bf08b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:17:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-91247654',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8879e81-223a-4036-8ba4-4746fde10901,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42eddf0227d84c19b012dfefe1c1c565',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:17:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:17:25Z,use_quota=True,user_id='7ef4dd14c22646bcab724fbaf996b84f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)}" {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 13:17:25 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-ec61735f-1eb3-420e-92ca-485e065177a7 tempest-CreateVolumesFromImageTest-1723038988 None] Creating volume e8879e81-223a-4036-8ba4-4746fde10901 {{(pid=83345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 13:17:25 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-ec61735f-1eb3-420e-92ca-485e065177a7 tempest-CreateVolumesFromImageTest-1723038988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:17:25 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-ec61735f-1eb3-420e-92ca-485e065177a7 tempest-CreateVolumesFromImageTest-1723038988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:17:25 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-ec61735f-1eb3-420e-92ca-485e065177a7 tempest-CreateVolumesFromImageTest-1723038988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:17:25 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-ec61735f-1eb3-420e-92ca-485e065177a7 tempest-CreateVolumesFromImageTest-1723038988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:17:25 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-ec61735f-1eb3-420e-92ca-485e065177a7 tempest-CreateVolumesFromImageTest-1723038988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:17:25 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-ec61735f-1eb3-420e-92ca-485e065177a7 tempest-CreateVolumesFromImageTest-1723038988 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:17:25 devstack cinder-volume[83345]: INFO cinder.volume.drivers.remotefs [None req-ec61735f-1eb3-420e-92ca-485e065177a7 tempest-CreateVolumesFromImageTest-1723038988 None] casted to osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331
Apr 10 13:17:25 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ec61735f-1eb3-420e-92ca-485e065177a7 tempest-CreateVolumesFromImageTest-1723038988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e8879e81-223a-4036-8ba4-4746fde10901 1073741824 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:25 devstack sudo[89431]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:25 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-bc40b221-d500-436f-9d56-0cf10d7acbed tempest-VolumeSnapshotQuotasNegativeTestJSON-464202690 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-59fd6015-7e4e-47e3-b227-e60fcc8d19c7" returned: 0 in 0.601s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:25 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-bc40b221-d500-436f-9d56-0cf10d7acbed tempest-VolumeSnapshotQuotasNegativeTestJSON-464202690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-59fd6015-7e4e-47e3-b227-e60fcc8d19c7 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:25 devstack sudo[89436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e8879e81-223a-4036-8ba4-4746fde10901 1073741824
Apr 10 13:17:25 devstack sudo[89436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:25 devstack sudo[89437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-59fd6015-7e4e-47e3-b227-e60fcc8d19c7
Apr 10 13:17:25 devstack sudo[89437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:25 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-92bacbcf-4edb-476e-a64d-a9fb378f9d5e tempest-CreateVolumesFromImageTest-1723038988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:17:25 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-92bacbcf-4edb-476e-a64d-a9fb378f9d5e tempest-CreateVolumesFromImageTest-1723038988 None] Flow 'volume_create_manager' (ad2f6df7-67a5-43e8-9fab-f9227bf7e8bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:17:25 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-92bacbcf-4edb-476e-a64d-a9fb378f9d5e tempest-CreateVolumesFromImageTest-1723038988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb83725c-62e4-45c8-b313-73b13d40077d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:17:25 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-92bacbcf-4edb-476e-a64d-a9fb378f9d5e tempest-CreateVolumesFromImageTest-1723038988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb83725c-62e4-45c8-b313-73b13d40077d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:17:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-828271097',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b75888a8-6a94-4f20-bbcd-09ef5fb3ce49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42eddf0227d84c19b012dfefe1c1c565',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:17:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:17:26Z,use_quota=True,user_id='7ef4dd14c22646bcab724fbaf996b84f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:17:25 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-92bacbcf-4edb-476e-a64d-a9fb378f9d5e tempest-CreateVolumesFromImageTest-1723038988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0f126cb-4f1b-4c38-8a05-0ccdc61e7c7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:17:25 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-92bacbcf-4edb-476e-a64d-a9fb378f9d5e tempest-CreateVolumesFromImageTest-1723038988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0f126cb-4f1b-4c38-8a05-0ccdc61e7c7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:17:25 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-92bacbcf-4edb-476e-a64d-a9fb378f9d5e tempest-CreateVolumesFromImageTest-1723038988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc6a4f38-6385-4b81-9d74-08a7be560d06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:17:25 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-92bacbcf-4edb-476e-a64d-a9fb378f9d5e tempest-CreateVolumesFromImageTest-1723038988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc6a4f38-6385-4b81-9d74-08a7be560d06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b75888a8-6a94-4f20-bbcd-09ef5fb3ce49', 'volume_name': 'volume-b75888a8-6a94-4f20-bbcd-09ef5fb3ce49', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:17:25 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-92bacbcf-4edb-476e-a64d-a9fb378f9d5e tempest-CreateVolumesFromImageTest-1723038988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb8fe975-9582-4b66-a18f-3867ed67d251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:17:25 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-92bacbcf-4edb-476e-a64d-a9fb378f9d5e tempest-CreateVolumesFromImageTest-1723038988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb8fe975-9582-4b66-a18f-3867ed67d251) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:17:25 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-92bacbcf-4edb-476e-a64d-a9fb378f9d5e tempest-CreateVolumesFromImageTest-1723038988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dab6974e-53ca-44c6-8a97-55238c206a4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:17:25 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-92bacbcf-4edb-476e-a64d-a9fb378f9d5e tempest-CreateVolumesFromImageTest-1723038988 None] Volume b75888a8-6a94-4f20-bbcd-09ef5fb3ce49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b75888a8-6a94-4f20-bbcd-09ef5fb3ce49', 'volume_size': 1}
Apr 10 13:17:25 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-92bacbcf-4edb-476e-a64d-a9fb378f9d5e tempest-CreateVolumesFromImageTest-1723038988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:17:25 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c2e283f-ac62-486a-8d72-c6eed55372ac tempest-CreateVolumesFromImageTest-1723038988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:17:25 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-9c2e283f-ac62-486a-8d72-c6eed55372ac tempest-CreateVolumesFromImageTest-1723038988 None] Flow 'volume_create_manager' (da943098-3c7a-4253-bd31-17d66615a448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:17:25 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-9c2e283f-ac62-486a-8d72-c6eed55372ac tempest-CreateVolumesFromImageTest-1723038988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9504984-cc48-4bb2-91e8-d732d65519be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:17:25 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-9c2e283f-ac62-486a-8d72-c6eed55372ac tempest-CreateVolumesFromImageTest-1723038988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9504984-cc48-4bb2-91e8-d732d65519be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:17:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1863878565',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c153ea3-8d91-454e-bc6f-d8f578249989,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42eddf0227d84c19b012dfefe1c1c565',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:17:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:17:26Z,use_quota=True,user_id='7ef4dd14c22646bcab724fbaf996b84f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:17:25 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-9c2e283f-ac62-486a-8d72-c6eed55372ac tempest-CreateVolumesFromImageTest-1723038988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7551dcd-5511-4238-b224-756d1c8326f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:17:25 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-9c2e283f-ac62-486a-8d72-c6eed55372ac tempest-CreateVolumesFromImageTest-1723038988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7551dcd-5511-4238-b224-756d1c8326f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:17:25 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-9c2e283f-ac62-486a-8d72-c6eed55372ac tempest-CreateVolumesFromImageTest-1723038988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a16e02cc-736d-455b-b527-36045202070d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:17:25 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-9c2e283f-ac62-486a-8d72-c6eed55372ac tempest-CreateVolumesFromImageTest-1723038988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a16e02cc-736d-455b-b527-36045202070d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c153ea3-8d91-454e-bc6f-d8f578249989', 'volume_name': 'volume-9c153ea3-8d91-454e-bc6f-d8f578249989', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:17:25 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-9c2e283f-ac62-486a-8d72-c6eed55372ac tempest-CreateVolumesFromImageTest-1723038988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66c6470e-e6d6-49e1-b6d2-1919b81c6313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:17:25 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-9c2e283f-ac62-486a-8d72-c6eed55372ac tempest-CreateVolumesFromImageTest-1723038988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66c6470e-e6d6-49e1-b6d2-1919b81c6313) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:17:25 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-9c2e283f-ac62-486a-8d72-c6eed55372ac tempest-CreateVolumesFromImageTest-1723038988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa65cf4d-b033-4390-b5f9-d5ec3b9367ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:17:25 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-9c2e283f-ac62-486a-8d72-c6eed55372ac tempest-CreateVolumesFromImageTest-1723038988 None] Volume 9c153ea3-8d91-454e-bc6f-d8f578249989: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c153ea3-8d91-454e-bc6f-d8f578249989', 'volume_size': 1}
Apr 10 13:17:25 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-9c2e283f-ac62-486a-8d72-c6eed55372ac tempest-CreateVolumesFromImageTest-1723038988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:17:25 devstack sudo[89436]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:25 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ec61735f-1eb3-420e-92ca-485e065177a7 tempest-CreateVolumesFromImageTest-1723038988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e8879e81-223a-4036-8ba4-4746fde10901 1073741824" returned: 0 in 0.558s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:25 devstack sudo[89437]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:25 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-bc40b221-d500-436f-9d56-0cf10d7acbed tempest-VolumeSnapshotQuotasNegativeTestJSON-464202690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-59fd6015-7e4e-47e3-b227-e60fcc8d19c7" returned: 0 in 0.557s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:25 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-bc40b221-d500-436f-9d56-0cf10d7acbed tempest-VolumeSnapshotQuotasNegativeTestJSON-464202690 None] Lock "cinder-quobyte-59fd6015-7e4e-47e3-b227-e60fcc8d19c7" released by "delete_volume" :: held 1.209s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:17:25 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-ece4d8a2-7f02-4a0e-aa66-5e38c284c1b1 tempest-CreateVolumesFromImageTest-1723038988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:17:26 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ece4d8a2-7f02-4a0e-aa66-5e38c284c1b1 tempest-CreateVolumesFromImageTest-1723038988 None] Flow 'volume_create_manager' (7eb956d5-7758-48de-ae4d-8dd3ed886867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:17:26 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ece4d8a2-7f02-4a0e-aa66-5e38c284c1b1 tempest-CreateVolumesFromImageTest-1723038988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (098017e1-1591-445b-bd10-1f9f5c2b3ae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:17:26 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ece4d8a2-7f02-4a0e-aa66-5e38c284c1b1 tempest-CreateVolumesFromImageTest-1723038988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (098017e1-1591-445b-bd10-1f9f5c2b3ae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:17:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1923623397',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a26051cb-cbb1-4400-bdc6-35b06a416554,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42eddf0227d84c19b012dfefe1c1c565',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:17:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:17:26Z,use_quota=True,user_id='7ef4dd14c22646bcab724fbaf996b84f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:17:26 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ece4d8a2-7f02-4a0e-aa66-5e38c284c1b1 tempest-CreateVolumesFromImageTest-1723038988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b0a3b25-1a32-40e5-9e5c-e16d209c1e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:17:26 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ece4d8a2-7f02-4a0e-aa66-5e38c284c1b1 tempest-CreateVolumesFromImageTest-1723038988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b0a3b25-1a32-40e5-9e5c-e16d209c1e15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:17:26 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ece4d8a2-7f02-4a0e-aa66-5e38c284c1b1 tempest-CreateVolumesFromImageTest-1723038988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (484b0082-75de-455a-89cd-badc804703eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:17:26 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ece4d8a2-7f02-4a0e-aa66-5e38c284c1b1 tempest-CreateVolumesFromImageTest-1723038988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (484b0082-75de-455a-89cd-badc804703eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a26051cb-cbb1-4400-bdc6-35b06a416554', 'volume_name': 'volume-a26051cb-cbb1-4400-bdc6-35b06a416554', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:17:26 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ece4d8a2-7f02-4a0e-aa66-5e38c284c1b1 tempest-CreateVolumesFromImageTest-1723038988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b0216ab-105f-416e-b1ae-5ac13e121472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:17:26 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ece4d8a2-7f02-4a0e-aa66-5e38c284c1b1 tempest-CreateVolumesFromImageTest-1723038988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b0216ab-105f-416e-b1ae-5ac13e121472) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:17:26 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ece4d8a2-7f02-4a0e-aa66-5e38c284c1b1 tempest-CreateVolumesFromImageTest-1723038988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e21eb5d4-3101-4f85-af0e-2fe6dd09d94f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:17:26 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-ece4d8a2-7f02-4a0e-aa66-5e38c284c1b1 tempest-CreateVolumesFromImageTest-1723038988 None] Volume a26051cb-cbb1-4400-bdc6-35b06a416554: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a26051cb-cbb1-4400-bdc6-35b06a416554', 'volume_size': 1}
Apr 10 13:17:26 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-ece4d8a2-7f02-4a0e-aa66-5e38c284c1b1 tempest-CreateVolumesFromImageTest-1723038988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:17:26 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ec61735f-1eb3-420e-92ca-485e065177a7 tempest-CreateVolumesFromImageTest-1723038988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e8879e81-223a-4036-8ba4-4746fde10901 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:26 devstack sudo[89444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e8879e81-223a-4036-8ba4-4746fde10901
Apr 10 13:17:26 devstack sudo[89444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:26 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-bc40b221-d500-436f-9d56-0cf10d7acbed tempest-VolumeSnapshotQuotasNegativeTestJSON-464202690 None] Created reservations ['85797dd4-4f79-49bd-a8c6-2fad16abbcd4', '0e1c117d-a4dc-45af-99fa-b4987256e91c', '2fe9e459-9bf4-439b-9d1e-e2c6c93aa718', 'b3281ff3-24b6-4bb1-aa50-0c64ecf17440'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:17:26 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-bc40b221-d500-436f-9d56-0cf10d7acbed tempest-VolumeSnapshotQuotasNegativeTestJSON-464202690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:17:26 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-bc40b221-d500-436f-9d56-0cf10d7acbed tempest-VolumeSnapshotQuotasNegativeTestJSON-464202690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:17:26 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-bc40b221-d500-436f-9d56-0cf10d7acbed tempest-VolumeSnapshotQuotasNegativeTestJSON-464202690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:17:26 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-bc40b221-d500-436f-9d56-0cf10d7acbed tempest-VolumeSnapshotQuotasNegativeTestJSON-464202690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:17:26 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-bc40b221-d500-436f-9d56-0cf10d7acbed tempest-VolumeSnapshotQuotasNegativeTestJSON-464202690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:17:26 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-bc40b221-d500-436f-9d56-0cf10d7acbed tempest-VolumeSnapshotQuotasNegativeTestJSON-464202690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:26 devstack sudo[89446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:17:26 devstack sudo[89446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:26 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b6f5396-67a7-48ed-bbe6-91b2715d4126 tempest-CreateVolumesFromImageTest-1723038988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:17:26 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-6b6f5396-67a7-48ed-bbe6-91b2715d4126 tempest-CreateVolumesFromImageTest-1723038988 None] Flow 'volume_create_manager' (c16764a8-5612-4f99-8d67-69e00f784efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:17:26 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-6b6f5396-67a7-48ed-bbe6-91b2715d4126 tempest-CreateVolumesFromImageTest-1723038988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85a6d85b-9c2e-49e1-ad4c-b092d52cb7d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:17:26 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-6b6f5396-67a7-48ed-bbe6-91b2715d4126 tempest-CreateVolumesFromImageTest-1723038988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85a6d85b-9c2e-49e1-ad4c-b092d52cb7d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:17:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1843436803',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41ed07fd-1f9e-48f0-9a0c-9d2d1fe103ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42eddf0227d84c19b012dfefe1c1c565',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:17:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:17:26Z,use_quota=True,user_id='7ef4dd14c22646bcab724fbaf996b84f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:17:26 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-6b6f5396-67a7-48ed-bbe6-91b2715d4126 tempest-CreateVolumesFromImageTest-1723038988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7e51e05-0ece-4985-b970-ae3b30fb2507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:17:26 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-6b6f5396-67a7-48ed-bbe6-91b2715d4126 tempest-CreateVolumesFromImageTest-1723038988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7e51e05-0ece-4985-b970-ae3b30fb2507) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:17:26 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-6b6f5396-67a7-48ed-bbe6-91b2715d4126 tempest-CreateVolumesFromImageTest-1723038988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2001790b-5328-49b2-a76b-5bb6eb082fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:17:26 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-6b6f5396-67a7-48ed-bbe6-91b2715d4126 tempest-CreateVolumesFromImageTest-1723038988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2001790b-5328-49b2-a76b-5bb6eb082fb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41ed07fd-1f9e-48f0-9a0c-9d2d1fe103ba', 'volume_name': 'volume-41ed07fd-1f9e-48f0-9a0c-9d2d1fe103ba', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:17:26 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-6b6f5396-67a7-48ed-bbe6-91b2715d4126 tempest-CreateVolumesFromImageTest-1723038988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ab8f361-09bc-4073-860e-0046681fecbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:17:26 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-6b6f5396-67a7-48ed-bbe6-91b2715d4126 tempest-CreateVolumesFromImageTest-1723038988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ab8f361-09bc-4073-860e-0046681fecbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:17:26 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-6b6f5396-67a7-48ed-bbe6-91b2715d4126 tempest-CreateVolumesFromImageTest-1723038988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e1142d0-73aa-4c98-a8e3-80e27e2ce8bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:17:26 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-6b6f5396-67a7-48ed-bbe6-91b2715d4126 tempest-CreateVolumesFromImageTest-1723038988 None] Volume 41ed07fd-1f9e-48f0-9a0c-9d2d1fe103ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41ed07fd-1f9e-48f0-9a0c-9d2d1fe103ba', 'volume_size': 1}
Apr 10 13:17:26 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-6b6f5396-67a7-48ed-bbe6-91b2715d4126 tempest-CreateVolumesFromImageTest-1723038988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:17:26 devstack sudo[89444]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:26 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ec61735f-1eb3-420e-92ca-485e065177a7 tempest-CreateVolumesFromImageTest-1723038988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e8879e81-223a-4036-8ba4-4746fde10901" returned: 0 in 0.427s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:26 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-ec61735f-1eb3-420e-92ca-485e065177a7 tempest-CreateVolumesFromImageTest-1723038988 None] <== create_volume: return (1125ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'} {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 13:17:26 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-ec61735f-1eb3-420e-92ca-485e065177a7 tempest-CreateVolumesFromImageTest-1723038988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.127s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:17:26 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-92bacbcf-4edb-476e-a64d-a9fb378f9d5e tempest-CreateVolumesFromImageTest-1723038988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.892s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:17:26 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-92bacbcf-4edb-476e-a64d-a9fb378f9d5e tempest-CreateVolumesFromImageTest-1723038988 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f252bf08b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:17:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-828271097',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b75888a8-6a94-4f20-bbcd-09ef5fb3ce49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42eddf0227d84c19b012dfefe1c1c565',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:17:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:17:26Z,use_quota=True,user_id='7ef4dd14c22646bcab724fbaf996b84f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)}" {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 13:17:26 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-92bacbcf-4edb-476e-a64d-a9fb378f9d5e tempest-CreateVolumesFromImageTest-1723038988 None] Creating volume b75888a8-6a94-4f20-bbcd-09ef5fb3ce49 {{(pid=83345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 13:17:26 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-92bacbcf-4edb-476e-a64d-a9fb378f9d5e tempest-CreateVolumesFromImageTest-1723038988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:17:26 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-92bacbcf-4edb-476e-a64d-a9fb378f9d5e tempest-CreateVolumesFromImageTest-1723038988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:17:26 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-92bacbcf-4edb-476e-a64d-a9fb378f9d5e tempest-CreateVolumesFromImageTest-1723038988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:17:26 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-92bacbcf-4edb-476e-a64d-a9fb378f9d5e tempest-CreateVolumesFromImageTest-1723038988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:17:26 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-92bacbcf-4edb-476e-a64d-a9fb378f9d5e tempest-CreateVolumesFromImageTest-1723038988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:17:26 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-92bacbcf-4edb-476e-a64d-a9fb378f9d5e tempest-CreateVolumesFromImageTest-1723038988 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:17:26 devstack cinder-volume[83345]: INFO cinder.volume.drivers.remotefs [None req-92bacbcf-4edb-476e-a64d-a9fb378f9d5e tempest-CreateVolumesFromImageTest-1723038988 None] casted to osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331
Apr 10 13:17:26 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-92bacbcf-4edb-476e-a64d-a9fb378f9d5e tempest-CreateVolumesFromImageTest-1723038988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b75888a8-6a94-4f20-bbcd-09ef5fb3ce49 1073741824 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:26 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ec61735f-1eb3-420e-92ca-485e065177a7 tempest-CreateVolumesFromImageTest-1723038988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1279edb-3c05-44bc-be82-81be877dd226) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8879e81-223a-4036-8ba4-4746fde10901', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:17:26 devstack sudo[89449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b75888a8-6a94-4f20-bbcd-09ef5fb3ce49 1073741824
Apr 10 13:17:26 devstack sudo[89449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:26 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ec61735f-1eb3-420e-92ca-485e065177a7 tempest-CreateVolumesFromImageTest-1723038988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3911c20-25ed-43c6-8593-12763656b707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:17:26 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-ec61735f-1eb3-420e-92ca-485e065177a7 tempest-CreateVolumesFromImageTest-1723038988 None] Volume volume-e8879e81-223a-4036-8ba4-4746fde10901 (e8879e81-223a-4036-8ba4-4746fde10901): created successfully
Apr 10 13:17:26 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ec61735f-1eb3-420e-92ca-485e065177a7 tempest-CreateVolumesFromImageTest-1723038988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3911c20-25ed-43c6-8593-12763656b707) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:17:26 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ec61735f-1eb3-420e-92ca-485e065177a7 tempest-CreateVolumesFromImageTest-1723038988 None] Flow 'volume_create_manager' (304cb824-b9bd-4ee0-b6f1-2024358f2b1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:17:26 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-ec61735f-1eb3-420e-92ca-485e065177a7 tempest-CreateVolumesFromImageTest-1723038988 None] Created volume successfully.
Apr 10 13:17:26 devstack sudo[89446]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:26 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-bc40b221-d500-436f-9d56-0cf10d7acbed tempest-VolumeSnapshotQuotasNegativeTestJSON-464202690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.465s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:26 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-bc40b221-d500-436f-9d56-0cf10d7acbed tempest-VolumeSnapshotQuotasNegativeTestJSON-464202690 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:17:26 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-bc40b221-d500-436f-9d56-0cf10d7acbed tempest-VolumeSnapshotQuotasNegativeTestJSON-464202690 None] Deleted volume successfully.
Apr 10 13:17:26 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-bc40b221-d500-436f-9d56-0cf10d7acbed tempest-VolumeSnapshotQuotasNegativeTestJSON-464202690 None] Lock "cinder-59fd6015-7e4e-47e3-b227-e60fcc8d19c7-delete_volume" released by "delete_volume" :: held 1.918s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:17:26 devstack sudo[89449]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:26 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-92bacbcf-4edb-476e-a64d-a9fb378f9d5e tempest-CreateVolumesFromImageTest-1723038988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b75888a8-6a94-4f20-bbcd-09ef5fb3ce49 1073741824" returned: 0 in 0.497s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:27 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-92bacbcf-4edb-476e-a64d-a9fb378f9d5e tempest-CreateVolumesFromImageTest-1723038988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b75888a8-6a94-4f20-bbcd-09ef5fb3ce49 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:27 devstack sudo[89455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b75888a8-6a94-4f20-bbcd-09ef5fb3ce49
Apr 10 13:17:27 devstack sudo[89455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:27 devstack sudo[89455]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:27 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-92bacbcf-4edb-476e-a64d-a9fb378f9d5e tempest-CreateVolumesFromImageTest-1723038988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b75888a8-6a94-4f20-bbcd-09ef5fb3ce49" returned: 0 in 0.483s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:27 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-92bacbcf-4edb-476e-a64d-a9fb378f9d5e tempest-CreateVolumesFromImageTest-1723038988 None] <== create_volume: return (1005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'} {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 13:17:27 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-92bacbcf-4edb-476e-a64d-a9fb378f9d5e tempest-CreateVolumesFromImageTest-1723038988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.008s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:17:27 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-9c2e283f-ac62-486a-8d72-c6eed55372ac tempest-CreateVolumesFromImageTest-1723038988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.731s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:17:27 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-9c2e283f-ac62-486a-8d72-c6eed55372ac tempest-CreateVolumesFromImageTest-1723038988 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f252bf08b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:17:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1863878565',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c153ea3-8d91-454e-bc6f-d8f578249989,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42eddf0227d84c19b012dfefe1c1c565',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:17:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:17:26Z,use_quota=True,user_id='7ef4dd14c22646bcab724fbaf996b84f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)}" {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 13:17:27 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-9c2e283f-ac62-486a-8d72-c6eed55372ac tempest-CreateVolumesFromImageTest-1723038988 None] Creating volume 9c153ea3-8d91-454e-bc6f-d8f578249989 {{(pid=83345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 13:17:27 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-9c2e283f-ac62-486a-8d72-c6eed55372ac tempest-CreateVolumesFromImageTest-1723038988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:17:27 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-9c2e283f-ac62-486a-8d72-c6eed55372ac tempest-CreateVolumesFromImageTest-1723038988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:17:27 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-9c2e283f-ac62-486a-8d72-c6eed55372ac tempest-CreateVolumesFromImageTest-1723038988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:17:27 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-9c2e283f-ac62-486a-8d72-c6eed55372ac tempest-CreateVolumesFromImageTest-1723038988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:17:27 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-9c2e283f-ac62-486a-8d72-c6eed55372ac tempest-CreateVolumesFromImageTest-1723038988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:17:27 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-9c2e283f-ac62-486a-8d72-c6eed55372ac tempest-CreateVolumesFromImageTest-1723038988 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:17:27 devstack cinder-volume[83345]: INFO cinder.volume.drivers.remotefs [None req-9c2e283f-ac62-486a-8d72-c6eed55372ac tempest-CreateVolumesFromImageTest-1723038988 None] casted to osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331
Apr 10 13:17:27 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-9c2e283f-ac62-486a-8d72-c6eed55372ac tempest-CreateVolumesFromImageTest-1723038988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-9c153ea3-8d91-454e-bc6f-d8f578249989 1073741824 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:27 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-92bacbcf-4edb-476e-a64d-a9fb378f9d5e tempest-CreateVolumesFromImageTest-1723038988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dab6974e-53ca-44c6-8a97-55238c206a4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b75888a8-6a94-4f20-bbcd-09ef5fb3ce49', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:17:27 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-92bacbcf-4edb-476e-a64d-a9fb378f9d5e tempest-CreateVolumesFromImageTest-1723038988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c8c91f2-1ad0-4139-b14b-099e8a8f5009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:17:27 devstack sudo[89458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-9c153ea3-8d91-454e-bc6f-d8f578249989 1073741824
Apr 10 13:17:27 devstack sudo[89458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:27 devstack cinder-volume[83345]: DEBUG dbcounter [-] [83345] Writing DB stats cinder:SELECT=195,cinder:INSERT=62,cinder:UPDATE=228,cinder:DELETE=22 {{(pid=83345) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 10 13:17:27 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-92bacbcf-4edb-476e-a64d-a9fb378f9d5e tempest-CreateVolumesFromImageTest-1723038988 None] Volume volume-b75888a8-6a94-4f20-bbcd-09ef5fb3ce49 (b75888a8-6a94-4f20-bbcd-09ef5fb3ce49): created successfully
Apr 10 13:17:27 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-92bacbcf-4edb-476e-a64d-a9fb378f9d5e tempest-CreateVolumesFromImageTest-1723038988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c8c91f2-1ad0-4139-b14b-099e8a8f5009) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:17:27 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-92bacbcf-4edb-476e-a64d-a9fb378f9d5e tempest-CreateVolumesFromImageTest-1723038988 None] Flow 'volume_create_manager' (ad2f6df7-67a5-43e8-9fab-f9227bf7e8bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:17:27 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-92bacbcf-4edb-476e-a64d-a9fb378f9d5e tempest-CreateVolumesFromImageTest-1723038988 None] Created volume successfully.
Apr 10 13:17:28 devstack sudo[89458]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:28 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-9c2e283f-ac62-486a-8d72-c6eed55372ac tempest-CreateVolumesFromImageTest-1723038988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-9c153ea3-8d91-454e-bc6f-d8f578249989 1073741824" returned: 0 in 0.563s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:28 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-9c2e283f-ac62-486a-8d72-c6eed55372ac tempest-CreateVolumesFromImageTest-1723038988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-9c153ea3-8d91-454e-bc6f-d8f578249989 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:28 devstack sudo[89463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-9c153ea3-8d91-454e-bc6f-d8f578249989
Apr 10 13:17:28 devstack sudo[89463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:28 devstack sudo[89463]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:28 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-9c2e283f-ac62-486a-8d72-c6eed55372ac tempest-CreateVolumesFromImageTest-1723038988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-9c153ea3-8d91-454e-bc6f-d8f578249989" returned: 0 in 0.465s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:28 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-9c2e283f-ac62-486a-8d72-c6eed55372ac tempest-CreateVolumesFromImageTest-1723038988 None] <== create_volume: return (1064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'} {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 13:17:28 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-9c2e283f-ac62-486a-8d72-c6eed55372ac tempest-CreateVolumesFromImageTest-1723038988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.068s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:17:28 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-ece4d8a2-7f02-4a0e-aa66-5e38c284c1b1 tempest-CreateVolumesFromImageTest-1723038988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.521s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:17:28 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-ece4d8a2-7f02-4a0e-aa66-5e38c284c1b1 tempest-CreateVolumesFromImageTest-1723038988 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f252bf08b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:17:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1923623397',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a26051cb-cbb1-4400-bdc6-35b06a416554,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42eddf0227d84c19b012dfefe1c1c565',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:17:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:17:26Z,use_quota=True,user_id='7ef4dd14c22646bcab724fbaf996b84f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)}" {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 13:17:28 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-ece4d8a2-7f02-4a0e-aa66-5e38c284c1b1 tempest-CreateVolumesFromImageTest-1723038988 None] Creating volume a26051cb-cbb1-4400-bdc6-35b06a416554 {{(pid=83345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 13:17:28 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-ece4d8a2-7f02-4a0e-aa66-5e38c284c1b1 tempest-CreateVolumesFromImageTest-1723038988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:17:28 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-ece4d8a2-7f02-4a0e-aa66-5e38c284c1b1 tempest-CreateVolumesFromImageTest-1723038988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:17:28 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-ece4d8a2-7f02-4a0e-aa66-5e38c284c1b1 tempest-CreateVolumesFromImageTest-1723038988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:17:28 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-ece4d8a2-7f02-4a0e-aa66-5e38c284c1b1 tempest-CreateVolumesFromImageTest-1723038988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:17:28 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-ece4d8a2-7f02-4a0e-aa66-5e38c284c1b1 tempest-CreateVolumesFromImageTest-1723038988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:17:28 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-ece4d8a2-7f02-4a0e-aa66-5e38c284c1b1 tempest-CreateVolumesFromImageTest-1723038988 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:17:28 devstack cinder-volume[83345]: INFO cinder.volume.drivers.remotefs [None req-ece4d8a2-7f02-4a0e-aa66-5e38c284c1b1 tempest-CreateVolumesFromImageTest-1723038988 None] casted to osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331
Apr 10 13:17:28 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ece4d8a2-7f02-4a0e-aa66-5e38c284c1b1 tempest-CreateVolumesFromImageTest-1723038988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-a26051cb-cbb1-4400-bdc6-35b06a416554 1073741824 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:28 devstack sudo[89500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-a26051cb-cbb1-4400-bdc6-35b06a416554 1073741824
Apr 10 13:17:28 devstack sudo[89500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:28 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-9c2e283f-ac62-486a-8d72-c6eed55372ac tempest-CreateVolumesFromImageTest-1723038988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa65cf4d-b033-4390-b5f9-d5ec3b9367ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c153ea3-8d91-454e-bc6f-d8f578249989', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:17:28 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-9c2e283f-ac62-486a-8d72-c6eed55372ac tempest-CreateVolumesFromImageTest-1723038988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b77fa795-0f97-40aa-bfa9-637144f2768e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:17:28 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-9c2e283f-ac62-486a-8d72-c6eed55372ac tempest-CreateVolumesFromImageTest-1723038988 None] Volume volume-9c153ea3-8d91-454e-bc6f-d8f578249989 (9c153ea3-8d91-454e-bc6f-d8f578249989): created successfully
Apr 10 13:17:28 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-9c2e283f-ac62-486a-8d72-c6eed55372ac tempest-CreateVolumesFromImageTest-1723038988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b77fa795-0f97-40aa-bfa9-637144f2768e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:17:28 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-9c2e283f-ac62-486a-8d72-c6eed55372ac tempest-CreateVolumesFromImageTest-1723038988 None] Flow 'volume_create_manager' (da943098-3c7a-4253-bd31-17d66615a448) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:17:28 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-9c2e283f-ac62-486a-8d72-c6eed55372ac tempest-CreateVolumesFromImageTest-1723038988 None] Created volume successfully.
Apr 10 13:17:29 devstack sudo[89500]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:29 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ece4d8a2-7f02-4a0e-aa66-5e38c284c1b1 tempest-CreateVolumesFromImageTest-1723038988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-a26051cb-cbb1-4400-bdc6-35b06a416554 1073741824" returned: 0 in 0.496s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:29 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ece4d8a2-7f02-4a0e-aa66-5e38c284c1b1 tempest-CreateVolumesFromImageTest-1723038988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-a26051cb-cbb1-4400-bdc6-35b06a416554 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:29 devstack sudo[89505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-a26051cb-cbb1-4400-bdc6-35b06a416554
Apr 10 13:17:29 devstack sudo[89505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:29 devstack sudo[89505]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:29 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ece4d8a2-7f02-4a0e-aa66-5e38c284c1b1 tempest-CreateVolumesFromImageTest-1723038988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-a26051cb-cbb1-4400-bdc6-35b06a416554" returned: 0 in 0.445s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:29 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-ece4d8a2-7f02-4a0e-aa66-5e38c284c1b1 tempest-CreateVolumesFromImageTest-1723038988 None] <== create_volume: return (966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'} {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 13:17:29 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-ece4d8a2-7f02-4a0e-aa66-5e38c284c1b1 tempest-CreateVolumesFromImageTest-1723038988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.968s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:17:29 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-6b6f5396-67a7-48ed-bbe6-91b2715d4126 tempest-CreateVolumesFromImageTest-1723038988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.287s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:17:29 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-6b6f5396-67a7-48ed-bbe6-91b2715d4126 tempest-CreateVolumesFromImageTest-1723038988 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f252bf08b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:17:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1843436803',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41ed07fd-1f9e-48f0-9a0c-9d2d1fe103ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42eddf0227d84c19b012dfefe1c1c565',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:17:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:17:26Z,use_quota=True,user_id='7ef4dd14c22646bcab724fbaf996b84f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)}" {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 13:17:29 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-6b6f5396-67a7-48ed-bbe6-91b2715d4126 tempest-CreateVolumesFromImageTest-1723038988 None] Creating volume 41ed07fd-1f9e-48f0-9a0c-9d2d1fe103ba {{(pid=83345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 13:17:29 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-6b6f5396-67a7-48ed-bbe6-91b2715d4126 tempest-CreateVolumesFromImageTest-1723038988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:17:29 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-6b6f5396-67a7-48ed-bbe6-91b2715d4126 tempest-CreateVolumesFromImageTest-1723038988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:17:29 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-6b6f5396-67a7-48ed-bbe6-91b2715d4126 tempest-CreateVolumesFromImageTest-1723038988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:17:29 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-6b6f5396-67a7-48ed-bbe6-91b2715d4126 tempest-CreateVolumesFromImageTest-1723038988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:17:29 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-6b6f5396-67a7-48ed-bbe6-91b2715d4126 tempest-CreateVolumesFromImageTest-1723038988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:17:29 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-6b6f5396-67a7-48ed-bbe6-91b2715d4126 tempest-CreateVolumesFromImageTest-1723038988 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:17:29 devstack cinder-volume[83345]: INFO cinder.volume.drivers.remotefs [None req-6b6f5396-67a7-48ed-bbe6-91b2715d4126 tempest-CreateVolumesFromImageTest-1723038988 None] casted to osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331
Apr 10 13:17:29 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-6b6f5396-67a7-48ed-bbe6-91b2715d4126 tempest-CreateVolumesFromImageTest-1723038988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-41ed07fd-1f9e-48f0-9a0c-9d2d1fe103ba 1073741824 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:29 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ece4d8a2-7f02-4a0e-aa66-5e38c284c1b1 tempest-CreateVolumesFromImageTest-1723038988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e21eb5d4-3101-4f85-af0e-2fe6dd09d94f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a26051cb-cbb1-4400-bdc6-35b06a416554', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:17:29 devstack sudo[89508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-41ed07fd-1f9e-48f0-9a0c-9d2d1fe103ba 1073741824
Apr 10 13:17:29 devstack sudo[89508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:29 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ece4d8a2-7f02-4a0e-aa66-5e38c284c1b1 tempest-CreateVolumesFromImageTest-1723038988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b256bc52-08b3-4922-808e-a940b2335ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:17:29 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-ece4d8a2-7f02-4a0e-aa66-5e38c284c1b1 tempest-CreateVolumesFromImageTest-1723038988 None] Volume volume-a26051cb-cbb1-4400-bdc6-35b06a416554 (a26051cb-cbb1-4400-bdc6-35b06a416554): created successfully
Apr 10 13:17:29 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ece4d8a2-7f02-4a0e-aa66-5e38c284c1b1 tempest-CreateVolumesFromImageTest-1723038988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b256bc52-08b3-4922-808e-a940b2335ceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:17:29 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ece4d8a2-7f02-4a0e-aa66-5e38c284c1b1 tempest-CreateVolumesFromImageTest-1723038988 None] Flow 'volume_create_manager' (7eb956d5-7758-48de-ae4d-8dd3ed886867) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:17:29 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-ece4d8a2-7f02-4a0e-aa66-5e38c284c1b1 tempest-CreateVolumesFromImageTest-1723038988 None] Created volume successfully.
Apr 10 13:17:30 devstack sudo[89508]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:30 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-6b6f5396-67a7-48ed-bbe6-91b2715d4126 tempest-CreateVolumesFromImageTest-1723038988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-41ed07fd-1f9e-48f0-9a0c-9d2d1fe103ba 1073741824" returned: 0 in 0.550s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:30 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-6b6f5396-67a7-48ed-bbe6-91b2715d4126 tempest-CreateVolumesFromImageTest-1723038988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-41ed07fd-1f9e-48f0-9a0c-9d2d1fe103ba {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:30 devstack sudo[89513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-41ed07fd-1f9e-48f0-9a0c-9d2d1fe103ba
Apr 10 13:17:30 devstack sudo[89513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:30 devstack sudo[89513]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:30 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-6b6f5396-67a7-48ed-bbe6-91b2715d4126 tempest-CreateVolumesFromImageTest-1723038988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-41ed07fd-1f9e-48f0-9a0c-9d2d1fe103ba" returned: 0 in 0.530s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:30 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-6b6f5396-67a7-48ed-bbe6-91b2715d4126 tempest-CreateVolumesFromImageTest-1723038988 None] <== create_volume: return (1106ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'} {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 13:17:30 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-6b6f5396-67a7-48ed-bbe6-91b2715d4126 tempest-CreateVolumesFromImageTest-1723038988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.109s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:17:30 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-6b6f5396-67a7-48ed-bbe6-91b2715d4126 tempest-CreateVolumesFromImageTest-1723038988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e1142d0-73aa-4c98-a8e3-80e27e2ce8bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41ed07fd-1f9e-48f0-9a0c-9d2d1fe103ba', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:17:30 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-6b6f5396-67a7-48ed-bbe6-91b2715d4126 tempest-CreateVolumesFromImageTest-1723038988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a025c70-77b5-4ae4-8107-0654020973cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:17:30 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-6b6f5396-67a7-48ed-bbe6-91b2715d4126 tempest-CreateVolumesFromImageTest-1723038988 None] Volume volume-41ed07fd-1f9e-48f0-9a0c-9d2d1fe103ba (41ed07fd-1f9e-48f0-9a0c-9d2d1fe103ba): created successfully
Apr 10 13:17:30 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-6b6f5396-67a7-48ed-bbe6-91b2715d4126 tempest-CreateVolumesFromImageTest-1723038988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a025c70-77b5-4ae4-8107-0654020973cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:17:30 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-6b6f5396-67a7-48ed-bbe6-91b2715d4126 tempest-CreateVolumesFromImageTest-1723038988 None] Flow 'volume_create_manager' (c16764a8-5612-4f99-8d67-69e00f784efc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:17:30 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-6b6f5396-67a7-48ed-bbe6-91b2715d4126 tempest-CreateVolumesFromImageTest-1723038988 None] Created volume successfully.
Apr 10 13:17:31 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-48370b11-2eb5-43a6-83b2-1c6991e16d60 tempest-CreateVolumesFromImageTest-1723038988 None] Acquiring lock "cinder-41ed07fd-1f9e-48f0-9a0c-9d2d1fe103ba-delete_volume" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:17:31 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-48370b11-2eb5-43a6-83b2-1c6991e16d60 tempest-CreateVolumesFromImageTest-1723038988 None] Lock "cinder-41ed07fd-1f9e-48f0-9a0c-9d2d1fe103ba-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:17:31 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-48370b11-2eb5-43a6-83b2-1c6991e16d60 tempest-CreateVolumesFromImageTest-1723038988 None] Acquiring lock "cinder-quobyte-41ed07fd-1f9e-48f0-9a0c-9d2d1fe103ba" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:17:31 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-48370b11-2eb5-43a6-83b2-1c6991e16d60 tempest-CreateVolumesFromImageTest-1723038988 None] Lock "cinder-quobyte-41ed07fd-1f9e-48f0-9a0c-9d2d1fe103ba" acquired by "delete_volume" :: waited 0.009s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:17:31 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[9651b078-2174-494c-8265-e4bd436503ce]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:17:31 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-48370b11-2eb5-43a6-83b2-1c6991e16d60 tempest-CreateVolumesFromImageTest-1723038988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-41ed07fd-1f9e-48f0-9a0c-9d2d1fe103ba {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:31 devstack sudo[89517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-41ed07fd-1f9e-48f0-9a0c-9d2d1fe103ba
Apr 10 13:17:31 devstack sudo[89517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:32 devstack sudo[89517]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:32 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-48370b11-2eb5-43a6-83b2-1c6991e16d60 tempest-CreateVolumesFromImageTest-1723038988 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-41ed07fd-1f9e-48f0-9a0c-9d2d1fe103ba" returned: 0 in 0.553s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:32 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-48370b11-2eb5-43a6-83b2-1c6991e16d60 tempest-CreateVolumesFromImageTest-1723038988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-41ed07fd-1f9e-48f0-9a0c-9d2d1fe103ba {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:32 devstack sudo[89522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-41ed07fd-1f9e-48f0-9a0c-9d2d1fe103ba
Apr 10 13:17:32 devstack sudo[89522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:32 devstack sudo[89522]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:32 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-48370b11-2eb5-43a6-83b2-1c6991e16d60 tempest-CreateVolumesFromImageTest-1723038988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-41ed07fd-1f9e-48f0-9a0c-9d2d1fe103ba" returned: 0 in 0.450s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:32 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-48370b11-2eb5-43a6-83b2-1c6991e16d60 tempest-CreateVolumesFromImageTest-1723038988 None] Lock "cinder-quobyte-41ed07fd-1f9e-48f0-9a0c-9d2d1fe103ba" released by "delete_volume" :: held 1.037s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:17:32 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-48370b11-2eb5-43a6-83b2-1c6991e16d60 tempest-CreateVolumesFromImageTest-1723038988 None] Created reservations ['331d120a-2182-4e17-9a65-f99f75bdd7d8', '2704518f-2b77-45e5-b7b4-8cf13ce660f2', '22969175-ed52-4ba9-9668-0534cdce13f1', '0554da28-8c8d-4d58-b456-bb70e9935dbd'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:17:32 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-48370b11-2eb5-43a6-83b2-1c6991e16d60 tempest-CreateVolumesFromImageTest-1723038988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:17:32 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-48370b11-2eb5-43a6-83b2-1c6991e16d60 tempest-CreateVolumesFromImageTest-1723038988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:17:32 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-48370b11-2eb5-43a6-83b2-1c6991e16d60 tempest-CreateVolumesFromImageTest-1723038988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:17:32 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-48370b11-2eb5-43a6-83b2-1c6991e16d60 tempest-CreateVolumesFromImageTest-1723038988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:17:32 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-48370b11-2eb5-43a6-83b2-1c6991e16d60 tempest-CreateVolumesFromImageTest-1723038988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:17:32 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-48370b11-2eb5-43a6-83b2-1c6991e16d60 tempest-CreateVolumesFromImageTest-1723038988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:32 devstack sudo[89525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:17:32 devstack sudo[89525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:33 devstack sudo[89525]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:33 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-48370b11-2eb5-43a6-83b2-1c6991e16d60 tempest-CreateVolumesFromImageTest-1723038988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.461s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:33 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-48370b11-2eb5-43a6-83b2-1c6991e16d60 tempest-CreateVolumesFromImageTest-1723038988 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:17:33 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-48370b11-2eb5-43a6-83b2-1c6991e16d60 tempest-CreateVolumesFromImageTest-1723038988 None] Deleted volume successfully.
Apr 10 13:17:33 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-48370b11-2eb5-43a6-83b2-1c6991e16d60 tempest-CreateVolumesFromImageTest-1723038988 None] Lock "cinder-41ed07fd-1f9e-48f0-9a0c-9d2d1fe103ba-delete_volume" released by "delete_volume" :: held 1.650s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:17:33 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b580bbc-9b01-453c-b1ee-2ada5f4d0c6e tempest-VolumesDeleteCascade-1486359075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:17:33 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-3b580bbc-9b01-453c-b1ee-2ada5f4d0c6e tempest-VolumesDeleteCascade-1486359075 None] Flow 'volume_create_manager' (9ce2efba-45b7-4ffd-807f-c563b53bf624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:17:33 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-3b580bbc-9b01-453c-b1ee-2ada5f4d0c6e tempest-VolumesDeleteCascade-1486359075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2d6d812-2bb3-4395-9f59-048620b00764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:17:33 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-3b580bbc-9b01-453c-b1ee-2ada5f4d0c6e tempest-VolumesDeleteCascade-1486359075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2d6d812-2bb3-4395-9f59-048620b00764) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:17:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-564840384',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c792d1e-aaa2-4eae-aec9-45c1b4767412,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a5495bb2aaa4cfd930adaef6d32f807',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:17:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:17:34Z,use_quota=True,user_id='357c35adde514f02ae903d7d7a632b30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:17:33 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-3b580bbc-9b01-453c-b1ee-2ada5f4d0c6e tempest-VolumesDeleteCascade-1486359075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3beb7013-ed01-461e-9bff-79a354ddb4c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:17:33 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-3b580bbc-9b01-453c-b1ee-2ada5f4d0c6e tempest-VolumesDeleteCascade-1486359075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3beb7013-ed01-461e-9bff-79a354ddb4c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:17:33 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-3b580bbc-9b01-453c-b1ee-2ada5f4d0c6e tempest-VolumesDeleteCascade-1486359075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffbff0b3-db96-40ed-bce0-c519678377db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:17:33 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-3b580bbc-9b01-453c-b1ee-2ada5f4d0c6e tempest-VolumesDeleteCascade-1486359075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffbff0b3-db96-40ed-bce0-c519678377db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c792d1e-aaa2-4eae-aec9-45c1b4767412', 'volume_name': 'volume-4c792d1e-aaa2-4eae-aec9-45c1b4767412', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:17:33 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-3b580bbc-9b01-453c-b1ee-2ada5f4d0c6e tempest-VolumesDeleteCascade-1486359075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1392feb-7f6f-4dba-bfe0-c1a28cd26c32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:17:33 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-3b580bbc-9b01-453c-b1ee-2ada5f4d0c6e tempest-VolumesDeleteCascade-1486359075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1392feb-7f6f-4dba-bfe0-c1a28cd26c32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:17:33 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-3b580bbc-9b01-453c-b1ee-2ada5f4d0c6e tempest-VolumesDeleteCascade-1486359075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c489fb48-b8b7-475f-9003-c1e8ae2d1381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:17:33 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-3b580bbc-9b01-453c-b1ee-2ada5f4d0c6e tempest-VolumesDeleteCascade-1486359075 None] Volume 4c792d1e-aaa2-4eae-aec9-45c1b4767412: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c792d1e-aaa2-4eae-aec9-45c1b4767412', 'volume_size': 1}
Apr 10 13:17:33 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-3b580bbc-9b01-453c-b1ee-2ada5f4d0c6e tempest-VolumesDeleteCascade-1486359075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:17:33 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-3b580bbc-9b01-453c-b1ee-2ada5f4d0c6e tempest-VolumesDeleteCascade-1486359075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:17:33 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-3b580bbc-9b01-453c-b1ee-2ada5f4d0c6e tempest-VolumesDeleteCascade-1486359075 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f252bf08b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:17:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-564840384',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c792d1e-aaa2-4eae-aec9-45c1b4767412,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a5495bb2aaa4cfd930adaef6d32f807',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:17:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:17:34Z,use_quota=True,user_id='357c35adde514f02ae903d7d7a632b30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)}" {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 13:17:33 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-3b580bbc-9b01-453c-b1ee-2ada5f4d0c6e tempest-VolumesDeleteCascade-1486359075 None] Creating volume 4c792d1e-aaa2-4eae-aec9-45c1b4767412 {{(pid=83345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 13:17:33 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-3b580bbc-9b01-453c-b1ee-2ada5f4d0c6e tempest-VolumesDeleteCascade-1486359075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:17:33 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-3b580bbc-9b01-453c-b1ee-2ada5f4d0c6e tempest-VolumesDeleteCascade-1486359075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:17:33 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-3b580bbc-9b01-453c-b1ee-2ada5f4d0c6e tempest-VolumesDeleteCascade-1486359075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:17:33 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-3b580bbc-9b01-453c-b1ee-2ada5f4d0c6e tempest-VolumesDeleteCascade-1486359075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:17:33 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-3b580bbc-9b01-453c-b1ee-2ada5f4d0c6e tempest-VolumesDeleteCascade-1486359075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:17:33 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-3b580bbc-9b01-453c-b1ee-2ada5f4d0c6e tempest-VolumesDeleteCascade-1486359075 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:17:33 devstack cinder-volume[83345]: INFO cinder.volume.drivers.remotefs [None req-3b580bbc-9b01-453c-b1ee-2ada5f4d0c6e tempest-VolumesDeleteCascade-1486359075 None] casted to osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331
Apr 10 13:17:33 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-3b580bbc-9b01-453c-b1ee-2ada5f4d0c6e tempest-VolumesDeleteCascade-1486359075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4c792d1e-aaa2-4eae-aec9-45c1b4767412 1073741824 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:33 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-de194e8e-6a5a-49c2-811b-a7df67b0a072 tempest-CreateVolumesFromImageTest-1723038988 None] Acquiring lock "cinder-a26051cb-cbb1-4400-bdc6-35b06a416554-delete_volume" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:17:33 devstack sudo[89528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4c792d1e-aaa2-4eae-aec9-45c1b4767412 1073741824
Apr 10 13:17:33 devstack sudo[89528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:33 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-de194e8e-6a5a-49c2-811b-a7df67b0a072 tempest-CreateVolumesFromImageTest-1723038988 None] Lock "cinder-a26051cb-cbb1-4400-bdc6-35b06a416554-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:17:33 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-de194e8e-6a5a-49c2-811b-a7df67b0a072 tempest-CreateVolumesFromImageTest-1723038988 None] Acquiring lock "cinder-quobyte-a26051cb-cbb1-4400-bdc6-35b06a416554" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:17:33 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-de194e8e-6a5a-49c2-811b-a7df67b0a072 tempest-CreateVolumesFromImageTest-1723038988 None] Lock "cinder-quobyte-a26051cb-cbb1-4400-bdc6-35b06a416554" acquired by "delete_volume" :: waited 0.008s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:17:34 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0cf2cbf-0575-4580-890c-c3bd78556f55]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:17:34 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-de194e8e-6a5a-49c2-811b-a7df67b0a072 tempest-CreateVolumesFromImageTest-1723038988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-a26051cb-cbb1-4400-bdc6-35b06a416554 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:34 devstack sudo[89530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-a26051cb-cbb1-4400-bdc6-35b06a416554
Apr 10 13:17:34 devstack sudo[89530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:34 devstack sudo[89528]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:34 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-3b580bbc-9b01-453c-b1ee-2ada5f4d0c6e tempest-VolumesDeleteCascade-1486359075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4c792d1e-aaa2-4eae-aec9-45c1b4767412 1073741824" returned: 0 in 0.478s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:34 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-3b580bbc-9b01-453c-b1ee-2ada5f4d0c6e tempest-VolumesDeleteCascade-1486359075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4c792d1e-aaa2-4eae-aec9-45c1b4767412 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:34 devstack sudo[89538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4c792d1e-aaa2-4eae-aec9-45c1b4767412
Apr 10 13:17:34 devstack sudo[89538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:34 devstack sudo[89530]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:34 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-de194e8e-6a5a-49c2-811b-a7df67b0a072 tempest-CreateVolumesFromImageTest-1723038988 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-a26051cb-cbb1-4400-bdc6-35b06a416554" returned: 0 in 0.505s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:34 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-de194e8e-6a5a-49c2-811b-a7df67b0a072 tempest-CreateVolumesFromImageTest-1723038988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-a26051cb-cbb1-4400-bdc6-35b06a416554 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:34 devstack sudo[89540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-a26051cb-cbb1-4400-bdc6-35b06a416554
Apr 10 13:17:34 devstack sudo[89540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:34 devstack sudo[89538]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:34 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-3b580bbc-9b01-453c-b1ee-2ada5f4d0c6e tempest-VolumesDeleteCascade-1486359075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4c792d1e-aaa2-4eae-aec9-45c1b4767412" returned: 0 in 0.414s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:34 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-3b580bbc-9b01-453c-b1ee-2ada5f4d0c6e tempest-VolumesDeleteCascade-1486359075 None] <== create_volume: return (924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'} {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 13:17:34 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-3b580bbc-9b01-453c-b1ee-2ada5f4d0c6e tempest-VolumesDeleteCascade-1486359075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.926s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:17:34 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-3b580bbc-9b01-453c-b1ee-2ada5f4d0c6e tempest-VolumesDeleteCascade-1486359075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c489fb48-b8b7-475f-9003-c1e8ae2d1381) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c792d1e-aaa2-4eae-aec9-45c1b4767412', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:17:34 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-3b580bbc-9b01-453c-b1ee-2ada5f4d0c6e tempest-VolumesDeleteCascade-1486359075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1caf71d-2c21-4759-87e7-2b1eda257c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:17:34 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-3b580bbc-9b01-453c-b1ee-2ada5f4d0c6e tempest-VolumesDeleteCascade-1486359075 None] Volume volume-4c792d1e-aaa2-4eae-aec9-45c1b4767412 (4c792d1e-aaa2-4eae-aec9-45c1b4767412): created successfully
Apr 10 13:17:34 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-3b580bbc-9b01-453c-b1ee-2ada5f4d0c6e tempest-VolumesDeleteCascade-1486359075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1caf71d-2c21-4759-87e7-2b1eda257c18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:17:34 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-3b580bbc-9b01-453c-b1ee-2ada5f4d0c6e tempest-VolumesDeleteCascade-1486359075 None] Flow 'volume_create_manager' (9ce2efba-45b7-4ffd-807f-c563b53bf624) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:17:34 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-3b580bbc-9b01-453c-b1ee-2ada5f4d0c6e tempest-VolumesDeleteCascade-1486359075 None] Created volume successfully.
Apr 10 13:17:34 devstack sudo[89540]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:34 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-de194e8e-6a5a-49c2-811b-a7df67b0a072 tempest-CreateVolumesFromImageTest-1723038988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-a26051cb-cbb1-4400-bdc6-35b06a416554" returned: 0 in 0.431s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:34 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-de194e8e-6a5a-49c2-811b-a7df67b0a072 tempest-CreateVolumesFromImageTest-1723038988 None] Lock "cinder-quobyte-a26051cb-cbb1-4400-bdc6-35b06a416554" released by "delete_volume" :: held 0.959s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:17:34 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-de194e8e-6a5a-49c2-811b-a7df67b0a072 tempest-CreateVolumesFromImageTest-1723038988 None] Created reservations ['0a04a25f-d32b-4a7d-abc4-98e3e0e34145', '53f26da6-230d-4eb5-a910-c96119dd71f4', '6604ef67-932b-42b9-bd1a-5c8a1ecb618a', '4f2d9c4e-2f5b-426f-840e-2a42d5abd6e0'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:17:35 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-de194e8e-6a5a-49c2-811b-a7df67b0a072 tempest-CreateVolumesFromImageTest-1723038988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:17:35 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-de194e8e-6a5a-49c2-811b-a7df67b0a072 tempest-CreateVolumesFromImageTest-1723038988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:17:35 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-de194e8e-6a5a-49c2-811b-a7df67b0a072 tempest-CreateVolumesFromImageTest-1723038988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:17:35 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-de194e8e-6a5a-49c2-811b-a7df67b0a072 tempest-CreateVolumesFromImageTest-1723038988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:17:35 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-de194e8e-6a5a-49c2-811b-a7df67b0a072 tempest-CreateVolumesFromImageTest-1723038988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:17:35 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-de194e8e-6a5a-49c2-811b-a7df67b0a072 tempest-CreateVolumesFromImageTest-1723038988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:35 devstack sudo[89544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:17:35 devstack sudo[89544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:35 devstack sudo[89544]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:35 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-de194e8e-6a5a-49c2-811b-a7df67b0a072 tempest-CreateVolumesFromImageTest-1723038988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.396s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:35 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-de194e8e-6a5a-49c2-811b-a7df67b0a072 tempest-CreateVolumesFromImageTest-1723038988 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:17:35 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-de194e8e-6a5a-49c2-811b-a7df67b0a072 tempest-CreateVolumesFromImageTest-1723038988 None] Deleted volume successfully.
Apr 10 13:17:35 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-de194e8e-6a5a-49c2-811b-a7df67b0a072 tempest-CreateVolumesFromImageTest-1723038988 None] Lock "cinder-a26051cb-cbb1-4400-bdc6-35b06a416554-delete_volume" released by "delete_volume" :: held 1.481s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:17:36 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-056fae91-7bfe-43da-895d-ac43e181303a tempest-VolumesDeleteCascade-1486359075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:17:36 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-056fae91-7bfe-43da-895d-ac43e181303a tempest-VolumesDeleteCascade-1486359075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:17:36 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-056fae91-7bfe-43da-895d-ac43e181303a tempest-VolumesDeleteCascade-1486359075 None] Creating offline snapshot 128c7179-8cfa-440d-bb0e-855e122afe9c of volume 4c792d1e-aaa2-4eae-aec9-45c1b4767412 {{(pid=83345) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 10 13:17:36 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[4342bace-aa0a-4076-a369-a6ccc1c1c77a]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:17:36 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-056fae91-7bfe-43da-895d-ac43e181303a tempest-VolumesDeleteCascade-1486359075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4c792d1e-aaa2-4eae-aec9-45c1b4767412 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:36 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-ab234294-61fa-4768-bf02-2e3523fe06bd tempest-CreateVolumesFromImageTest-1723038988 None] Acquiring lock "cinder-9c153ea3-8d91-454e-bc6f-d8f578249989-delete_volume" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:17:36 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-ab234294-61fa-4768-bf02-2e3523fe06bd tempest-CreateVolumesFromImageTest-1723038988 None] Lock "cinder-9c153ea3-8d91-454e-bc6f-d8f578249989-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:17:36 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-ab234294-61fa-4768-bf02-2e3523fe06bd tempest-CreateVolumesFromImageTest-1723038988 None] Acquiring lock "cinder-quobyte-9c153ea3-8d91-454e-bc6f-d8f578249989" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:17:36 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-ab234294-61fa-4768-bf02-2e3523fe06bd tempest-CreateVolumesFromImageTest-1723038988 None] Lock "cinder-quobyte-9c153ea3-8d91-454e-bc6f-d8f578249989" acquired by "delete_volume" :: waited 0.013s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:17:36 devstack sudo[89547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4c792d1e-aaa2-4eae-aec9-45c1b4767412
Apr 10 13:17:36 devstack sudo[89547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:36 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[17b77fd3-2b50-4fe0-9061-df091a00f89e]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:17:36 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ab234294-61fa-4768-bf02-2e3523fe06bd tempest-CreateVolumesFromImageTest-1723038988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-9c153ea3-8d91-454e-bc6f-d8f578249989 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:36 devstack sudo[89549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-9c153ea3-8d91-454e-bc6f-d8f578249989
Apr 10 13:17:36 devstack sudo[89549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:36 devstack sudo[89547]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:36 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-056fae91-7bfe-43da-895d-ac43e181303a tempest-VolumesDeleteCascade-1486359075 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4c792d1e-aaa2-4eae-aec9-45c1b4767412" returned: 0 in 0.492s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:36 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-056fae91-7bfe-43da-895d-ac43e181303a tempest-VolumesDeleteCascade-1486359075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4c792d1e-aaa2-4eae-aec9-45c1b4767412,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4c792d1e-aaa2-4eae-aec9-45c1b4767412.128c7179-8cfa-440d-bb0e-855e122afe9c 1G {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:36 devstack sudo[89557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4c792d1e-aaa2-4eae-aec9-45c1b4767412,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4c792d1e-aaa2-4eae-aec9-45c1b4767412.128c7179-8cfa-440d-bb0e-855e122afe9c 1G
Apr 10 13:17:36 devstack sudo[89557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:36 devstack sudo[89549]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:36 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ab234294-61fa-4768-bf02-2e3523fe06bd tempest-CreateVolumesFromImageTest-1723038988 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-9c153ea3-8d91-454e-bc6f-d8f578249989" returned: 0 in 0.471s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:36 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ab234294-61fa-4768-bf02-2e3523fe06bd tempest-CreateVolumesFromImageTest-1723038988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-9c153ea3-8d91-454e-bc6f-d8f578249989 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:36 devstack sudo[89559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-9c153ea3-8d91-454e-bc6f-d8f578249989
Apr 10 13:17:36 devstack sudo[89559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:37 devstack sudo[89559]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:37 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ab234294-61fa-4768-bf02-2e3523fe06bd tempest-CreateVolumesFromImageTest-1723038988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-9c153ea3-8d91-454e-bc6f-d8f578249989" returned: 0 in 0.408s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:37 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-ab234294-61fa-4768-bf02-2e3523fe06bd tempest-CreateVolumesFromImageTest-1723038988 None] Lock "cinder-quobyte-9c153ea3-8d91-454e-bc6f-d8f578249989" released by "delete_volume" :: held 0.902s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:17:37 devstack sudo[89557]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:37 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-056fae91-7bfe-43da-895d-ac43e181303a tempest-VolumesDeleteCascade-1486359075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4c792d1e-aaa2-4eae-aec9-45c1b4767412,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4c792d1e-aaa2-4eae-aec9-45c1b4767412.128c7179-8cfa-440d-bb0e-855e122afe9c 1G" returned: 0 in 0.506s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:37 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-056fae91-7bfe-43da-895d-ac43e181303a tempest-VolumesDeleteCascade-1486359075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c792d1e-aaa2-4eae-aec9-45c1b4767412 -F qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4c792d1e-aaa2-4eae-aec9-45c1b4767412.128c7179-8cfa-440d-bb0e-855e122afe9c {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:37 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-ab234294-61fa-4768-bf02-2e3523fe06bd tempest-CreateVolumesFromImageTest-1723038988 None] Created reservations ['2ef031cd-3d33-4420-963a-f12934d160a6', '0faf8fba-e28d-4aab-ad1d-f444b5014509', 'cfa31bef-1c0b-4d25-9b94-dd0bb00d7265', '73a568b0-b4b9-480f-afa7-955721e86ebf'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:17:37 devstack sudo[89565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c792d1e-aaa2-4eae-aec9-45c1b4767412 -F qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4c792d1e-aaa2-4eae-aec9-45c1b4767412.128c7179-8cfa-440d-bb0e-855e122afe9c
Apr 10 13:17:37 devstack sudo[89565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:37 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-ab234294-61fa-4768-bf02-2e3523fe06bd tempest-CreateVolumesFromImageTest-1723038988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:17:37 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-ab234294-61fa-4768-bf02-2e3523fe06bd tempest-CreateVolumesFromImageTest-1723038988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:17:37 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-ab234294-61fa-4768-bf02-2e3523fe06bd tempest-CreateVolumesFromImageTest-1723038988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:17:37 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-ab234294-61fa-4768-bf02-2e3523fe06bd tempest-CreateVolumesFromImageTest-1723038988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:17:37 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-ab234294-61fa-4768-bf02-2e3523fe06bd tempest-CreateVolumesFromImageTest-1723038988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:17:37 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ab234294-61fa-4768-bf02-2e3523fe06bd tempest-CreateVolumesFromImageTest-1723038988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:37 devstack sudo[89567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:17:37 devstack sudo[89567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:37 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-4ae352c2-9104-4f5a-bc74-e846a211ea7d tempest-CreateVolumesFromImageTest-1723038988 None] Acquiring lock "cinder-b75888a8-6a94-4f20-bbcd-09ef5fb3ce49-delete_volume" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:17:37 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-4ae352c2-9104-4f5a-bc74-e846a211ea7d tempest-CreateVolumesFromImageTest-1723038988 None] Lock "cinder-b75888a8-6a94-4f20-bbcd-09ef5fb3ce49-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:17:37 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-4ae352c2-9104-4f5a-bc74-e846a211ea7d tempest-CreateVolumesFromImageTest-1723038988 None] Acquiring lock "cinder-quobyte-b75888a8-6a94-4f20-bbcd-09ef5fb3ce49" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:17:37 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-4ae352c2-9104-4f5a-bc74-e846a211ea7d tempest-CreateVolumesFromImageTest-1723038988 None] Lock "cinder-quobyte-b75888a8-6a94-4f20-bbcd-09ef5fb3ce49" acquired by "delete_volume" :: waited 0.016s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:17:37 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fe35d3b-6fba-4c51-81a5-b82b5ec43ff0]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:17:37 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-4ae352c2-9104-4f5a-bc74-e846a211ea7d tempest-CreateVolumesFromImageTest-1723038988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b75888a8-6a94-4f20-bbcd-09ef5fb3ce49 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:37 devstack sudo[89569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b75888a8-6a94-4f20-bbcd-09ef5fb3ce49
Apr 10 13:17:37 devstack sudo[89569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:37 devstack sudo[89565]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:37 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-056fae91-7bfe-43da-895d-ac43e181303a tempest-VolumesDeleteCascade-1486359075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c792d1e-aaa2-4eae-aec9-45c1b4767412 -F qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4c792d1e-aaa2-4eae-aec9-45c1b4767412.128c7179-8cfa-440d-bb0e-855e122afe9c" returned: 0 in 0.453s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:37 devstack cinder-volume[83345]: WARNING cinder.volume.drivers.remotefs [None req-056fae91-7bfe-43da-895d-ac43e181303a tempest-VolumesDeleteCascade-1486359075 None] /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4c792d1e-aaa2-4eae-aec9-45c1b4767412.128c7179-8cfa-440d-bb0e-855e122afe9c is being set with open permissions: ugo+rw
Apr 10 13:17:37 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-056fae91-7bfe-43da-895d-ac43e181303a tempest-VolumesDeleteCascade-1486359075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4c792d1e-aaa2-4eae-aec9-45c1b4767412.128c7179-8cfa-440d-bb0e-855e122afe9c {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:37 devstack sudo[89575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4c792d1e-aaa2-4eae-aec9-45c1b4767412.128c7179-8cfa-440d-bb0e-855e122afe9c
Apr 10 13:17:37 devstack sudo[89575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:37 devstack sudo[89567]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:37 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ab234294-61fa-4768-bf02-2e3523fe06bd tempest-CreateVolumesFromImageTest-1723038988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.452s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:37 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-ab234294-61fa-4768-bf02-2e3523fe06bd tempest-CreateVolumesFromImageTest-1723038988 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:17:37 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-ab234294-61fa-4768-bf02-2e3523fe06bd tempest-CreateVolumesFromImageTest-1723038988 None] Deleted volume successfully.
Apr 10 13:17:37 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-ab234294-61fa-4768-bf02-2e3523fe06bd tempest-CreateVolumesFromImageTest-1723038988 None] Lock "cinder-9c153ea3-8d91-454e-bc6f-d8f578249989-delete_volume" released by "delete_volume" :: held 1.518s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:17:37 devstack sudo[89569]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:37 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-4ae352c2-9104-4f5a-bc74-e846a211ea7d tempest-CreateVolumesFromImageTest-1723038988 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b75888a8-6a94-4f20-bbcd-09ef5fb3ce49" returned: 0 in 0.474s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:37 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-4ae352c2-9104-4f5a-bc74-e846a211ea7d tempest-CreateVolumesFromImageTest-1723038988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b75888a8-6a94-4f20-bbcd-09ef5fb3ce49 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:37 devstack sudo[89580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b75888a8-6a94-4f20-bbcd-09ef5fb3ce49
Apr 10 13:17:37 devstack sudo[89580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:37 devstack sudo[89575]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:37 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-056fae91-7bfe-43da-895d-ac43e181303a tempest-VolumesDeleteCascade-1486359075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4c792d1e-aaa2-4eae-aec9-45c1b4767412.128c7179-8cfa-440d-bb0e-855e122afe9c" returned: 0 in 0.405s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:37 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-056fae91-7bfe-43da-895d-ac43e181303a tempest-VolumesDeleteCascade-1486359075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4c792d1e-aaa2-4eae-aec9-45c1b4767412.info {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:37 devstack sudo[89583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4c792d1e-aaa2-4eae-aec9-45c1b4767412.info
Apr 10 13:17:37 devstack sudo[89583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:38 devstack sudo[89580]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:38 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-4ae352c2-9104-4f5a-bc74-e846a211ea7d tempest-CreateVolumesFromImageTest-1723038988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b75888a8-6a94-4f20-bbcd-09ef5fb3ce49" returned: 0 in 0.455s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:38 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-4ae352c2-9104-4f5a-bc74-e846a211ea7d tempest-CreateVolumesFromImageTest-1723038988 None] Lock "cinder-quobyte-b75888a8-6a94-4f20-bbcd-09ef5fb3ce49" released by "delete_volume" :: held 0.951s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:17:38 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-4ae352c2-9104-4f5a-bc74-e846a211ea7d tempest-CreateVolumesFromImageTest-1723038988 None] Created reservations ['80f95dd1-bb06-4eec-b34c-5faa5e04fa9f', 'cb14b778-1ed5-40be-a92b-dedee36df910', '69b1a426-49cb-4ddd-9d8b-3e9bfeb89168', 'a621edb9-04f9-489a-83f4-a023af713035'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:17:38 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-4ae352c2-9104-4f5a-bc74-e846a211ea7d tempest-CreateVolumesFromImageTest-1723038988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:17:38 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-4ae352c2-9104-4f5a-bc74-e846a211ea7d tempest-CreateVolumesFromImageTest-1723038988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:17:38 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-4ae352c2-9104-4f5a-bc74-e846a211ea7d tempest-CreateVolumesFromImageTest-1723038988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:17:38 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-4ae352c2-9104-4f5a-bc74-e846a211ea7d tempest-CreateVolumesFromImageTest-1723038988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:17:38 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-4ae352c2-9104-4f5a-bc74-e846a211ea7d tempest-CreateVolumesFromImageTest-1723038988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:17:38 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-4ae352c2-9104-4f5a-bc74-e846a211ea7d tempest-CreateVolumesFromImageTest-1723038988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:38 devstack sudo[89587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:17:38 devstack sudo[89587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:38 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-27e362c4-b56c-4b15-950d-83610cac9c91 tempest-CreateVolumesFromImageTest-1723038988 None] Acquiring lock "cinder-e8879e81-223a-4036-8ba4-4746fde10901-delete_volume" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:17:38 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-27e362c4-b56c-4b15-950d-83610cac9c91 tempest-CreateVolumesFromImageTest-1723038988 None] Lock "cinder-e8879e81-223a-4036-8ba4-4746fde10901-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:17:38 devstack sudo[89583]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:38 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-27e362c4-b56c-4b15-950d-83610cac9c91 tempest-CreateVolumesFromImageTest-1723038988 None] Acquiring lock "cinder-quobyte-e8879e81-223a-4036-8ba4-4746fde10901" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:17:38 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-056fae91-7bfe-43da-895d-ac43e181303a tempest-VolumesDeleteCascade-1486359075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4c792d1e-aaa2-4eae-aec9-45c1b4767412.info" returned: 0 in 0.421s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:38 devstack cinder-volume[83345]: WARNING cinder.volume.drivers.remotefs [None req-056fae91-7bfe-43da-895d-ac43e181303a tempest-VolumesDeleteCascade-1486359075 None] /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4c792d1e-aaa2-4eae-aec9-45c1b4767412.info is being set with open permissions: ugo+rw
Apr 10 13:17:38 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-056fae91-7bfe-43da-895d-ac43e181303a tempest-VolumesDeleteCascade-1486359075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4c792d1e-aaa2-4eae-aec9-45c1b4767412.info {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:38 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-27e362c4-b56c-4b15-950d-83610cac9c91 tempest-CreateVolumesFromImageTest-1723038988 None] Lock "cinder-quobyte-e8879e81-223a-4036-8ba4-4746fde10901" acquired by "delete_volume" :: waited 0.020s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:17:38 devstack sudo[89589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4c792d1e-aaa2-4eae-aec9-45c1b4767412.info
Apr 10 13:17:38 devstack sudo[89589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:38 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[11bcd456-6183-4458-b192-29759e779561]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:17:38 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-27e362c4-b56c-4b15-950d-83610cac9c91 tempest-CreateVolumesFromImageTest-1723038988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e8879e81-223a-4036-8ba4-4746fde10901 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:38 devstack sudo[89591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e8879e81-223a-4036-8ba4-4746fde10901
Apr 10 13:17:38 devstack sudo[89591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:38 devstack sudo[89587]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:38 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-4ae352c2-9104-4f5a-bc74-e846a211ea7d tempest-CreateVolumesFromImageTest-1723038988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.420s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:38 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-4ae352c2-9104-4f5a-bc74-e846a211ea7d tempest-CreateVolumesFromImageTest-1723038988 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:17:38 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-4ae352c2-9104-4f5a-bc74-e846a211ea7d tempest-CreateVolumesFromImageTest-1723038988 None] Deleted volume successfully.
Apr 10 13:17:38 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-4ae352c2-9104-4f5a-bc74-e846a211ea7d tempest-CreateVolumesFromImageTest-1723038988 None] Lock "cinder-b75888a8-6a94-4f20-bbcd-09ef5fb3ce49-delete_volume" released by "delete_volume" :: held 1.529s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:17:38 devstack sudo[89589]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:38 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-056fae91-7bfe-43da-895d-ac43e181303a tempest-VolumesDeleteCascade-1486359075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4c792d1e-aaa2-4eae-aec9-45c1b4767412.info" returned: 0 in 0.459s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:38 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-056fae91-7bfe-43da-895d-ac43e181303a tempest-VolumesDeleteCascade-1486359075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.794s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:17:38 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-056fae91-7bfe-43da-895d-ac43e181303a tempest-VolumesDeleteCascade-1486359075 None] Create snapshot completed successfully
Apr 10 13:17:38 devstack sudo[89591]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:38 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-27e362c4-b56c-4b15-950d-83610cac9c91 tempest-CreateVolumesFromImageTest-1723038988 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e8879e81-223a-4036-8ba4-4746fde10901" returned: 0 in 0.465s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:38 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-27e362c4-b56c-4b15-950d-83610cac9c91 tempest-CreateVolumesFromImageTest-1723038988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e8879e81-223a-4036-8ba4-4746fde10901 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:38 devstack sudo[89598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e8879e81-223a-4036-8ba4-4746fde10901
Apr 10 13:17:38 devstack sudo[89598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:39 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-e7756e57-b59c-41d3-98d3-0cfdadfbe2a3 tempest-VolumesDeleteCascade-1486359075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:17:39 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-e7756e57-b59c-41d3-98d3-0cfdadfbe2a3 tempest-VolumesDeleteCascade-1486359075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:17:39 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-e7756e57-b59c-41d3-98d3-0cfdadfbe2a3 tempest-VolumesDeleteCascade-1486359075 None] Creating offline snapshot 1afdb4ce-13fa-4cf2-8d08-9a834a6aa661 of volume 4c792d1e-aaa2-4eae-aec9-45c1b4767412 {{(pid=83345) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 10 13:17:39 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c281974-3bdc-4f76-95b8-963a9e169b39]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:17:39 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-e7756e57-b59c-41d3-98d3-0cfdadfbe2a3 tempest-VolumesDeleteCascade-1486359075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4c792d1e-aaa2-4eae-aec9-45c1b4767412.128c7179-8cfa-440d-bb0e-855e122afe9c {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:39 devstack sudo[89598]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:39 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-27e362c4-b56c-4b15-950d-83610cac9c91 tempest-CreateVolumesFromImageTest-1723038988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e8879e81-223a-4036-8ba4-4746fde10901" returned: 0 in 0.442s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:39 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-27e362c4-b56c-4b15-950d-83610cac9c91 tempest-CreateVolumesFromImageTest-1723038988 None] Lock "cinder-quobyte-e8879e81-223a-4036-8ba4-4746fde10901" released by "delete_volume" :: held 0.933s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:17:39 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-27e362c4-b56c-4b15-950d-83610cac9c91 tempest-CreateVolumesFromImageTest-1723038988 None] Created reservations ['58a771d0-a382-4254-a024-1b15515b01f8', '3512f5f8-ccae-4faf-aa41-37f3f9798e6d', 'e18b2e96-5941-4c80-a0a8-2d342c37019e', 'c8ed74c3-4219-4fcb-bbdc-ae8fcd3a6055'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:17:39 devstack sudo[89601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4c792d1e-aaa2-4eae-aec9-45c1b4767412.128c7179-8cfa-440d-bb0e-855e122afe9c
Apr 10 13:17:39 devstack sudo[89601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:39 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-27e362c4-b56c-4b15-950d-83610cac9c91 tempest-CreateVolumesFromImageTest-1723038988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:17:39 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-27e362c4-b56c-4b15-950d-83610cac9c91 tempest-CreateVolumesFromImageTest-1723038988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:17:39 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-27e362c4-b56c-4b15-950d-83610cac9c91 tempest-CreateVolumesFromImageTest-1723038988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:17:39 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-27e362c4-b56c-4b15-950d-83610cac9c91 tempest-CreateVolumesFromImageTest-1723038988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:17:39 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-27e362c4-b56c-4b15-950d-83610cac9c91 tempest-CreateVolumesFromImageTest-1723038988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:17:39 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-27e362c4-b56c-4b15-950d-83610cac9c91 tempest-CreateVolumesFromImageTest-1723038988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:39 devstack sudo[89603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:17:39 devstack sudo[89603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:39 devstack sudo[89601]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:39 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-e7756e57-b59c-41d3-98d3-0cfdadfbe2a3 tempest-VolumesDeleteCascade-1486359075 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4c792d1e-aaa2-4eae-aec9-45c1b4767412.128c7179-8cfa-440d-bb0e-855e122afe9c" returned: 0 in 0.516s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:39 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-e7756e57-b59c-41d3-98d3-0cfdadfbe2a3 tempest-VolumesDeleteCascade-1486359075 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4c792d1e-aaa2-4eae-aec9-45c1b4767412(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 13:17:39 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-e7756e57-b59c-41d3-98d3-0cfdadfbe2a3 tempest-VolumesDeleteCascade-1486359075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4c792d1e-aaa2-4eae-aec9-45c1b4767412.128c7179-8cfa-440d-bb0e-855e122afe9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4c792d1e-aaa2-4eae-aec9-45c1b4767412.1afdb4ce-13fa-4cf2-8d08-9a834a6aa661 1G {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:39 devstack sudo[89603]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:39 devstack sudo[89609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4c792d1e-aaa2-4eae-aec9-45c1b4767412.128c7179-8cfa-440d-bb0e-855e122afe9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4c792d1e-aaa2-4eae-aec9-45c1b4767412.1afdb4ce-13fa-4cf2-8d08-9a834a6aa661 1G
Apr 10 13:17:39 devstack sudo[89609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:39 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-27e362c4-b56c-4b15-950d-83610cac9c91 tempest-CreateVolumesFromImageTest-1723038988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.464s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:39 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-27e362c4-b56c-4b15-950d-83610cac9c91 tempest-CreateVolumesFromImageTest-1723038988 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:17:39 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-27e362c4-b56c-4b15-950d-83610cac9c91 tempest-CreateVolumesFromImageTest-1723038988 None] Deleted volume successfully.
Apr 10 13:17:39 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-27e362c4-b56c-4b15-950d-83610cac9c91 tempest-CreateVolumesFromImageTest-1723038988 None] Lock "cinder-e8879e81-223a-4036-8ba4-4746fde10901-delete_volume" released by "delete_volume" :: held 1.557s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:17:40 devstack sudo[89609]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:40 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-e7756e57-b59c-41d3-98d3-0cfdadfbe2a3 tempest-VolumesDeleteCascade-1486359075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4c792d1e-aaa2-4eae-aec9-45c1b4767412.128c7179-8cfa-440d-bb0e-855e122afe9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4c792d1e-aaa2-4eae-aec9-45c1b4767412.1afdb4ce-13fa-4cf2-8d08-9a834a6aa661 1G" returned: 0 in 0.560s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:40 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-e7756e57-b59c-41d3-98d3-0cfdadfbe2a3 tempest-VolumesDeleteCascade-1486359075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c792d1e-aaa2-4eae-aec9-45c1b4767412.128c7179-8cfa-440d-bb0e-855e122afe9c -F qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4c792d1e-aaa2-4eae-aec9-45c1b4767412.1afdb4ce-13fa-4cf2-8d08-9a834a6aa661 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:40 devstack sudo[89614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c792d1e-aaa2-4eae-aec9-45c1b4767412.128c7179-8cfa-440d-bb0e-855e122afe9c -F qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4c792d1e-aaa2-4eae-aec9-45c1b4767412.1afdb4ce-13fa-4cf2-8d08-9a834a6aa661
Apr 10 13:17:40 devstack sudo[89614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:40 devstack sudo[89614]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:40 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-e7756e57-b59c-41d3-98d3-0cfdadfbe2a3 tempest-VolumesDeleteCascade-1486359075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c792d1e-aaa2-4eae-aec9-45c1b4767412.128c7179-8cfa-440d-bb0e-855e122afe9c -F qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4c792d1e-aaa2-4eae-aec9-45c1b4767412.1afdb4ce-13fa-4cf2-8d08-9a834a6aa661" returned: 0 in 0.484s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:40 devstack cinder-volume[83345]: WARNING cinder.volume.drivers.remotefs [None req-e7756e57-b59c-41d3-98d3-0cfdadfbe2a3 tempest-VolumesDeleteCascade-1486359075 None] /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4c792d1e-aaa2-4eae-aec9-45c1b4767412.1afdb4ce-13fa-4cf2-8d08-9a834a6aa661 is being set with open permissions: ugo+rw
Apr 10 13:17:40 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-e7756e57-b59c-41d3-98d3-0cfdadfbe2a3 tempest-VolumesDeleteCascade-1486359075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4c792d1e-aaa2-4eae-aec9-45c1b4767412.1afdb4ce-13fa-4cf2-8d08-9a834a6aa661 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:40 devstack sudo[89619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4c792d1e-aaa2-4eae-aec9-45c1b4767412.1afdb4ce-13fa-4cf2-8d08-9a834a6aa661
Apr 10 13:17:40 devstack sudo[89619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:41 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a8a6384-a661-4bfb-ae18-f61aa8427d83 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:17:41 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-4a8a6384-a661-4bfb-ae18-f61aa8427d83 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Flow 'volume_create_manager' (bd719a3b-3497-42bc-b72f-a2b474774c6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:17:41 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-4a8a6384-a661-4bfb-ae18-f61aa8427d83 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a7901fb-8eb1-410d-8bb1-5239f720e241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:17:41 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-4a8a6384-a661-4bfb-ae18-f61aa8427d83 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a7901fb-8eb1-410d-8bb1-5239f720e241) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:17:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1581306701',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1b43e14-a509-4d72-adec-b1fa1b92323d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f9d354df97e4333b5e2df1565b935c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:17:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:17:41Z,use_quota=True,user_id='65291306a8c74c4da4bc23b183835080',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:17:41 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-4a8a6384-a661-4bfb-ae18-f61aa8427d83 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bf12b62-4b54-4ac1-bc3f-9eb0017f4761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:17:41 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-4a8a6384-a661-4bfb-ae18-f61aa8427d83 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bf12b62-4b54-4ac1-bc3f-9eb0017f4761) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:17:41 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-4a8a6384-a661-4bfb-ae18-f61aa8427d83 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5eb2079c-03db-44f3-a221-b5e2d4ae1fe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:17:41 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-4a8a6384-a661-4bfb-ae18-f61aa8427d83 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5eb2079c-03db-44f3-a221-b5e2d4ae1fe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1b43e14-a509-4d72-adec-b1fa1b92323d', 'volume_name': 'volume-c1b43e14-a509-4d72-adec-b1fa1b92323d', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:17:41 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-4a8a6384-a661-4bfb-ae18-f61aa8427d83 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71bf7856-be67-417f-8c4b-88d68dbbe204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:17:41 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-4a8a6384-a661-4bfb-ae18-f61aa8427d83 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71bf7856-be67-417f-8c4b-88d68dbbe204) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:17:41 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-4a8a6384-a661-4bfb-ae18-f61aa8427d83 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e51180c6-860a-452d-8588-98c2b31f65c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:17:41 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-4a8a6384-a661-4bfb-ae18-f61aa8427d83 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Volume c1b43e14-a509-4d72-adec-b1fa1b92323d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1b43e14-a509-4d72-adec-b1fa1b92323d', 'volume_size': 1}
Apr 10 13:17:41 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-4a8a6384-a661-4bfb-ae18-f61aa8427d83 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:17:41 devstack sudo[89619]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:41 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-e7756e57-b59c-41d3-98d3-0cfdadfbe2a3 tempest-VolumesDeleteCascade-1486359075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4c792d1e-aaa2-4eae-aec9-45c1b4767412.1afdb4ce-13fa-4cf2-8d08-9a834a6aa661" returned: 0 in 0.429s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:41 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-e7756e57-b59c-41d3-98d3-0cfdadfbe2a3 tempest-VolumesDeleteCascade-1486359075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.044s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:17:41 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-4a8a6384-a661-4bfb-ae18-f61aa8427d83 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.129s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:17:41 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-4a8a6384-a661-4bfb-ae18-f61aa8427d83 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f252bf08b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:17:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1581306701',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1b43e14-a509-4d72-adec-b1fa1b92323d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f9d354df97e4333b5e2df1565b935c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:17:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:17:41Z,use_quota=True,user_id='65291306a8c74c4da4bc23b183835080',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)}" {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 13:17:41 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-4a8a6384-a661-4bfb-ae18-f61aa8427d83 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Creating volume c1b43e14-a509-4d72-adec-b1fa1b92323d {{(pid=83345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 13:17:41 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-4a8a6384-a661-4bfb-ae18-f61aa8427d83 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:17:41 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-4a8a6384-a661-4bfb-ae18-f61aa8427d83 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:17:41 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-4a8a6384-a661-4bfb-ae18-f61aa8427d83 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:17:41 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-4a8a6384-a661-4bfb-ae18-f61aa8427d83 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:17:41 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-4a8a6384-a661-4bfb-ae18-f61aa8427d83 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:17:41 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-4a8a6384-a661-4bfb-ae18-f61aa8427d83 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:17:41 devstack cinder-volume[83345]: INFO cinder.volume.drivers.remotefs [None req-4a8a6384-a661-4bfb-ae18-f61aa8427d83 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] casted to osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331
Apr 10 13:17:41 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-4a8a6384-a661-4bfb-ae18-f61aa8427d83 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-c1b43e14-a509-4d72-adec-b1fa1b92323d 1073741824 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:41 devstack sudo[89622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-c1b43e14-a509-4d72-adec-b1fa1b92323d 1073741824
Apr 10 13:17:41 devstack sudo[89622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:41 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-e7756e57-b59c-41d3-98d3-0cfdadfbe2a3 tempest-VolumesDeleteCascade-1486359075 None] Create snapshot completed successfully
Apr 10 13:17:41 devstack sudo[89622]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:41 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-4a8a6384-a661-4bfb-ae18-f61aa8427d83 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-c1b43e14-a509-4d72-adec-b1fa1b92323d 1073741824" returned: 0 in 0.469s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:41 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-4a8a6384-a661-4bfb-ae18-f61aa8427d83 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-c1b43e14-a509-4d72-adec-b1fa1b92323d {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:41 devstack sudo[89628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-c1b43e14-a509-4d72-adec-b1fa1b92323d
Apr 10 13:17:41 devstack sudo[89628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:42 devstack sudo[89628]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:42 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-4a8a6384-a661-4bfb-ae18-f61aa8427d83 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-c1b43e14-a509-4d72-adec-b1fa1b92323d" returned: 0 in 0.390s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:42 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-4a8a6384-a661-4bfb-ae18-f61aa8427d83 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] <== create_volume: return (883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'} {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 13:17:42 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-4a8a6384-a661-4bfb-ae18-f61aa8427d83 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.886s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:17:42 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-4a8a6384-a661-4bfb-ae18-f61aa8427d83 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e51180c6-860a-452d-8588-98c2b31f65c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1b43e14-a509-4d72-adec-b1fa1b92323d', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:17:42 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-4a8a6384-a661-4bfb-ae18-f61aa8427d83 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7b9ee8c-e188-47ca-81a3-339182285a5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:17:42 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-4a8a6384-a661-4bfb-ae18-f61aa8427d83 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Volume volume-c1b43e14-a509-4d72-adec-b1fa1b92323d (c1b43e14-a509-4d72-adec-b1fa1b92323d): created successfully
Apr 10 13:17:42 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-4a8a6384-a661-4bfb-ae18-f61aa8427d83 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7b9ee8c-e188-47ca-81a3-339182285a5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:17:42 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-4a8a6384-a661-4bfb-ae18-f61aa8427d83 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Flow 'volume_create_manager' (bd719a3b-3497-42bc-b72f-a2b474774c6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:17:42 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-4a8a6384-a661-4bfb-ae18-f61aa8427d83 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Created volume successfully.
Apr 10 13:17:42 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-253e85bd-5cc2-48cb-83ed-20e0fc380c29 tempest-VolumesDeleteCascade-1486359075 None] Acquiring lock "cinder-4c792d1e-aaa2-4eae-aec9-45c1b4767412-delete_volume" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:17:42 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-253e85bd-5cc2-48cb-83ed-20e0fc380c29 tempest-VolumesDeleteCascade-1486359075 None] Lock "cinder-4c792d1e-aaa2-4eae-aec9-45c1b4767412-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:17:42 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-253e85bd-5cc2-48cb-83ed-20e0fc380c29 tempest-VolumesDeleteCascade-1486359075 None] Performing cascade delete. {{(pid=83345) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Apr 10 13:17:42 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-253e85bd-5cc2-48cb-83ed-20e0fc380c29 tempest-VolumesDeleteCascade-1486359075 None] Acquiring lock "cinder-128c7179-8cfa-440d-bb0e-855e122afe9c-delete_snapshot" by "delete_snapshot" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:17:42 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-253e85bd-5cc2-48cb-83ed-20e0fc380c29 tempest-VolumesDeleteCascade-1486359075 None] Lock "cinder-128c7179-8cfa-440d-bb0e-855e122afe9c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:17:42 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-253e85bd-5cc2-48cb-83ed-20e0fc380c29 tempest-VolumesDeleteCascade-1486359075 None] Acquiring lock "cinder-quobyte-4c792d1e-aaa2-4eae-aec9-45c1b4767412" by "delete_snapshot" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:17:42 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-253e85bd-5cc2-48cb-83ed-20e0fc380c29 tempest-VolumesDeleteCascade-1486359075 None] Lock "cinder-quobyte-4c792d1e-aaa2-4eae-aec9-45c1b4767412" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:17:42 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-253e85bd-5cc2-48cb-83ed-20e0fc380c29 tempest-VolumesDeleteCascade-1486359075 None] Acquiring lock "cinder-quobyte-128c7179-8cfa-440d-bb0e-855e122afe9c" by "_delete_snapshot" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:17:42 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-253e85bd-5cc2-48cb-83ed-20e0fc380c29 tempest-VolumesDeleteCascade-1486359075 None] Lock "cinder-quobyte-128c7179-8cfa-440d-bb0e-855e122afe9c" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:17:42 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-253e85bd-5cc2-48cb-83ed-20e0fc380c29 tempest-VolumesDeleteCascade-1486359075 None] Deleting offline snapshot 128c7179-8cfa-440d-bb0e-855e122afe9c of volume 4c792d1e-aaa2-4eae-aec9-45c1b4767412 {{(pid=83345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 10 13:17:42 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-253e85bd-5cc2-48cb-83ed-20e0fc380c29 tempest-VolumesDeleteCascade-1486359075 None] snapshot_file for this snap is: volume-4c792d1e-aaa2-4eae-aec9-45c1b4767412.128c7179-8cfa-440d-bb0e-855e122afe9c {{(pid=83345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 10 13:17:42 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5f72ff3-5a09-49b8-9400-5a097f1705f8]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:17:42 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-253e85bd-5cc2-48cb-83ed-20e0fc380c29 tempest-VolumesDeleteCascade-1486359075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4c792d1e-aaa2-4eae-aec9-45c1b4767412.128c7179-8cfa-440d-bb0e-855e122afe9c {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:42 devstack sudo[89631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4c792d1e-aaa2-4eae-aec9-45c1b4767412.128c7179-8cfa-440d-bb0e-855e122afe9c
Apr 10 13:17:42 devstack sudo[89631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:43 devstack sudo[89631]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:43 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-253e85bd-5cc2-48cb-83ed-20e0fc380c29 tempest-VolumesDeleteCascade-1486359075 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4c792d1e-aaa2-4eae-aec9-45c1b4767412.128c7179-8cfa-440d-bb0e-855e122afe9c" returned: 0 in 0.495s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:43 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-253e85bd-5cc2-48cb-83ed-20e0fc380c29 tempest-VolumesDeleteCascade-1486359075 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4c792d1e-aaa2-4eae-aec9-45c1b4767412(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 13:17:43 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[9760c310-0598-4f16-afb5-68796e85af4b]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:17:43 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-253e85bd-5cc2-48cb-83ed-20e0fc380c29 tempest-VolumesDeleteCascade-1486359075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4c792d1e-aaa2-4eae-aec9-45c1b4767412 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:43 devstack sudo[89636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4c792d1e-aaa2-4eae-aec9-45c1b4767412
Apr 10 13:17:43 devstack sudo[89636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:43 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b1274fc-fe46-44f6-8c28-b093837ba907 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:17:43 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-8b1274fc-fe46-44f6-8c28-b093837ba907 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Flow 'volume_create_manager' (71deb842-f30f-4a28-aa34-542ce076d0e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:17:43 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-8b1274fc-fe46-44f6-8c28-b093837ba907 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8397485d-2c0f-4733-81b6-72888cc9e381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:17:43 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-8b1274fc-fe46-44f6-8c28-b093837ba907 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8397485d-2c0f-4733-81b6-72888cc9e381) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:17:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-243056943',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9b9ae5b-227f-4c3f-bb6e-156050b04f85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f9d354df97e4333b5e2df1565b935c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:17:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:17:43Z,use_quota=True,user_id='65291306a8c74c4da4bc23b183835080',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:17:43 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-8b1274fc-fe46-44f6-8c28-b093837ba907 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4c75b94-68e6-4ad2-9938-f8d3d537effb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:17:43 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-8b1274fc-fe46-44f6-8c28-b093837ba907 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4c75b94-68e6-4ad2-9938-f8d3d537effb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:17:43 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-8b1274fc-fe46-44f6-8c28-b093837ba907 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ef8d0cf-293d-4d90-ad4f-518bcdfc95a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:17:43 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-8b1274fc-fe46-44f6-8c28-b093837ba907 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ef8d0cf-293d-4d90-ad4f-518bcdfc95a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9b9ae5b-227f-4c3f-bb6e-156050b04f85', 'volume_name': 'volume-d9b9ae5b-227f-4c3f-bb6e-156050b04f85', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:17:43 devstack sudo[89636]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:43 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-8b1274fc-fe46-44f6-8c28-b093837ba907 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30ffb840-6293-4922-a243-a243fabbb147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:17:43 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-8b1274fc-fe46-44f6-8c28-b093837ba907 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30ffb840-6293-4922-a243-a243fabbb147) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:17:43 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-8b1274fc-fe46-44f6-8c28-b093837ba907 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12d25571-100a-464b-8294-e6eff5fe0eb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:17:43 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-8b1274fc-fe46-44f6-8c28-b093837ba907 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Volume d9b9ae5b-227f-4c3f-bb6e-156050b04f85: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9b9ae5b-227f-4c3f-bb6e-156050b04f85', 'volume_size': 1}
Apr 10 13:17:43 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-8b1274fc-fe46-44f6-8c28-b093837ba907 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:17:43 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-8b1274fc-fe46-44f6-8c28-b093837ba907 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:17:43 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-8b1274fc-fe46-44f6-8c28-b093837ba907 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f252bf08b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:17:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-243056943',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9b9ae5b-227f-4c3f-bb6e-156050b04f85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f9d354df97e4333b5e2df1565b935c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:17:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:17:43Z,use_quota=True,user_id='65291306a8c74c4da4bc23b183835080',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)}" {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 13:17:43 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-8b1274fc-fe46-44f6-8c28-b093837ba907 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Creating volume d9b9ae5b-227f-4c3f-bb6e-156050b04f85 {{(pid=83345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 13:17:43 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-8b1274fc-fe46-44f6-8c28-b093837ba907 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:17:43 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-8b1274fc-fe46-44f6-8c28-b093837ba907 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:17:43 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-8b1274fc-fe46-44f6-8c28-b093837ba907 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:17:43 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-8b1274fc-fe46-44f6-8c28-b093837ba907 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:17:43 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-8b1274fc-fe46-44f6-8c28-b093837ba907 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:17:43 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-8b1274fc-fe46-44f6-8c28-b093837ba907 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:17:43 devstack cinder-volume[83345]: INFO cinder.volume.drivers.remotefs [None req-8b1274fc-fe46-44f6-8c28-b093837ba907 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] casted to osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331
Apr 10 13:17:43 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-8b1274fc-fe46-44f6-8c28-b093837ba907 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-d9b9ae5b-227f-4c3f-bb6e-156050b04f85 1073741824 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:43 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-253e85bd-5cc2-48cb-83ed-20e0fc380c29 tempest-VolumesDeleteCascade-1486359075 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4c792d1e-aaa2-4eae-aec9-45c1b4767412" returned: 0 in 0.530s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:43 devstack sudo[89641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-d9b9ae5b-227f-4c3f-bb6e-156050b04f85 1073741824
Apr 10 13:17:43 devstack sudo[89641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:43 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[30af474b-0941-485e-86ac-ba539a7cac33]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:17:43 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-253e85bd-5cc2-48cb-83ed-20e0fc380c29 tempest-VolumesDeleteCascade-1486359075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4c792d1e-aaa2-4eae-aec9-45c1b4767412.1afdb4ce-13fa-4cf2-8d08-9a834a6aa661 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:43 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-5dc44f9e-6588-44ca-bd6d-766f63b797ed tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:17:43 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-5dc44f9e-6588-44ca-bd6d-766f63b797ed tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Flow 'volume_create_manager' (a69d18bd-4eb4-4e6c-bb4f-65e4cfd0f41c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:17:43 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-5dc44f9e-6588-44ca-bd6d-766f63b797ed tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25e44532-8378-4e4e-9235-57098097b1c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:17:43 devstack sudo[89643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4c792d1e-aaa2-4eae-aec9-45c1b4767412.1afdb4ce-13fa-4cf2-8d08-9a834a6aa661
Apr 10 13:17:43 devstack sudo[89643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:43 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-5dc44f9e-6588-44ca-bd6d-766f63b797ed tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25e44532-8378-4e4e-9235-57098097b1c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:17:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-408910727',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a83e57c-048d-45ed-8f4b-68980bb26ce7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f9d354df97e4333b5e2df1565b935c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:17:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:17:44Z,use_quota=True,user_id='65291306a8c74c4da4bc23b183835080',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:17:43 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-5dc44f9e-6588-44ca-bd6d-766f63b797ed tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d63eace-fb61-427d-9cba-a95254ae2d1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:17:43 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-5dc44f9e-6588-44ca-bd6d-766f63b797ed tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d63eace-fb61-427d-9cba-a95254ae2d1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:17:43 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-5dc44f9e-6588-44ca-bd6d-766f63b797ed tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a70c8af-0e5a-4793-84c2-ce73d3a1fc29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:17:43 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-5dc44f9e-6588-44ca-bd6d-766f63b797ed tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a70c8af-0e5a-4793-84c2-ce73d3a1fc29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a83e57c-048d-45ed-8f4b-68980bb26ce7', 'volume_name': 'volume-1a83e57c-048d-45ed-8f4b-68980bb26ce7', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:17:43 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-5dc44f9e-6588-44ca-bd6d-766f63b797ed tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00f36b3f-1621-4087-be80-a4eec927b4cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:17:43 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-5dc44f9e-6588-44ca-bd6d-766f63b797ed tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00f36b3f-1621-4087-be80-a4eec927b4cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:17:43 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-5dc44f9e-6588-44ca-bd6d-766f63b797ed tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b0e62ff-a1a7-4429-b983-f755162e88e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:17:43 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-5dc44f9e-6588-44ca-bd6d-766f63b797ed tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Volume 1a83e57c-048d-45ed-8f4b-68980bb26ce7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a83e57c-048d-45ed-8f4b-68980bb26ce7', 'volume_size': 1}
Apr 10 13:17:43 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-5dc44f9e-6588-44ca-bd6d-766f63b797ed tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:17:43 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-370e19a9-0843-435a-8637-264a5f4f76c1 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:17:43 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-370e19a9-0843-435a-8637-264a5f4f76c1 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Flow 'volume_create_manager' (43bc644f-dd3b-4902-a31a-3413f4c1855e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:17:43 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-370e19a9-0843-435a-8637-264a5f4f76c1 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32ac9e70-d8e5-4048-bed2-fb2be73ea3c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:17:43 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-370e19a9-0843-435a-8637-264a5f4f76c1 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32ac9e70-d8e5-4048-bed2-fb2be73ea3c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:17:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1113315777',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00f648d0-e57c-4a40-b3d0-b95d4c8fe744,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f9d354df97e4333b5e2df1565b935c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:17:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:17:44Z,use_quota=True,user_id='65291306a8c74c4da4bc23b183835080',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:17:43 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-370e19a9-0843-435a-8637-264a5f4f76c1 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7901f75b-d12f-443d-adca-2a04230d5012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:17:43 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-370e19a9-0843-435a-8637-264a5f4f76c1 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7901f75b-d12f-443d-adca-2a04230d5012) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:17:43 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-370e19a9-0843-435a-8637-264a5f4f76c1 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bab8b54-b4bb-4192-a258-8d6eaa914b8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:17:43 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-370e19a9-0843-435a-8637-264a5f4f76c1 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bab8b54-b4bb-4192-a258-8d6eaa914b8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00f648d0-e57c-4a40-b3d0-b95d4c8fe744', 'volume_name': 'volume-00f648d0-e57c-4a40-b3d0-b95d4c8fe744', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:17:43 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-370e19a9-0843-435a-8637-264a5f4f76c1 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa886303-c170-4e0c-bc71-a6a6e08f2fec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:17:43 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-370e19a9-0843-435a-8637-264a5f4f76c1 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa886303-c170-4e0c-bc71-a6a6e08f2fec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:17:43 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-370e19a9-0843-435a-8637-264a5f4f76c1 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1bd19d9-cce6-4479-b933-733657a83195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:17:43 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-370e19a9-0843-435a-8637-264a5f4f76c1 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Volume 00f648d0-e57c-4a40-b3d0-b95d4c8fe744: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00f648d0-e57c-4a40-b3d0-b95d4c8fe744', 'volume_size': 1}
Apr 10 13:17:43 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-370e19a9-0843-435a-8637-264a5f4f76c1 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:17:44 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-aff2d534-9a2c-4311-b24b-6e3ec9040904 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:17:44 devstack sudo[89643]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:44 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-aff2d534-9a2c-4311-b24b-6e3ec9040904 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Flow 'volume_create_manager' (93a08ee3-b2d6-46f7-a11e-fbc4153c3c39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:17:44 devstack sudo[89641]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:44 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-aff2d534-9a2c-4311-b24b-6e3ec9040904 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab5e5e58-2ce7-4d02-a2bf-07f135bd33a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:17:44 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-253e85bd-5cc2-48cb-83ed-20e0fc380c29 tempest-VolumesDeleteCascade-1486359075 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4c792d1e-aaa2-4eae-aec9-45c1b4767412.1afdb4ce-13fa-4cf2-8d08-9a834a6aa661" returned: 0 in 0.546s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:44 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-8b1274fc-fe46-44f6-8c28-b093837ba907 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-d9b9ae5b-227f-4c3f-bb6e-156050b04f85 1073741824" returned: 0 in 0.601s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:44 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-253e85bd-5cc2-48cb-83ed-20e0fc380c29 tempest-VolumesDeleteCascade-1486359075 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4c792d1e-aaa2-4eae-aec9-45c1b4767412(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 13:17:44 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[08dd3f85-79a9-4fd5-b965-a4fd9fb3934e]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:17:44 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-253e85bd-5cc2-48cb-83ed-20e0fc380c29 tempest-VolumesDeleteCascade-1486359075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4c792d1e-aaa2-4eae-aec9-45c1b4767412.128c7179-8cfa-440d-bb0e-855e122afe9c {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:44 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-aff2d534-9a2c-4311-b24b-6e3ec9040904 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab5e5e58-2ce7-4d02-a2bf-07f135bd33a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:17:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1729541742',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=013dc3f9-1191-4262-91e1-7b16f7f1945e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f9d354df97e4333b5e2df1565b935c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:17:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:17:44Z,use_quota=True,user_id='65291306a8c74c4da4bc23b183835080',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:17:44 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-aff2d534-9a2c-4311-b24b-6e3ec9040904 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c22b28f2-8dc4-4b2f-ac18-8b4b37c302b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:17:44 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-aff2d534-9a2c-4311-b24b-6e3ec9040904 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c22b28f2-8dc4-4b2f-ac18-8b4b37c302b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:17:44 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-aff2d534-9a2c-4311-b24b-6e3ec9040904 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (564ee14f-609f-40c7-9e2b-804337b68f27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:17:44 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-aff2d534-9a2c-4311-b24b-6e3ec9040904 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (564ee14f-609f-40c7-9e2b-804337b68f27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '013dc3f9-1191-4262-91e1-7b16f7f1945e', 'volume_name': 'volume-013dc3f9-1191-4262-91e1-7b16f7f1945e', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:17:44 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-aff2d534-9a2c-4311-b24b-6e3ec9040904 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (275e12cb-33e3-42d3-8d6f-aacf43d706c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:17:44 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-aff2d534-9a2c-4311-b24b-6e3ec9040904 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (275e12cb-33e3-42d3-8d6f-aacf43d706c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:17:44 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-aff2d534-9a2c-4311-b24b-6e3ec9040904 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37814943-3357-4a97-805c-64dba4fa3df6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:17:44 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-aff2d534-9a2c-4311-b24b-6e3ec9040904 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Volume 013dc3f9-1191-4262-91e1-7b16f7f1945e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-013dc3f9-1191-4262-91e1-7b16f7f1945e', 'volume_size': 1}
Apr 10 13:17:44 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-aff2d534-9a2c-4311-b24b-6e3ec9040904 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:17:44 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-8b1274fc-fe46-44f6-8c28-b093837ba907 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-d9b9ae5b-227f-4c3f-bb6e-156050b04f85 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:44 devstack sudo[89651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4c792d1e-aaa2-4eae-aec9-45c1b4767412.128c7179-8cfa-440d-bb0e-855e122afe9c
Apr 10 13:17:44 devstack sudo[89651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:44 devstack sudo[89652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-d9b9ae5b-227f-4c3f-bb6e-156050b04f85
Apr 10 13:17:44 devstack sudo[89652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:44 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a45b658-b8a0-4ed2-968c-cc773493b4ff tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:17:44 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-7a45b658-b8a0-4ed2-968c-cc773493b4ff tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Flow 'volume_create_manager' (bbced55f-ba74-48ae-9715-f54ef70625d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:17:44 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-7a45b658-b8a0-4ed2-968c-cc773493b4ff tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9d32c89-d888-4ec5-8f4f-1d526ee1f936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:17:44 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-7a45b658-b8a0-4ed2-968c-cc773493b4ff tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9d32c89-d888-4ec5-8f4f-1d526ee1f936) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:17:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1066578642',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41506146-951f-46b4-9663-86c66121edcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f9d354df97e4333b5e2df1565b935c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:17:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:17:44Z,use_quota=True,user_id='65291306a8c74c4da4bc23b183835080',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:17:44 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-7a45b658-b8a0-4ed2-968c-cc773493b4ff tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d087989b-07f5-4dbb-a0a5-ebee5116691b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:17:44 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-7a45b658-b8a0-4ed2-968c-cc773493b4ff tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d087989b-07f5-4dbb-a0a5-ebee5116691b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:17:44 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-7a45b658-b8a0-4ed2-968c-cc773493b4ff tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a1ad27d-80ba-4d3b-9e0f-eaa409568a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:17:44 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-7a45b658-b8a0-4ed2-968c-cc773493b4ff tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a1ad27d-80ba-4d3b-9e0f-eaa409568a51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41506146-951f-46b4-9663-86c66121edcf', 'volume_name': 'volume-41506146-951f-46b4-9663-86c66121edcf', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:17:44 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-7a45b658-b8a0-4ed2-968c-cc773493b4ff tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc5857d2-7207-4463-8e18-3edbbb81ba56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:17:44 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-7a45b658-b8a0-4ed2-968c-cc773493b4ff tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc5857d2-7207-4463-8e18-3edbbb81ba56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:17:44 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-7a45b658-b8a0-4ed2-968c-cc773493b4ff tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfb1dc26-1df2-4e99-a902-baa760644bb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:17:44 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-7a45b658-b8a0-4ed2-968c-cc773493b4ff tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Volume 41506146-951f-46b4-9663-86c66121edcf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41506146-951f-46b4-9663-86c66121edcf', 'volume_size': 1}
Apr 10 13:17:44 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-7a45b658-b8a0-4ed2-968c-cc773493b4ff tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:17:44 devstack sudo[89652]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:44 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-8b1274fc-fe46-44f6-8c28-b093837ba907 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-d9b9ae5b-227f-4c3f-bb6e-156050b04f85" returned: 0 in 0.434s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:44 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-8b1274fc-fe46-44f6-8c28-b093837ba907 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] <== create_volume: return (1133ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'} {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 13:17:44 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-8b1274fc-fe46-44f6-8c28-b093837ba907 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.135s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:17:44 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-5dc44f9e-6588-44ca-bd6d-766f63b797ed tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.929s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:17:44 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-5dc44f9e-6588-44ca-bd6d-766f63b797ed tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f252bf08b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:17:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-408910727',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a83e57c-048d-45ed-8f4b-68980bb26ce7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f9d354df97e4333b5e2df1565b935c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:17:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:17:44Z,use_quota=True,user_id='65291306a8c74c4da4bc23b183835080',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)}" {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 13:17:44 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-5dc44f9e-6588-44ca-bd6d-766f63b797ed tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Creating volume 1a83e57c-048d-45ed-8f4b-68980bb26ce7 {{(pid=83345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 13:17:44 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-5dc44f9e-6588-44ca-bd6d-766f63b797ed tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:17:44 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-5dc44f9e-6588-44ca-bd6d-766f63b797ed tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:17:44 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-5dc44f9e-6588-44ca-bd6d-766f63b797ed tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:17:44 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-5dc44f9e-6588-44ca-bd6d-766f63b797ed tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:17:44 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-5dc44f9e-6588-44ca-bd6d-766f63b797ed tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:17:44 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-5dc44f9e-6588-44ca-bd6d-766f63b797ed tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:17:44 devstack cinder-volume[83345]: INFO cinder.volume.drivers.remotefs [None req-5dc44f9e-6588-44ca-bd6d-766f63b797ed tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] casted to osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331
Apr 10 13:17:44 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-5dc44f9e-6588-44ca-bd6d-766f63b797ed tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-1a83e57c-048d-45ed-8f4b-68980bb26ce7 1073741824 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:44 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-8b1274fc-fe46-44f6-8c28-b093837ba907 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12d25571-100a-464b-8294-e6eff5fe0eb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9b9ae5b-227f-4c3f-bb6e-156050b04f85', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:17:44 devstack sudo[89659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-1a83e57c-048d-45ed-8f4b-68980bb26ce7 1073741824
Apr 10 13:17:44 devstack sudo[89659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:44 devstack sudo[89651]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:44 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-8b1274fc-fe46-44f6-8c28-b093837ba907 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34eb0003-c060-4c4f-a626-c74b8d358cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:17:44 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-253e85bd-5cc2-48cb-83ed-20e0fc380c29 tempest-VolumesDeleteCascade-1486359075 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4c792d1e-aaa2-4eae-aec9-45c1b4767412.128c7179-8cfa-440d-bb0e-855e122afe9c" returned: 0 in 0.542s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:44 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-253e85bd-5cc2-48cb-83ed-20e0fc380c29 tempest-VolumesDeleteCascade-1486359075 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4c792d1e-aaa2-4eae-aec9-45c1b4767412(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 13:17:44 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-8b1274fc-fe46-44f6-8c28-b093837ba907 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Volume volume-d9b9ae5b-227f-4c3f-bb6e-156050b04f85 (d9b9ae5b-227f-4c3f-bb6e-156050b04f85): created successfully
Apr 10 13:17:44 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-8b1274fc-fe46-44f6-8c28-b093837ba907 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34eb0003-c060-4c4f-a626-c74b8d358cef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:17:44 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-8b1274fc-fe46-44f6-8c28-b093837ba907 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Flow 'volume_create_manager' (71deb842-f30f-4a28-aa34-542ce076d0e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:17:44 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f43e0b4-2598-4a6b-b4a5-e0cf61c641e0]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:17:44 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-253e85bd-5cc2-48cb-83ed-20e0fc380c29 tempest-VolumesDeleteCascade-1486359075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4c792d1e-aaa2-4eae-aec9-45c1b4767412 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:44 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-8b1274fc-fe46-44f6-8c28-b093837ba907 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Created volume successfully.
Apr 10 13:17:44 devstack sudo[89661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4c792d1e-aaa2-4eae-aec9-45c1b4767412
Apr 10 13:17:44 devstack sudo[89661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:45 devstack sudo[89659]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:45 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-5dc44f9e-6588-44ca-bd6d-766f63b797ed tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-1a83e57c-048d-45ed-8f4b-68980bb26ce7 1073741824" returned: 0 in 0.461s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:45 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-5dc44f9e-6588-44ca-bd6d-766f63b797ed tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-1a83e57c-048d-45ed-8f4b-68980bb26ce7 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:45 devstack sudo[89666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-1a83e57c-048d-45ed-8f4b-68980bb26ce7
Apr 10 13:17:45 devstack sudo[89666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:45 devstack sudo[89661]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:45 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-253e85bd-5cc2-48cb-83ed-20e0fc380c29 tempest-VolumesDeleteCascade-1486359075 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4c792d1e-aaa2-4eae-aec9-45c1b4767412" returned: 0 in 0.556s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:45 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-253e85bd-5cc2-48cb-83ed-20e0fc380c29 tempest-VolumesDeleteCascade-1486359075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4c792d1e-aaa2-4eae-aec9-45c1b4767412.128c7179-8cfa-440d-bb0e-855e122afe9c {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:45 devstack sudo[89671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4c792d1e-aaa2-4eae-aec9-45c1b4767412.128c7179-8cfa-440d-bb0e-855e122afe9c
Apr 10 13:17:45 devstack sudo[89671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:45 devstack sudo[89666]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:45 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-5dc44f9e-6588-44ca-bd6d-766f63b797ed tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-1a83e57c-048d-45ed-8f4b-68980bb26ce7" returned: 0 in 0.440s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:45 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-5dc44f9e-6588-44ca-bd6d-766f63b797ed tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'} {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 13:17:45 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-5dc44f9e-6588-44ca-bd6d-766f63b797ed tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:17:45 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-370e19a9-0843-435a-8637-264a5f4f76c1 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.670s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:17:45 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-370e19a9-0843-435a-8637-264a5f4f76c1 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f252bf08b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:17:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1113315777',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00f648d0-e57c-4a40-b3d0-b95d4c8fe744,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f9d354df97e4333b5e2df1565b935c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:17:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:17:44Z,use_quota=True,user_id='65291306a8c74c4da4bc23b183835080',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)}" {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 13:17:45 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-370e19a9-0843-435a-8637-264a5f4f76c1 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Creating volume 00f648d0-e57c-4a40-b3d0-b95d4c8fe744 {{(pid=83345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 13:17:45 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-370e19a9-0843-435a-8637-264a5f4f76c1 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:17:45 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-370e19a9-0843-435a-8637-264a5f4f76c1 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:17:45 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-370e19a9-0843-435a-8637-264a5f4f76c1 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:17:45 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-370e19a9-0843-435a-8637-264a5f4f76c1 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:17:45 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-370e19a9-0843-435a-8637-264a5f4f76c1 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:17:45 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-370e19a9-0843-435a-8637-264a5f4f76c1 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:17:45 devstack cinder-volume[83345]: INFO cinder.volume.drivers.remotefs [None req-370e19a9-0843-435a-8637-264a5f4f76c1 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] casted to osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331
Apr 10 13:17:45 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-370e19a9-0843-435a-8637-264a5f4f76c1 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-00f648d0-e57c-4a40-b3d0-b95d4c8fe744 1073741824 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:45 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-5dc44f9e-6588-44ca-bd6d-766f63b797ed tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b0e62ff-a1a7-4429-b983-f755162e88e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a83e57c-048d-45ed-8f4b-68980bb26ce7', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:17:45 devstack sudo[89674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-00f648d0-e57c-4a40-b3d0-b95d4c8fe744 1073741824
Apr 10 13:17:45 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-5dc44f9e-6588-44ca-bd6d-766f63b797ed tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (482c5bdd-c1cd-4739-98fc-69baae1691fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:17:45 devstack sudo[89674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:45 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-5dc44f9e-6588-44ca-bd6d-766f63b797ed tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Volume volume-1a83e57c-048d-45ed-8f4b-68980bb26ce7 (1a83e57c-048d-45ed-8f4b-68980bb26ce7): created successfully
Apr 10 13:17:45 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-5dc44f9e-6588-44ca-bd6d-766f63b797ed tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (482c5bdd-c1cd-4739-98fc-69baae1691fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:17:45 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-5dc44f9e-6588-44ca-bd6d-766f63b797ed tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Flow 'volume_create_manager' (a69d18bd-4eb4-4e6c-bb4f-65e4cfd0f41c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:17:45 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-5dc44f9e-6588-44ca-bd6d-766f63b797ed tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Created volume successfully.
Apr 10 13:17:45 devstack sudo[89671]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:45 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-253e85bd-5cc2-48cb-83ed-20e0fc380c29 tempest-VolumesDeleteCascade-1486359075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4c792d1e-aaa2-4eae-aec9-45c1b4767412.128c7179-8cfa-440d-bb0e-855e122afe9c" returned: 0 in 0.498s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:45 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-253e85bd-5cc2-48cb-83ed-20e0fc380c29 tempest-VolumesDeleteCascade-1486359075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4c792d1e-aaa2-4eae-aec9-45c1b4767412.128c7179-8cfa-440d-bb0e-855e122afe9c {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:45 devstack sudo[89679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4c792d1e-aaa2-4eae-aec9-45c1b4767412.128c7179-8cfa-440d-bb0e-855e122afe9c
Apr 10 13:17:45 devstack sudo[89679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:46 devstack sudo[89674]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:46 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-370e19a9-0843-435a-8637-264a5f4f76c1 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-00f648d0-e57c-4a40-b3d0-b95d4c8fe744 1073741824" returned: 0 in 0.469s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:46 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-370e19a9-0843-435a-8637-264a5f4f76c1 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-00f648d0-e57c-4a40-b3d0-b95d4c8fe744 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:46 devstack sudo[89684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-00f648d0-e57c-4a40-b3d0-b95d4c8fe744
Apr 10 13:17:46 devstack sudo[89684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:46 devstack sudo[89679]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:46 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-253e85bd-5cc2-48cb-83ed-20e0fc380c29 tempest-VolumesDeleteCascade-1486359075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4c792d1e-aaa2-4eae-aec9-45c1b4767412.128c7179-8cfa-440d-bb0e-855e122afe9c" returned: 0 in 0.454s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:46 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-253e85bd-5cc2-48cb-83ed-20e0fc380c29 tempest-VolumesDeleteCascade-1486359075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c792d1e-aaa2-4eae-aec9-45c1b4767412 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4c792d1e-aaa2-4eae-aec9-45c1b4767412.1afdb4ce-13fa-4cf2-8d08-9a834a6aa661 -F qcow2 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:46 devstack sudo[89687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c792d1e-aaa2-4eae-aec9-45c1b4767412 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4c792d1e-aaa2-4eae-aec9-45c1b4767412.1afdb4ce-13fa-4cf2-8d08-9a834a6aa661 -F qcow2
Apr 10 13:17:46 devstack sudo[89687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:46 devstack sudo[89684]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:46 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-370e19a9-0843-435a-8637-264a5f4f76c1 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-00f648d0-e57c-4a40-b3d0-b95d4c8fe744" returned: 0 in 0.443s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:46 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-370e19a9-0843-435a-8637-264a5f4f76c1 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] <== create_volume: return (939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'} {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 13:17:46 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-370e19a9-0843-435a-8637-264a5f4f76c1 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:17:46 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-aff2d534-9a2c-4311-b24b-6e3ec9040904 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.323s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:17:46 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-aff2d534-9a2c-4311-b24b-6e3ec9040904 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f252bf08b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:17:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1729541742',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=013dc3f9-1191-4262-91e1-7b16f7f1945e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f9d354df97e4333b5e2df1565b935c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:17:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:17:44Z,use_quota=True,user_id='65291306a8c74c4da4bc23b183835080',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)}" {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 13:17:46 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-aff2d534-9a2c-4311-b24b-6e3ec9040904 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Creating volume 013dc3f9-1191-4262-91e1-7b16f7f1945e {{(pid=83345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 13:17:46 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-aff2d534-9a2c-4311-b24b-6e3ec9040904 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:17:46 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-aff2d534-9a2c-4311-b24b-6e3ec9040904 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:17:46 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-aff2d534-9a2c-4311-b24b-6e3ec9040904 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:17:46 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-aff2d534-9a2c-4311-b24b-6e3ec9040904 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:17:46 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-aff2d534-9a2c-4311-b24b-6e3ec9040904 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:17:46 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-aff2d534-9a2c-4311-b24b-6e3ec9040904 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:17:46 devstack cinder-volume[83345]: INFO cinder.volume.drivers.remotefs [None req-aff2d534-9a2c-4311-b24b-6e3ec9040904 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] casted to osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331
Apr 10 13:17:46 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-aff2d534-9a2c-4311-b24b-6e3ec9040904 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-013dc3f9-1191-4262-91e1-7b16f7f1945e 1073741824 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:46 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-370e19a9-0843-435a-8637-264a5f4f76c1 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1bd19d9-cce6-4479-b933-733657a83195) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00f648d0-e57c-4a40-b3d0-b95d4c8fe744', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:17:46 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-370e19a9-0843-435a-8637-264a5f4f76c1 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e21bfce6-9b53-45f3-836c-042d2b704bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:17:46 devstack sudo[89690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-013dc3f9-1191-4262-91e1-7b16f7f1945e 1073741824
Apr 10 13:17:46 devstack sudo[89690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:46 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-370e19a9-0843-435a-8637-264a5f4f76c1 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Volume volume-00f648d0-e57c-4a40-b3d0-b95d4c8fe744 (00f648d0-e57c-4a40-b3d0-b95d4c8fe744): created successfully
Apr 10 13:17:46 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-370e19a9-0843-435a-8637-264a5f4f76c1 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e21bfce6-9b53-45f3-836c-042d2b704bd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:17:46 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-370e19a9-0843-435a-8637-264a5f4f76c1 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Flow 'volume_create_manager' (43bc644f-dd3b-4902-a31a-3413f4c1855e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:17:46 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-370e19a9-0843-435a-8637-264a5f4f76c1 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Created volume successfully.
Apr 10 13:17:46 devstack sudo[89687]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:46 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-253e85bd-5cc2-48cb-83ed-20e0fc380c29 tempest-VolumesDeleteCascade-1486359075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c792d1e-aaa2-4eae-aec9-45c1b4767412 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4c792d1e-aaa2-4eae-aec9-45c1b4767412.1afdb4ce-13fa-4cf2-8d08-9a834a6aa661 -F qcow2" returned: 0 in 0.479s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:46 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-253e85bd-5cc2-48cb-83ed-20e0fc380c29 tempest-VolumesDeleteCascade-1486359075 None] Lock "cinder-quobyte-128c7179-8cfa-440d-bb0e-855e122afe9c" released by "_delete_snapshot" :: held 4.233s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:17:46 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-253e85bd-5cc2-48cb-83ed-20e0fc380c29 tempest-VolumesDeleteCascade-1486359075 None] Lock "cinder-quobyte-4c792d1e-aaa2-4eae-aec9-45c1b4767412" released by "delete_snapshot" :: held 4.245s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:17:46 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-253e85bd-5cc2-48cb-83ed-20e0fc380c29 tempest-VolumesDeleteCascade-1486359075 None] Created reservations ['87dc255b-1e14-4fde-8410-6381d078fb48', '151bda23-8f6b-473e-8ff2-2c1175c0f257', '7af21111-bd6a-4680-a17f-1fa19a7d591c', '2b2a69e5-f0a7-4ede-8b8a-2bfc41228b9c'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:17:46 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-253e85bd-5cc2-48cb-83ed-20e0fc380c29 tempest-VolumesDeleteCascade-1486359075 None] Delete snapshot completed successfully.
Apr 10 13:17:46 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-253e85bd-5cc2-48cb-83ed-20e0fc380c29 tempest-VolumesDeleteCascade-1486359075 None] Lock "cinder-128c7179-8cfa-440d-bb0e-855e122afe9c-delete_snapshot" released by "delete_snapshot" :: held 4.337s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:17:46 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-253e85bd-5cc2-48cb-83ed-20e0fc380c29 tempest-VolumesDeleteCascade-1486359075 None] Acquiring lock "cinder-1afdb4ce-13fa-4cf2-8d08-9a834a6aa661-delete_snapshot" by "delete_snapshot" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:17:46 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-253e85bd-5cc2-48cb-83ed-20e0fc380c29 tempest-VolumesDeleteCascade-1486359075 None] Lock "cinder-1afdb4ce-13fa-4cf2-8d08-9a834a6aa661-delete_snapshot" acquired by "delete_snapshot" :: waited 0.007s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:17:46 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-253e85bd-5cc2-48cb-83ed-20e0fc380c29 tempest-VolumesDeleteCascade-1486359075 None] Acquiring lock "cinder-quobyte-4c792d1e-aaa2-4eae-aec9-45c1b4767412" by "delete_snapshot" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:17:46 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-253e85bd-5cc2-48cb-83ed-20e0fc380c29 tempest-VolumesDeleteCascade-1486359075 None] Lock "cinder-quobyte-4c792d1e-aaa2-4eae-aec9-45c1b4767412" acquired by "delete_snapshot" :: waited 0.006s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:17:46 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-253e85bd-5cc2-48cb-83ed-20e0fc380c29 tempest-VolumesDeleteCascade-1486359075 None] Acquiring lock "cinder-quobyte-1afdb4ce-13fa-4cf2-8d08-9a834a6aa661" by "_delete_snapshot" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:17:46 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-253e85bd-5cc2-48cb-83ed-20e0fc380c29 tempest-VolumesDeleteCascade-1486359075 None] Lock "cinder-quobyte-1afdb4ce-13fa-4cf2-8d08-9a834a6aa661" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:17:46 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-253e85bd-5cc2-48cb-83ed-20e0fc380c29 tempest-VolumesDeleteCascade-1486359075 None] Deleting offline snapshot 1afdb4ce-13fa-4cf2-8d08-9a834a6aa661 of volume 4c792d1e-aaa2-4eae-aec9-45c1b4767412 {{(pid=83345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 10 13:17:46 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-253e85bd-5cc2-48cb-83ed-20e0fc380c29 tempest-VolumesDeleteCascade-1486359075 None] snapshot_file for this snap is: volume-4c792d1e-aaa2-4eae-aec9-45c1b4767412.1afdb4ce-13fa-4cf2-8d08-9a834a6aa661 {{(pid=83345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 10 13:17:46 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ebd6353-5d0c-4020-a5e1-ba32a4854f9b]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:17:46 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-253e85bd-5cc2-48cb-83ed-20e0fc380c29 tempest-VolumesDeleteCascade-1486359075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4c792d1e-aaa2-4eae-aec9-45c1b4767412.1afdb4ce-13fa-4cf2-8d08-9a834a6aa661 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:46 devstack sudo[89697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4c792d1e-aaa2-4eae-aec9-45c1b4767412.1afdb4ce-13fa-4cf2-8d08-9a834a6aa661
Apr 10 13:17:46 devstack sudo[89697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:47 devstack sudo[89690]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:47 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-aff2d534-9a2c-4311-b24b-6e3ec9040904 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-013dc3f9-1191-4262-91e1-7b16f7f1945e 1073741824" returned: 0 in 0.498s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:47 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-aff2d534-9a2c-4311-b24b-6e3ec9040904 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-013dc3f9-1191-4262-91e1-7b16f7f1945e {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:47 devstack sudo[89702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-013dc3f9-1191-4262-91e1-7b16f7f1945e
Apr 10 13:17:47 devstack sudo[89702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:47 devstack sudo[89697]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:47 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-253e85bd-5cc2-48cb-83ed-20e0fc380c29 tempest-VolumesDeleteCascade-1486359075 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4c792d1e-aaa2-4eae-aec9-45c1b4767412.1afdb4ce-13fa-4cf2-8d08-9a834a6aa661" returned: 0 in 0.491s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:47 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-253e85bd-5cc2-48cb-83ed-20e0fc380c29 tempest-VolumesDeleteCascade-1486359075 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4c792d1e-aaa2-4eae-aec9-45c1b4767412(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 13:17:47 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dbb6cab-7d0c-42e4-b4af-5d058aea8d49]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:17:47 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-253e85bd-5cc2-48cb-83ed-20e0fc380c29 tempest-VolumesDeleteCascade-1486359075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4c792d1e-aaa2-4eae-aec9-45c1b4767412 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:47 devstack sudo[89707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4c792d1e-aaa2-4eae-aec9-45c1b4767412
Apr 10 13:17:47 devstack sudo[89707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:47 devstack sudo[89702]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:47 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-aff2d534-9a2c-4311-b24b-6e3ec9040904 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-013dc3f9-1191-4262-91e1-7b16f7f1945e" returned: 0 in 0.430s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:47 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-aff2d534-9a2c-4311-b24b-6e3ec9040904 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] <== create_volume: return (953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'} {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 13:17:47 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-aff2d534-9a2c-4311-b24b-6e3ec9040904 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.956s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:17:47 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-7a45b658-b8a0-4ed2-968c-cc773493b4ff tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.086s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:17:47 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-7a45b658-b8a0-4ed2-968c-cc773493b4ff tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f252bf08b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:17:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1066578642',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41506146-951f-46b4-9663-86c66121edcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f9d354df97e4333b5e2df1565b935c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:17:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:17:44Z,use_quota=True,user_id='65291306a8c74c4da4bc23b183835080',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)}" {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 13:17:47 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-7a45b658-b8a0-4ed2-968c-cc773493b4ff tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Creating volume 41506146-951f-46b4-9663-86c66121edcf {{(pid=83345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 13:17:47 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-7a45b658-b8a0-4ed2-968c-cc773493b4ff tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:17:47 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-7a45b658-b8a0-4ed2-968c-cc773493b4ff tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:17:47 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-7a45b658-b8a0-4ed2-968c-cc773493b4ff tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:17:47 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-7a45b658-b8a0-4ed2-968c-cc773493b4ff tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:17:47 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-7a45b658-b8a0-4ed2-968c-cc773493b4ff tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:17:47 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-7a45b658-b8a0-4ed2-968c-cc773493b4ff tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:17:47 devstack cinder-volume[83345]: INFO cinder.volume.drivers.remotefs [None req-7a45b658-b8a0-4ed2-968c-cc773493b4ff tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] casted to osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331
Apr 10 13:17:47 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-7a45b658-b8a0-4ed2-968c-cc773493b4ff tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-41506146-951f-46b4-9663-86c66121edcf 1073741824 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:47 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-aff2d534-9a2c-4311-b24b-6e3ec9040904 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37814943-3357-4a97-805c-64dba4fa3df6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-013dc3f9-1191-4262-91e1-7b16f7f1945e', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:17:47 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-aff2d534-9a2c-4311-b24b-6e3ec9040904 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15fb38d9-24b7-486e-a1ae-108ab860b039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:17:47 devstack sudo[89710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-41506146-951f-46b4-9663-86c66121edcf 1073741824
Apr 10 13:17:47 devstack sudo[89710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:47 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-aff2d534-9a2c-4311-b24b-6e3ec9040904 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Volume volume-013dc3f9-1191-4262-91e1-7b16f7f1945e (013dc3f9-1191-4262-91e1-7b16f7f1945e): created successfully
Apr 10 13:17:47 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-aff2d534-9a2c-4311-b24b-6e3ec9040904 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15fb38d9-24b7-486e-a1ae-108ab860b039) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:17:47 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-aff2d534-9a2c-4311-b24b-6e3ec9040904 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Flow 'volume_create_manager' (93a08ee3-b2d6-46f7-a11e-fbc4153c3c39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:17:47 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-aff2d534-9a2c-4311-b24b-6e3ec9040904 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Created volume successfully.
Apr 10 13:17:47 devstack sudo[89707]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:47 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-253e85bd-5cc2-48cb-83ed-20e0fc380c29 tempest-VolumesDeleteCascade-1486359075 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4c792d1e-aaa2-4eae-aec9-45c1b4767412" returned: 0 in 0.515s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:47 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-253e85bd-5cc2-48cb-83ed-20e0fc380c29 tempest-VolumesDeleteCascade-1486359075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4c792d1e-aaa2-4eae-aec9-45c1b4767412.1afdb4ce-13fa-4cf2-8d08-9a834a6aa661 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:47 devstack sudo[89717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4c792d1e-aaa2-4eae-aec9-45c1b4767412.1afdb4ce-13fa-4cf2-8d08-9a834a6aa661
Apr 10 13:17:47 devstack sudo[89717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:48 devstack sudo[89710]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:48 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-7a45b658-b8a0-4ed2-968c-cc773493b4ff tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-41506146-951f-46b4-9663-86c66121edcf 1073741824" returned: 0 in 0.488s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:48 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-7a45b658-b8a0-4ed2-968c-cc773493b4ff tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-41506146-951f-46b4-9663-86c66121edcf {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:48 devstack sudo[89720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-41506146-951f-46b4-9663-86c66121edcf
Apr 10 13:17:48 devstack sudo[89720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:48 devstack sudo[89717]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:48 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-253e85bd-5cc2-48cb-83ed-20e0fc380c29 tempest-VolumesDeleteCascade-1486359075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4c792d1e-aaa2-4eae-aec9-45c1b4767412.1afdb4ce-13fa-4cf2-8d08-9a834a6aa661" returned: 0 in 0.485s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:48 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-253e85bd-5cc2-48cb-83ed-20e0fc380c29 tempest-VolumesDeleteCascade-1486359075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4c792d1e-aaa2-4eae-aec9-45c1b4767412.1afdb4ce-13fa-4cf2-8d08-9a834a6aa661 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:48 devstack sudo[89726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4c792d1e-aaa2-4eae-aec9-45c1b4767412.1afdb4ce-13fa-4cf2-8d08-9a834a6aa661
Apr 10 13:17:48 devstack sudo[89726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:48 devstack sudo[89720]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:48 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-7a45b658-b8a0-4ed2-968c-cc773493b4ff tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-41506146-951f-46b4-9663-86c66121edcf" returned: 0 in 0.399s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:48 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-7a45b658-b8a0-4ed2-968c-cc773493b4ff tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] <== create_volume: return (919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'} {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 13:17:48 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-7a45b658-b8a0-4ed2-968c-cc773493b4ff tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:17:48 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-7a45b658-b8a0-4ed2-968c-cc773493b4ff tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfb1dc26-1df2-4e99-a902-baa760644bb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41506146-951f-46b4-9663-86c66121edcf', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:17:48 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-7a45b658-b8a0-4ed2-968c-cc773493b4ff tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea8c5e15-30ff-483b-9e1b-cab4c71a1b1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:17:48 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-7a45b658-b8a0-4ed2-968c-cc773493b4ff tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Volume volume-41506146-951f-46b4-9663-86c66121edcf (41506146-951f-46b4-9663-86c66121edcf): created successfully
Apr 10 13:17:48 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-7a45b658-b8a0-4ed2-968c-cc773493b4ff tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea8c5e15-30ff-483b-9e1b-cab4c71a1b1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:17:48 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-7a45b658-b8a0-4ed2-968c-cc773493b4ff tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Flow 'volume_create_manager' (bbced55f-ba74-48ae-9715-f54ef70625d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:17:48 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-7a45b658-b8a0-4ed2-968c-cc773493b4ff tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Created volume successfully.
Apr 10 13:17:48 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-105bcf6e-a383-403a-b0c7-fa3a2aca5ce4 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Acquiring lock "cinder-41506146-951f-46b4-9663-86c66121edcf-delete_volume" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:17:48 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-105bcf6e-a383-403a-b0c7-fa3a2aca5ce4 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Lock "cinder-41506146-951f-46b4-9663-86c66121edcf-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:17:48 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-105bcf6e-a383-403a-b0c7-fa3a2aca5ce4 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Acquiring lock "cinder-quobyte-41506146-951f-46b4-9663-86c66121edcf" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:17:48 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-105bcf6e-a383-403a-b0c7-fa3a2aca5ce4 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Lock "cinder-quobyte-41506146-951f-46b4-9663-86c66121edcf" acquired by "delete_volume" :: waited 0.019s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:17:48 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b0e254b-7a93-40e3-a17b-9e85024e5cec]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:17:48 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-105bcf6e-a383-403a-b0c7-fa3a2aca5ce4 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-41506146-951f-46b4-9663-86c66121edcf {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:48 devstack sudo[89726]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:48 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-253e85bd-5cc2-48cb-83ed-20e0fc380c29 tempest-VolumesDeleteCascade-1486359075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4c792d1e-aaa2-4eae-aec9-45c1b4767412.1afdb4ce-13fa-4cf2-8d08-9a834a6aa661" returned: 0 in 0.458s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:48 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-253e85bd-5cc2-48cb-83ed-20e0fc380c29 tempest-VolumesDeleteCascade-1486359075 None] Lock "cinder-quobyte-1afdb4ce-13fa-4cf2-8d08-9a834a6aa661" released by "_delete_snapshot" :: held 1.994s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:17:48 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-253e85bd-5cc2-48cb-83ed-20e0fc380c29 tempest-VolumesDeleteCascade-1486359075 None] Lock "cinder-quobyte-4c792d1e-aaa2-4eae-aec9-45c1b4767412" released by "delete_snapshot" :: held 2.007s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:17:48 devstack sudo[89729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-41506146-951f-46b4-9663-86c66121edcf
Apr 10 13:17:48 devstack sudo[89729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:48 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-253e85bd-5cc2-48cb-83ed-20e0fc380c29 tempest-VolumesDeleteCascade-1486359075 None] Created reservations ['44a8bdfa-910b-4fe4-bcc7-2f992d1640ed', 'b8b865e0-f47b-4f12-8f92-3499ffa8e40e', 'e4bcdd6a-77bf-414c-9652-574f4a60a1c6', 'd8905ef3-737d-44ac-a738-5e76bee09775'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:17:48 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-253e85bd-5cc2-48cb-83ed-20e0fc380c29 tempest-VolumesDeleteCascade-1486359075 None] Delete snapshot completed successfully.
Apr 10 13:17:48 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-253e85bd-5cc2-48cb-83ed-20e0fc380c29 tempest-VolumesDeleteCascade-1486359075 None] Lock "cinder-1afdb4ce-13fa-4cf2-8d08-9a834a6aa661-delete_snapshot" released by "delete_snapshot" :: held 2.103s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:17:48 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-253e85bd-5cc2-48cb-83ed-20e0fc380c29 tempest-VolumesDeleteCascade-1486359075 None] Snapshots deleted, issuing volume delete {{(pid=83345) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Apr 10 13:17:48 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-253e85bd-5cc2-48cb-83ed-20e0fc380c29 tempest-VolumesDeleteCascade-1486359075 None] Acquiring lock "cinder-quobyte-4c792d1e-aaa2-4eae-aec9-45c1b4767412" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:17:48 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-253e85bd-5cc2-48cb-83ed-20e0fc380c29 tempest-VolumesDeleteCascade-1486359075 None] Lock "cinder-quobyte-4c792d1e-aaa2-4eae-aec9-45c1b4767412" acquired by "delete_volume" :: waited 0.007s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:17:48 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[27b6b72f-c4c1-493d-aac2-6c0a7b4a393a]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:17:48 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-253e85bd-5cc2-48cb-83ed-20e0fc380c29 tempest-VolumesDeleteCascade-1486359075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4c792d1e-aaa2-4eae-aec9-45c1b4767412 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:49 devstack sudo[89731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4c792d1e-aaa2-4eae-aec9-45c1b4767412
Apr 10 13:17:49 devstack sudo[89731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:49 devstack sudo[89729]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:49 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-105bcf6e-a383-403a-b0c7-fa3a2aca5ce4 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-41506146-951f-46b4-9663-86c66121edcf" returned: 0 in 0.463s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:49 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-105bcf6e-a383-403a-b0c7-fa3a2aca5ce4 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-41506146-951f-46b4-9663-86c66121edcf {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:49 devstack sudo[89736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-41506146-951f-46b4-9663-86c66121edcf
Apr 10 13:17:49 devstack sudo[89736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:49 devstack sudo[89731]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:49 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-253e85bd-5cc2-48cb-83ed-20e0fc380c29 tempest-VolumesDeleteCascade-1486359075 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4c792d1e-aaa2-4eae-aec9-45c1b4767412" returned: 0 in 0.496s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:49 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-253e85bd-5cc2-48cb-83ed-20e0fc380c29 tempest-VolumesDeleteCascade-1486359075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4c792d1e-aaa2-4eae-aec9-45c1b4767412 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:49 devstack sudo[89741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4c792d1e-aaa2-4eae-aec9-45c1b4767412
Apr 10 13:17:49 devstack sudo[89741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:49 devstack sudo[89736]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:49 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-105bcf6e-a383-403a-b0c7-fa3a2aca5ce4 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-41506146-951f-46b4-9663-86c66121edcf" returned: 0 in 0.398s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:49 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-105bcf6e-a383-403a-b0c7-fa3a2aca5ce4 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Lock "cinder-quobyte-41506146-951f-46b4-9663-86c66121edcf" released by "delete_volume" :: held 0.883s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:17:49 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-105bcf6e-a383-403a-b0c7-fa3a2aca5ce4 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Created reservations ['8a0a352f-614c-4359-928b-87af5ee406bc', '2fc78e8e-4df6-4f72-8257-7be43c9cb7e5', 'e5c2388a-a91d-4c03-8f4f-57b8d573c566', 'a4be908d-63cc-4580-97e9-90b3b768a7f0'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:17:49 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-105bcf6e-a383-403a-b0c7-fa3a2aca5ce4 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:17:49 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-105bcf6e-a383-403a-b0c7-fa3a2aca5ce4 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:17:49 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-105bcf6e-a383-403a-b0c7-fa3a2aca5ce4 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:17:49 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-105bcf6e-a383-403a-b0c7-fa3a2aca5ce4 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:17:49 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-105bcf6e-a383-403a-b0c7-fa3a2aca5ce4 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:17:49 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-105bcf6e-a383-403a-b0c7-fa3a2aca5ce4 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:49 devstack sudo[89744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:17:49 devstack sudo[89744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:49 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-592491e4-34cf-4ae7-8516-7bbb1b2e737c tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Acquiring lock "cinder-013dc3f9-1191-4262-91e1-7b16f7f1945e-delete_volume" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:17:49 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-592491e4-34cf-4ae7-8516-7bbb1b2e737c tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Lock "cinder-013dc3f9-1191-4262-91e1-7b16f7f1945e-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:17:49 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-592491e4-34cf-4ae7-8516-7bbb1b2e737c tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Acquiring lock "cinder-quobyte-013dc3f9-1191-4262-91e1-7b16f7f1945e" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:17:49 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-592491e4-34cf-4ae7-8516-7bbb1b2e737c tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Lock "cinder-quobyte-013dc3f9-1191-4262-91e1-7b16f7f1945e" acquired by "delete_volume" :: waited 0.026s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:17:49 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1413fa5-0747-4476-a84d-0e8bd46604b7]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:17:49 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-592491e4-34cf-4ae7-8516-7bbb1b2e737c tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-013dc3f9-1191-4262-91e1-7b16f7f1945e {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:49 devstack sudo[89741]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:49 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-253e85bd-5cc2-48cb-83ed-20e0fc380c29 tempest-VolumesDeleteCascade-1486359075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4c792d1e-aaa2-4eae-aec9-45c1b4767412" returned: 0 in 0.472s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:49 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-253e85bd-5cc2-48cb-83ed-20e0fc380c29 tempest-VolumesDeleteCascade-1486359075 None] Lock "cinder-quobyte-4c792d1e-aaa2-4eae-aec9-45c1b4767412" released by "delete_volume" :: held 0.999s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:17:49 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-253e85bd-5cc2-48cb-83ed-20e0fc380c29 tempest-VolumesDeleteCascade-1486359075 None] Created reservations ['41c75575-c1d4-48f8-8490-7c74bde44fb0', '113f1a47-a0b9-4936-8f72-2a87faaa2e40', 'fdff9994-b228-42d2-b748-85cca9e7c0ab', 'a4a73725-effc-4ed1-ae3e-5484879f59ff'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:17:50 devstack sudo[89747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-013dc3f9-1191-4262-91e1-7b16f7f1945e
Apr 10 13:17:50 devstack sudo[89747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:50 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-253e85bd-5cc2-48cb-83ed-20e0fc380c29 tempest-VolumesDeleteCascade-1486359075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:17:50 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-253e85bd-5cc2-48cb-83ed-20e0fc380c29 tempest-VolumesDeleteCascade-1486359075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:17:50 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-253e85bd-5cc2-48cb-83ed-20e0fc380c29 tempest-VolumesDeleteCascade-1486359075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:17:50 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-253e85bd-5cc2-48cb-83ed-20e0fc380c29 tempest-VolumesDeleteCascade-1486359075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:17:50 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-253e85bd-5cc2-48cb-83ed-20e0fc380c29 tempest-VolumesDeleteCascade-1486359075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:17:50 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-253e85bd-5cc2-48cb-83ed-20e0fc380c29 tempest-VolumesDeleteCascade-1486359075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:50 devstack sudo[89749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:17:50 devstack sudo[89749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:50 devstack sudo[89744]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:50 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-105bcf6e-a383-403a-b0c7-fa3a2aca5ce4 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.437s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:50 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-105bcf6e-a383-403a-b0c7-fa3a2aca5ce4 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:17:50 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-105bcf6e-a383-403a-b0c7-fa3a2aca5ce4 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Deleted volume successfully.
Apr 10 13:17:50 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-105bcf6e-a383-403a-b0c7-fa3a2aca5ce4 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Lock "cinder-41506146-951f-46b4-9663-86c66121edcf-delete_volume" released by "delete_volume" :: held 1.466s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:17:50 devstack sudo[89747]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:50 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-592491e4-34cf-4ae7-8516-7bbb1b2e737c tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-013dc3f9-1191-4262-91e1-7b16f7f1945e" returned: 0 in 0.507s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:50 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-592491e4-34cf-4ae7-8516-7bbb1b2e737c tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-013dc3f9-1191-4262-91e1-7b16f7f1945e {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:50 devstack sudo[89749]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:50 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-253e85bd-5cc2-48cb-83ed-20e0fc380c29 tempest-VolumesDeleteCascade-1486359075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.422s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:50 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-253e85bd-5cc2-48cb-83ed-20e0fc380c29 tempest-VolumesDeleteCascade-1486359075 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:17:50 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-253e85bd-5cc2-48cb-83ed-20e0fc380c29 tempest-VolumesDeleteCascade-1486359075 None] Deleted volume successfully.
Apr 10 13:17:50 devstack sudo[89756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-013dc3f9-1191-4262-91e1-7b16f7f1945e
Apr 10 13:17:50 devstack sudo[89756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:50 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-253e85bd-5cc2-48cb-83ed-20e0fc380c29 tempest-VolumesDeleteCascade-1486359075 None] Lock "cinder-4c792d1e-aaa2-4eae-aec9-45c1b4767412-delete_volume" released by "delete_volume" :: held 8.026s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:17:50 devstack sudo[89756]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:50 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-592491e4-34cf-4ae7-8516-7bbb1b2e737c tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-013dc3f9-1191-4262-91e1-7b16f7f1945e" returned: 0 in 0.428s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:50 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-592491e4-34cf-4ae7-8516-7bbb1b2e737c tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Lock "cinder-quobyte-013dc3f9-1191-4262-91e1-7b16f7f1945e" released by "delete_volume" :: held 0.957s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:17:50 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-592491e4-34cf-4ae7-8516-7bbb1b2e737c tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Created reservations ['3706fc66-59c1-4032-bf5e-2ec54bbcd127', 'a78cd522-f05f-413c-a585-52ece570eb87', '7fa8461d-d7c5-47d6-8d57-f960a0924f68', '286f9ee9-5601-4435-ba6f-428084c008ff'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:17:50 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-592491e4-34cf-4ae7-8516-7bbb1b2e737c tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:17:50 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-592491e4-34cf-4ae7-8516-7bbb1b2e737c tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:17:50 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-592491e4-34cf-4ae7-8516-7bbb1b2e737c tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:17:50 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-592491e4-34cf-4ae7-8516-7bbb1b2e737c tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:17:50 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-592491e4-34cf-4ae7-8516-7bbb1b2e737c tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:17:50 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-592491e4-34cf-4ae7-8516-7bbb1b2e737c tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:50 devstack sudo[89759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:17:50 devstack sudo[89759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:50 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-04fcf7eb-0c99-4177-a5d6-7ff0ddb9ac32 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Acquiring lock "cinder-00f648d0-e57c-4a40-b3d0-b95d4c8fe744-delete_volume" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:17:51 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-04fcf7eb-0c99-4177-a5d6-7ff0ddb9ac32 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Lock "cinder-00f648d0-e57c-4a40-b3d0-b95d4c8fe744-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:17:51 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-04fcf7eb-0c99-4177-a5d6-7ff0ddb9ac32 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Acquiring lock "cinder-quobyte-00f648d0-e57c-4a40-b3d0-b95d4c8fe744" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:17:51 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-04fcf7eb-0c99-4177-a5d6-7ff0ddb9ac32 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Lock "cinder-quobyte-00f648d0-e57c-4a40-b3d0-b95d4c8fe744" acquired by "delete_volume" :: waited 0.008s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:17:51 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dbc19e8-eae1-4cea-94a1-981cd8f2bbc0]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:17:51 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-04fcf7eb-0c99-4177-a5d6-7ff0ddb9ac32 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-00f648d0-e57c-4a40-b3d0-b95d4c8fe744 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:51 devstack sudo[89761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-00f648d0-e57c-4a40-b3d0-b95d4c8fe744
Apr 10 13:17:51 devstack sudo[89761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:51 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cc4a50d-9397-42d3-934f-e1b9170d53e3 tempest-VolumesDeleteCascade-1486359075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:17:51 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-6cc4a50d-9397-42d3-934f-e1b9170d53e3 tempest-VolumesDeleteCascade-1486359075 None] Flow 'volume_create_manager' (f35e02f1-2119-413c-a9c2-de4be11d7b0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:17:51 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-6cc4a50d-9397-42d3-934f-e1b9170d53e3 tempest-VolumesDeleteCascade-1486359075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be57de43-403e-45f1-bb42-a6d337e445ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:17:51 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-6cc4a50d-9397-42d3-934f-e1b9170d53e3 tempest-VolumesDeleteCascade-1486359075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be57de43-403e-45f1-bb42-a6d337e445ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:17:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-516162186',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3815fbf-307e-4baf-9adc-fb31f253e941,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a5495bb2aaa4cfd930adaef6d32f807',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:17:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:17:51Z,use_quota=True,user_id='357c35adde514f02ae903d7d7a632b30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:17:51 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-6cc4a50d-9397-42d3-934f-e1b9170d53e3 tempest-VolumesDeleteCascade-1486359075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da1c7eb5-46d5-44bb-a30d-d7ebd79de4f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:17:51 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-6cc4a50d-9397-42d3-934f-e1b9170d53e3 tempest-VolumesDeleteCascade-1486359075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da1c7eb5-46d5-44bb-a30d-d7ebd79de4f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:17:51 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-6cc4a50d-9397-42d3-934f-e1b9170d53e3 tempest-VolumesDeleteCascade-1486359075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f73a295-71f2-4ce7-a538-4ceda347f81c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:17:51 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-6cc4a50d-9397-42d3-934f-e1b9170d53e3 tempest-VolumesDeleteCascade-1486359075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f73a295-71f2-4ce7-a538-4ceda347f81c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3815fbf-307e-4baf-9adc-fb31f253e941', 'volume_name': 'volume-f3815fbf-307e-4baf-9adc-fb31f253e941', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:17:51 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-6cc4a50d-9397-42d3-934f-e1b9170d53e3 tempest-VolumesDeleteCascade-1486359075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac0b6372-3c9b-43db-b64d-b6541530319c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:17:51 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-6cc4a50d-9397-42d3-934f-e1b9170d53e3 tempest-VolumesDeleteCascade-1486359075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac0b6372-3c9b-43db-b64d-b6541530319c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:17:51 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-6cc4a50d-9397-42d3-934f-e1b9170d53e3 tempest-VolumesDeleteCascade-1486359075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (479c3991-221a-4acc-bec2-1d90daadb6bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:17:51 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-6cc4a50d-9397-42d3-934f-e1b9170d53e3 tempest-VolumesDeleteCascade-1486359075 None] Volume f3815fbf-307e-4baf-9adc-fb31f253e941: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3815fbf-307e-4baf-9adc-fb31f253e941', 'volume_size': 1}
Apr 10 13:17:51 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-6cc4a50d-9397-42d3-934f-e1b9170d53e3 tempest-VolumesDeleteCascade-1486359075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:17:51 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-6cc4a50d-9397-42d3-934f-e1b9170d53e3 tempest-VolumesDeleteCascade-1486359075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:17:51 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-6cc4a50d-9397-42d3-934f-e1b9170d53e3 tempest-VolumesDeleteCascade-1486359075 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f252bf08b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:17:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-516162186',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3815fbf-307e-4baf-9adc-fb31f253e941,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a5495bb2aaa4cfd930adaef6d32f807',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:17:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:17:51Z,use_quota=True,user_id='357c35adde514f02ae903d7d7a632b30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)}" {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 13:17:51 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-6cc4a50d-9397-42d3-934f-e1b9170d53e3 tempest-VolumesDeleteCascade-1486359075 None] Creating volume f3815fbf-307e-4baf-9adc-fb31f253e941 {{(pid=83345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 13:17:51 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-6cc4a50d-9397-42d3-934f-e1b9170d53e3 tempest-VolumesDeleteCascade-1486359075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:17:51 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-6cc4a50d-9397-42d3-934f-e1b9170d53e3 tempest-VolumesDeleteCascade-1486359075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:17:51 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-6cc4a50d-9397-42d3-934f-e1b9170d53e3 tempest-VolumesDeleteCascade-1486359075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:17:51 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-6cc4a50d-9397-42d3-934f-e1b9170d53e3 tempest-VolumesDeleteCascade-1486359075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:17:51 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-6cc4a50d-9397-42d3-934f-e1b9170d53e3 tempest-VolumesDeleteCascade-1486359075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:17:51 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-6cc4a50d-9397-42d3-934f-e1b9170d53e3 tempest-VolumesDeleteCascade-1486359075 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:17:51 devstack cinder-volume[83345]: INFO cinder.volume.drivers.remotefs [None req-6cc4a50d-9397-42d3-934f-e1b9170d53e3 tempest-VolumesDeleteCascade-1486359075 None] casted to osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331
Apr 10 13:17:51 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-6cc4a50d-9397-42d3-934f-e1b9170d53e3 tempest-VolumesDeleteCascade-1486359075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-f3815fbf-307e-4baf-9adc-fb31f253e941 1073741824 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:51 devstack sudo[89764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-f3815fbf-307e-4baf-9adc-fb31f253e941 1073741824
Apr 10 13:17:51 devstack sudo[89764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:51 devstack sudo[89759]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:51 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-592491e4-34cf-4ae7-8516-7bbb1b2e737c tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.463s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:51 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-592491e4-34cf-4ae7-8516-7bbb1b2e737c tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:17:51 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-592491e4-34cf-4ae7-8516-7bbb1b2e737c tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Deleted volume successfully.
Apr 10 13:17:51 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-592491e4-34cf-4ae7-8516-7bbb1b2e737c tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Lock "cinder-013dc3f9-1191-4262-91e1-7b16f7f1945e-delete_volume" released by "delete_volume" :: held 1.574s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:17:51 devstack sudo[89761]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:51 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-04fcf7eb-0c99-4177-a5d6-7ff0ddb9ac32 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-00f648d0-e57c-4a40-b3d0-b95d4c8fe744" returned: 0 in 0.524s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:51 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-04fcf7eb-0c99-4177-a5d6-7ff0ddb9ac32 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-00f648d0-e57c-4a40-b3d0-b95d4c8fe744 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:51 devstack sudo[89770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-00f648d0-e57c-4a40-b3d0-b95d4c8fe744
Apr 10 13:17:51 devstack sudo[89770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:51 devstack sudo[89764]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:51 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-6cc4a50d-9397-42d3-934f-e1b9170d53e3 tempest-VolumesDeleteCascade-1486359075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-f3815fbf-307e-4baf-9adc-fb31f253e941 1073741824" returned: 0 in 0.474s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:51 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-6cc4a50d-9397-42d3-934f-e1b9170d53e3 tempest-VolumesDeleteCascade-1486359075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-f3815fbf-307e-4baf-9adc-fb31f253e941 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:51 devstack sudo[89775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-f3815fbf-307e-4baf-9adc-fb31f253e941
Apr 10 13:17:51 devstack sudo[89775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:52 devstack sudo[89770]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:52 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-04fcf7eb-0c99-4177-a5d6-7ff0ddb9ac32 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-00f648d0-e57c-4a40-b3d0-b95d4c8fe744" returned: 0 in 0.434s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:52 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-04fcf7eb-0c99-4177-a5d6-7ff0ddb9ac32 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Lock "cinder-quobyte-00f648d0-e57c-4a40-b3d0-b95d4c8fe744" released by "delete_volume" :: held 0.990s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:17:52 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-04fcf7eb-0c99-4177-a5d6-7ff0ddb9ac32 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Created reservations ['9ee16e14-5949-4401-ac05-eeeb5ce8785e', 'ce83af20-8735-47f6-b474-a71db1dea53b', '9c593f43-e45b-40b8-b08f-ae7f3eed3681', '38e65107-6ead-4673-a3ab-9f78d7474072'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:17:52 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-04fcf7eb-0c99-4177-a5d6-7ff0ddb9ac32 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:17:52 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-04fcf7eb-0c99-4177-a5d6-7ff0ddb9ac32 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:17:52 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-04fcf7eb-0c99-4177-a5d6-7ff0ddb9ac32 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:17:52 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-04fcf7eb-0c99-4177-a5d6-7ff0ddb9ac32 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:17:52 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-04fcf7eb-0c99-4177-a5d6-7ff0ddb9ac32 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:17:52 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-04fcf7eb-0c99-4177-a5d6-7ff0ddb9ac32 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:52 devstack sudo[89778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:17:52 devstack sudo[89778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:52 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-88180e42-326e-4a6c-98ce-49c51c002371 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Acquiring lock "cinder-1a83e57c-048d-45ed-8f4b-68980bb26ce7-delete_volume" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:17:52 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-88180e42-326e-4a6c-98ce-49c51c002371 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Lock "cinder-1a83e57c-048d-45ed-8f4b-68980bb26ce7-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:17:52 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-88180e42-326e-4a6c-98ce-49c51c002371 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Acquiring lock "cinder-quobyte-1a83e57c-048d-45ed-8f4b-68980bb26ce7" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:17:52 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-88180e42-326e-4a6c-98ce-49c51c002371 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Lock "cinder-quobyte-1a83e57c-048d-45ed-8f4b-68980bb26ce7" acquired by "delete_volume" :: waited 0.009s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:17:52 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdeb4a9e-c123-491a-b15d-27f010556ba7]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:17:52 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-88180e42-326e-4a6c-98ce-49c51c002371 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-1a83e57c-048d-45ed-8f4b-68980bb26ce7 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:52 devstack sudo[89781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-1a83e57c-048d-45ed-8f4b-68980bb26ce7
Apr 10 13:17:52 devstack sudo[89781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:52 devstack sudo[89775]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:52 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-6cc4a50d-9397-42d3-934f-e1b9170d53e3 tempest-VolumesDeleteCascade-1486359075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-f3815fbf-307e-4baf-9adc-fb31f253e941" returned: 0 in 0.424s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:52 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-6cc4a50d-9397-42d3-934f-e1b9170d53e3 tempest-VolumesDeleteCascade-1486359075 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'} {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 13:17:52 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-6cc4a50d-9397-42d3-934f-e1b9170d53e3 tempest-VolumesDeleteCascade-1486359075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:17:52 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-6cc4a50d-9397-42d3-934f-e1b9170d53e3 tempest-VolumesDeleteCascade-1486359075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (479c3991-221a-4acc-bec2-1d90daadb6bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3815fbf-307e-4baf-9adc-fb31f253e941', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:17:52 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-6cc4a50d-9397-42d3-934f-e1b9170d53e3 tempest-VolumesDeleteCascade-1486359075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21557832-dbf3-4f99-8516-aaa70ee7729a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:17:52 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-6cc4a50d-9397-42d3-934f-e1b9170d53e3 tempest-VolumesDeleteCascade-1486359075 None] Volume volume-f3815fbf-307e-4baf-9adc-fb31f253e941 (f3815fbf-307e-4baf-9adc-fb31f253e941): created successfully
Apr 10 13:17:52 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-6cc4a50d-9397-42d3-934f-e1b9170d53e3 tempest-VolumesDeleteCascade-1486359075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21557832-dbf3-4f99-8516-aaa70ee7729a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:17:52 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-6cc4a50d-9397-42d3-934f-e1b9170d53e3 tempest-VolumesDeleteCascade-1486359075 None] Flow 'volume_create_manager' (f35e02f1-2119-413c-a9c2-de4be11d7b0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:17:52 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-6cc4a50d-9397-42d3-934f-e1b9170d53e3 tempest-VolumesDeleteCascade-1486359075 None] Created volume successfully.
Apr 10 13:17:52 devstack sudo[89778]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:52 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-04fcf7eb-0c99-4177-a5d6-7ff0ddb9ac32 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.418s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:52 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-04fcf7eb-0c99-4177-a5d6-7ff0ddb9ac32 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:17:52 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-04fcf7eb-0c99-4177-a5d6-7ff0ddb9ac32 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Deleted volume successfully.
Apr 10 13:17:52 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-04fcf7eb-0c99-4177-a5d6-7ff0ddb9ac32 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Lock "cinder-00f648d0-e57c-4a40-b3d0-b95d4c8fe744-delete_volume" released by "delete_volume" :: held 1.535s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:17:52 devstack sudo[89781]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:52 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-88180e42-326e-4a6c-98ce-49c51c002371 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-1a83e57c-048d-45ed-8f4b-68980bb26ce7" returned: 0 in 0.495s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:52 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-88180e42-326e-4a6c-98ce-49c51c002371 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-1a83e57c-048d-45ed-8f4b-68980bb26ce7 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:52 devstack sudo[89787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-1a83e57c-048d-45ed-8f4b-68980bb26ce7
Apr 10 13:17:52 devstack sudo[89787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:53 devstack sudo[89787]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:53 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-88180e42-326e-4a6c-98ce-49c51c002371 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-1a83e57c-048d-45ed-8f4b-68980bb26ce7" returned: 0 in 0.419s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:53 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-88180e42-326e-4a6c-98ce-49c51c002371 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Lock "cinder-quobyte-1a83e57c-048d-45ed-8f4b-68980bb26ce7" released by "delete_volume" :: held 0.934s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:17:53 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-88180e42-326e-4a6c-98ce-49c51c002371 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Created reservations ['d1f894b5-76ae-4b02-a4ef-8391f9b4abce', '8ede9def-f715-4b9b-9519-e2fc9f15023a', '1f363f5a-14c1-4c63-81c3-97d75114a20c', 'ebd9ced2-6222-48c5-a46c-2894cd24ed41'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:17:53 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-88180e42-326e-4a6c-98ce-49c51c002371 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:17:53 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-88180e42-326e-4a6c-98ce-49c51c002371 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:17:53 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-88180e42-326e-4a6c-98ce-49c51c002371 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:17:53 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-88180e42-326e-4a6c-98ce-49c51c002371 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:17:53 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-88180e42-326e-4a6c-98ce-49c51c002371 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:17:53 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-88180e42-326e-4a6c-98ce-49c51c002371 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:53 devstack sudo[89790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:17:53 devstack sudo[89790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:53 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-c4141b72-54d3-452d-b9c7-5b0eb8c80ed0 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Acquiring lock "cinder-d9b9ae5b-227f-4c3f-bb6e-156050b04f85-delete_volume" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:17:53 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-c4141b72-54d3-452d-b9c7-5b0eb8c80ed0 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Lock "cinder-d9b9ae5b-227f-4c3f-bb6e-156050b04f85-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:17:53 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-c4141b72-54d3-452d-b9c7-5b0eb8c80ed0 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Acquiring lock "cinder-quobyte-d9b9ae5b-227f-4c3f-bb6e-156050b04f85" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:17:53 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-c4141b72-54d3-452d-b9c7-5b0eb8c80ed0 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Lock "cinder-quobyte-d9b9ae5b-227f-4c3f-bb6e-156050b04f85" acquired by "delete_volume" :: waited 0.010s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:17:53 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca1ed276-2290-4bbe-abcb-e30f5b8665f5]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:17:53 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-c4141b72-54d3-452d-b9c7-5b0eb8c80ed0 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-d9b9ae5b-227f-4c3f-bb6e-156050b04f85 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:53 devstack sudo[89792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-d9b9ae5b-227f-4c3f-bb6e-156050b04f85
Apr 10 13:17:53 devstack sudo[89792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:53 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-33ee9615-bd53-48f1-a9fb-61668799efde tempest-VolumesDeleteCascade-1486359075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:17:53 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-33ee9615-bd53-48f1-a9fb-61668799efde tempest-VolumesDeleteCascade-1486359075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:17:53 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-33ee9615-bd53-48f1-a9fb-61668799efde tempest-VolumesDeleteCascade-1486359075 None] Creating offline snapshot 47fa5c3f-f40e-45da-9f55-b40dec5b967c of volume f3815fbf-307e-4baf-9adc-fb31f253e941 {{(pid=83345) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 10 13:17:53 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[33604ae6-a904-4d96-8fda-384ca19c9485]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:17:53 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-33ee9615-bd53-48f1-a9fb-61668799efde tempest-VolumesDeleteCascade-1486359075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-f3815fbf-307e-4baf-9adc-fb31f253e941 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:53 devstack cinder-volume[83345]: DEBUG oslo_service.periodic_task [None req-c3f44832-ad7f-424b-a850-32c7352a19c5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83345) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 10 13:17:53 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-c3f44832-ad7f-424b-a850-32c7352a19c5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:17:53 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-c3f44832-ad7f-424b-a850-32c7352a19c5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:17:53 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-c3f44832-ad7f-424b-a850-32c7352a19c5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:17:53 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-c3f44832-ad7f-424b-a850-32c7352a19c5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:17:53 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-c3f44832-ad7f-424b-a850-32c7352a19c5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:17:53 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-c3f44832-ad7f-424b-a850-32c7352a19c5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:53 devstack sudo[89794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-f3815fbf-307e-4baf-9adc-fb31f253e941
Apr 10 13:17:53 devstack sudo[89794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:53 devstack sudo[89795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:17:53 devstack sudo[89795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:53 devstack sudo[89790]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:53 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-88180e42-326e-4a6c-98ce-49c51c002371 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.460s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:53 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-88180e42-326e-4a6c-98ce-49c51c002371 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:17:53 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-88180e42-326e-4a6c-98ce-49c51c002371 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Deleted volume successfully.
Apr 10 13:17:53 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-88180e42-326e-4a6c-98ce-49c51c002371 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Lock "cinder-1a83e57c-048d-45ed-8f4b-68980bb26ce7-delete_volume" released by "delete_volume" :: held 1.524s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:17:53 devstack sudo[89792]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:53 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-c4141b72-54d3-452d-b9c7-5b0eb8c80ed0 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-d9b9ae5b-227f-4c3f-bb6e-156050b04f85" returned: 0 in 0.521s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:53 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-c4141b72-54d3-452d-b9c7-5b0eb8c80ed0 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-d9b9ae5b-227f-4c3f-bb6e-156050b04f85 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:53 devstack sudo[89802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-d9b9ae5b-227f-4c3f-bb6e-156050b04f85
Apr 10 13:17:53 devstack sudo[89802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:54 devstack sudo[89795]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:54 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-c3f44832-ad7f-424b-a850-32c7352a19c5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.458s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:54 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-c3f44832-ad7f-424b-a850-32c7352a19c5 None None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:17:54 devstack sudo[89794]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:54 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-33ee9615-bd53-48f1-a9fb-61668799efde tempest-VolumesDeleteCascade-1486359075 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-f3815fbf-307e-4baf-9adc-fb31f253e941" returned: 0 in 0.531s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:54 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-33ee9615-bd53-48f1-a9fb-61668799efde tempest-VolumesDeleteCascade-1486359075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-f3815fbf-307e-4baf-9adc-fb31f253e941,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-f3815fbf-307e-4baf-9adc-fb31f253e941.47fa5c3f-f40e-45da-9f55-b40dec5b967c 1G {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:54 devstack sudo[89808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-f3815fbf-307e-4baf-9adc-fb31f253e941,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-f3815fbf-307e-4baf-9adc-fb31f253e941.47fa5c3f-f40e-45da-9f55-b40dec5b967c 1G
Apr 10 13:17:54 devstack sudo[89808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:54 devstack sudo[89802]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:54 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-c4141b72-54d3-452d-b9c7-5b0eb8c80ed0 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-d9b9ae5b-227f-4c3f-bb6e-156050b04f85" returned: 0 in 0.426s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:54 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-c4141b72-54d3-452d-b9c7-5b0eb8c80ed0 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Lock "cinder-quobyte-d9b9ae5b-227f-4c3f-bb6e-156050b04f85" released by "delete_volume" :: held 0.980s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:17:54 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-c4141b72-54d3-452d-b9c7-5b0eb8c80ed0 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Created reservations ['6135989c-020c-4013-99ed-c50d0f4747a8', '9d682077-b71e-4260-b3b2-551481c2c5a6', '3fb6b174-217a-4149-b7b1-6f10655676f9', '56717962-58c8-456f-9ba0-484bf916cc73'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:17:54 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-c4141b72-54d3-452d-b9c7-5b0eb8c80ed0 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:17:54 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-c4141b72-54d3-452d-b9c7-5b0eb8c80ed0 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:17:54 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-c4141b72-54d3-452d-b9c7-5b0eb8c80ed0 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:17:54 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-c4141b72-54d3-452d-b9c7-5b0eb8c80ed0 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:17:54 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-c4141b72-54d3-452d-b9c7-5b0eb8c80ed0 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:17:54 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-c4141b72-54d3-452d-b9c7-5b0eb8c80ed0 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:54 devstack sudo[89811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:17:54 devstack sudo[89811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:54 devstack sudo[89808]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:54 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-33ee9615-bd53-48f1-a9fb-61668799efde tempest-VolumesDeleteCascade-1486359075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-f3815fbf-307e-4baf-9adc-fb31f253e941,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-f3815fbf-307e-4baf-9adc-fb31f253e941.47fa5c3f-f40e-45da-9f55-b40dec5b967c 1G" returned: 0 in 0.495s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:54 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-33ee9615-bd53-48f1-a9fb-61668799efde tempest-VolumesDeleteCascade-1486359075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3815fbf-307e-4baf-9adc-fb31f253e941 -F qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-f3815fbf-307e-4baf-9adc-fb31f253e941.47fa5c3f-f40e-45da-9f55-b40dec5b967c {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:54 devstack sudo[89816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3815fbf-307e-4baf-9adc-fb31f253e941 -F qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-f3815fbf-307e-4baf-9adc-fb31f253e941.47fa5c3f-f40e-45da-9f55-b40dec5b967c
Apr 10 13:17:54 devstack sudo[89816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:54 devstack sudo[89811]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:54 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-c4141b72-54d3-452d-b9c7-5b0eb8c80ed0 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.414s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:54 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-c4141b72-54d3-452d-b9c7-5b0eb8c80ed0 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:17:54 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-c4141b72-54d3-452d-b9c7-5b0eb8c80ed0 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Deleted volume successfully.
Apr 10 13:17:54 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-c4141b72-54d3-452d-b9c7-5b0eb8c80ed0 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Lock "cinder-d9b9ae5b-227f-4c3f-bb6e-156050b04f85-delete_volume" released by "delete_volume" :: held 1.536s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:17:54 devstack sudo[89816]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:54 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-33ee9615-bd53-48f1-a9fb-61668799efde tempest-VolumesDeleteCascade-1486359075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3815fbf-307e-4baf-9adc-fb31f253e941 -F qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-f3815fbf-307e-4baf-9adc-fb31f253e941.47fa5c3f-f40e-45da-9f55-b40dec5b967c" returned: 0 in 0.435s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:54 devstack cinder-volume[83345]: WARNING cinder.volume.drivers.remotefs [None req-33ee9615-bd53-48f1-a9fb-61668799efde tempest-VolumesDeleteCascade-1486359075 None] /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-f3815fbf-307e-4baf-9adc-fb31f253e941.47fa5c3f-f40e-45da-9f55-b40dec5b967c is being set with open permissions: ugo+rw
Apr 10 13:17:54 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-33ee9615-bd53-48f1-a9fb-61668799efde tempest-VolumesDeleteCascade-1486359075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-f3815fbf-307e-4baf-9adc-fb31f253e941.47fa5c3f-f40e-45da-9f55-b40dec5b967c {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:55 devstack sudo[89822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-f3815fbf-307e-4baf-9adc-fb31f253e941.47fa5c3f-f40e-45da-9f55-b40dec5b967c
Apr 10 13:17:55 devstack sudo[89822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:55 devstack sudo[89822]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:55 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-33ee9615-bd53-48f1-a9fb-61668799efde tempest-VolumesDeleteCascade-1486359075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-f3815fbf-307e-4baf-9adc-fb31f253e941.47fa5c3f-f40e-45da-9f55-b40dec5b967c" returned: 0 in 0.392s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:55 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-33ee9615-bd53-48f1-a9fb-61668799efde tempest-VolumesDeleteCascade-1486359075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-f3815fbf-307e-4baf-9adc-fb31f253e941.info {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:55 devstack sudo[89825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-f3815fbf-307e-4baf-9adc-fb31f253e941.info
Apr 10 13:17:55 devstack sudo[89825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:55 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-3404b8f0-d50c-4689-99d4-55a4e6da7641 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Acquiring lock "cinder-c1b43e14-a509-4d72-adec-b1fa1b92323d-delete_volume" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:17:55 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-3404b8f0-d50c-4689-99d4-55a4e6da7641 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Lock "cinder-c1b43e14-a509-4d72-adec-b1fa1b92323d-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:17:55 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-3404b8f0-d50c-4689-99d4-55a4e6da7641 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Acquiring lock "cinder-quobyte-c1b43e14-a509-4d72-adec-b1fa1b92323d" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:17:55 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-3404b8f0-d50c-4689-99d4-55a4e6da7641 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Lock "cinder-quobyte-c1b43e14-a509-4d72-adec-b1fa1b92323d" acquired by "delete_volume" :: waited 0.007s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:17:55 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[01ce60a1-8167-44ec-a69e-650accd257d4]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:17:55 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-3404b8f0-d50c-4689-99d4-55a4e6da7641 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-c1b43e14-a509-4d72-adec-b1fa1b92323d {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:55 devstack sudo[89827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-c1b43e14-a509-4d72-adec-b1fa1b92323d
Apr 10 13:17:55 devstack sudo[89827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:55 devstack sudo[89825]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:55 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-33ee9615-bd53-48f1-a9fb-61668799efde tempest-VolumesDeleteCascade-1486359075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-f3815fbf-307e-4baf-9adc-fb31f253e941.info" returned: 0 in 0.416s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:55 devstack cinder-volume[83345]: WARNING cinder.volume.drivers.remotefs [None req-33ee9615-bd53-48f1-a9fb-61668799efde tempest-VolumesDeleteCascade-1486359075 None] /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-f3815fbf-307e-4baf-9adc-fb31f253e941.info is being set with open permissions: ugo+rw
Apr 10 13:17:55 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-33ee9615-bd53-48f1-a9fb-61668799efde tempest-VolumesDeleteCascade-1486359075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-f3815fbf-307e-4baf-9adc-fb31f253e941.info {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:55 devstack sudo[89830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-f3815fbf-307e-4baf-9adc-fb31f253e941.info
Apr 10 13:17:55 devstack sudo[89830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:55 devstack sudo[89827]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:55 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-3404b8f0-d50c-4689-99d4-55a4e6da7641 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-c1b43e14-a509-4d72-adec-b1fa1b92323d" returned: 0 in 0.474s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:55 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-3404b8f0-d50c-4689-99d4-55a4e6da7641 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-c1b43e14-a509-4d72-adec-b1fa1b92323d {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:55 devstack sudo[89835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-c1b43e14-a509-4d72-adec-b1fa1b92323d
Apr 10 13:17:55 devstack sudo[89835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:56 devstack sudo[89830]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:56 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-33ee9615-bd53-48f1-a9fb-61668799efde tempest-VolumesDeleteCascade-1486359075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-f3815fbf-307e-4baf-9adc-fb31f253e941.info" returned: 0 in 0.404s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:56 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-33ee9615-bd53-48f1-a9fb-61668799efde tempest-VolumesDeleteCascade-1486359075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.727s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:17:56 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-33ee9615-bd53-48f1-a9fb-61668799efde tempest-VolumesDeleteCascade-1486359075 None] Create snapshot completed successfully
Apr 10 13:17:56 devstack sudo[89835]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:56 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-3404b8f0-d50c-4689-99d4-55a4e6da7641 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-c1b43e14-a509-4d72-adec-b1fa1b92323d" returned: 0 in 0.401s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:56 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-3404b8f0-d50c-4689-99d4-55a4e6da7641 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Lock "cinder-quobyte-c1b43e14-a509-4d72-adec-b1fa1b92323d" released by "delete_volume" :: held 0.909s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:17:56 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-3404b8f0-d50c-4689-99d4-55a4e6da7641 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Created reservations ['a9d431d5-9874-48f7-9286-3105c1af888e', '024dfce2-14f8-47aa-9e0b-c9e3e90fd575', '75b073d3-efe5-4387-b4b1-3002df48fd5b', '2fc6705d-7fc4-4cdc-bc15-67b82335871a'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:17:56 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-3404b8f0-d50c-4689-99d4-55a4e6da7641 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:17:56 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-3404b8f0-d50c-4689-99d4-55a4e6da7641 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:17:56 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-3404b8f0-d50c-4689-99d4-55a4e6da7641 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:17:56 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-3404b8f0-d50c-4689-99d4-55a4e6da7641 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:17:56 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-3404b8f0-d50c-4689-99d4-55a4e6da7641 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:17:56 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-3404b8f0-d50c-4689-99d4-55a4e6da7641 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:56 devstack sudo[89839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:17:56 devstack sudo[89839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:56 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6fc85ce-8e45-49d7-b99b-52546a9b0e0c tempest-VolumesDeleteCascade-1486359075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:17:56 devstack sudo[89839]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:56 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-3404b8f0-d50c-4689-99d4-55a4e6da7641 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.465s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:56 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-3404b8f0-d50c-4689-99d4-55a4e6da7641 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:17:56 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-3404b8f0-d50c-4689-99d4-55a4e6da7641 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Deleted volume successfully.
Apr 10 13:17:56 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-c6fc85ce-8e45-49d7-b99b-52546a9b0e0c tempest-VolumesDeleteCascade-1486359075 None] Flow 'volume_create_manager' (f6b82d8d-a68d-47b9-83a1-730f0d741d6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:17:56 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-c6fc85ce-8e45-49d7-b99b-52546a9b0e0c tempest-VolumesDeleteCascade-1486359075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c79f5b7-60c2-4b29-9ab0-19bce9efaafd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:17:56 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-c6fc85ce-8e45-49d7-b99b-52546a9b0e0c tempest-VolumesDeleteCascade-1486359075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c79f5b7-60c2-4b29-9ab0-19bce9efaafd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:17:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1283693832',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06918892-ada2-4602-9ca7-31f77263bd6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a5495bb2aaa4cfd930adaef6d32f807',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:17:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=47fa5c3f-f40e-45da-9f55-b40dec5b967c,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:17:57Z,use_quota=True,user_id='357c35adde514f02ae903d7d7a632b30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:17:56 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-c6fc85ce-8e45-49d7-b99b-52546a9b0e0c tempest-VolumesDeleteCascade-1486359075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a35eec2-121a-46ba-b28c-6a0170722fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:17:56 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-c6fc85ce-8e45-49d7-b99b-52546a9b0e0c tempest-VolumesDeleteCascade-1486359075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a35eec2-121a-46ba-b28c-6a0170722fb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:17:56 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-c6fc85ce-8e45-49d7-b99b-52546a9b0e0c tempest-VolumesDeleteCascade-1486359075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83c47228-17ea-4245-b30d-62fe106ddc91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:17:56 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-c6fc85ce-8e45-49d7-b99b-52546a9b0e0c tempest-VolumesDeleteCascade-1486359075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83c47228-17ea-4245-b30d-62fe106ddc91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '06918892-ada2-4602-9ca7-31f77263bd6b', 'volume_name': 'volume-06918892-ada2-4602-9ca7-31f77263bd6b', 'volume_size': 1, 'snapshot_id': '47fa5c3f-f40e-45da-9f55-b40dec5b967c'}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:17:56 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-c6fc85ce-8e45-49d7-b99b-52546a9b0e0c tempest-VolumesDeleteCascade-1486359075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ecd4cb4-957b-4e4d-8733-dcc2d8b0b9a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:17:56 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-c6fc85ce-8e45-49d7-b99b-52546a9b0e0c tempest-VolumesDeleteCascade-1486359075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ecd4cb4-957b-4e4d-8733-dcc2d8b0b9a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:17:56 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-c6fc85ce-8e45-49d7-b99b-52546a9b0e0c tempest-VolumesDeleteCascade-1486359075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d13b3f1a-2a1c-414e-b58e-03a53adb90c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:17:56 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-c6fc85ce-8e45-49d7-b99b-52546a9b0e0c tempest-VolumesDeleteCascade-1486359075 None] Volume 06918892-ada2-4602-9ca7-31f77263bd6b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-06918892-ada2-4602-9ca7-31f77263bd6b', 'volume_size': 1, 'snapshot_id': '47fa5c3f-f40e-45da-9f55-b40dec5b967c'}
Apr 10 13:17:56 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-3404b8f0-d50c-4689-99d4-55a4e6da7641 tempest-CreateVolumesFromSourceVolumeTest-1083755746 None] Lock "cinder-c1b43e14-a509-4d72-adec-b1fa1b92323d-delete_volume" released by "delete_volume" :: held 1.533s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:17:56 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-c6fc85ce-8e45-49d7-b99b-52546a9b0e0c tempest-VolumesDeleteCascade-1486359075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:17:56 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-c6fc85ce-8e45-49d7-b99b-52546a9b0e0c tempest-VolumesDeleteCascade-1486359075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:17:56 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-c6fc85ce-8e45-49d7-b99b-52546a9b0e0c tempest-VolumesDeleteCascade-1486359075 None] Acquiring lock "cinder-quobyte-47fa5c3f-f40e-45da-9f55-b40dec5b967c-06918892-ada2-4602-9ca7-31f77263bd6b" by "_create_volume_from_snapshot" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:17:56 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-c6fc85ce-8e45-49d7-b99b-52546a9b0e0c tempest-VolumesDeleteCascade-1486359075 None] Lock "cinder-quobyte-47fa5c3f-f40e-45da-9f55-b40dec5b967c-06918892-ada2-4602-9ca7-31f77263bd6b" acquired by "_create_volume_from_snapshot" :: waited 0.007s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:17:56 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-c6fc85ce-8e45-49d7-b99b-52546a9b0e0c tempest-VolumesDeleteCascade-1486359075 None] Creating volume 06918892-ada2-4602-9ca7-31f77263bd6b from snapshot 47fa5c3f-f40e-45da-9f55-b40dec5b967c {{(pid=83345) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 10 13:17:56 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-c6fc85ce-8e45-49d7-b99b-52546a9b0e0c tempest-VolumesDeleteCascade-1486359075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:17:56 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-c6fc85ce-8e45-49d7-b99b-52546a9b0e0c tempest-VolumesDeleteCascade-1486359075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:17:56 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-c6fc85ce-8e45-49d7-b99b-52546a9b0e0c tempest-VolumesDeleteCascade-1486359075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:17:56 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-c6fc85ce-8e45-49d7-b99b-52546a9b0e0c tempest-VolumesDeleteCascade-1486359075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:17:56 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-c6fc85ce-8e45-49d7-b99b-52546a9b0e0c tempest-VolumesDeleteCascade-1486359075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:17:56 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-c6fc85ce-8e45-49d7-b99b-52546a9b0e0c tempest-VolumesDeleteCascade-1486359075 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:17:56 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-c6fc85ce-8e45-49d7-b99b-52546a9b0e0c tempest-VolumesDeleteCascade-1486359075 None] Acquiring lock "cinder-quobyte-06918892-ada2-4602-9ca7-31f77263bd6b" by "_copy_volume_from_snapshot" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:17:57 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-c6fc85ce-8e45-49d7-b99b-52546a9b0e0c tempest-VolumesDeleteCascade-1486359075 None] Lock "cinder-quobyte-06918892-ada2-4602-9ca7-31f77263bd6b" acquired by "_copy_volume_from_snapshot" :: waited 0.007s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:17:57 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-c6fc85ce-8e45-49d7-b99b-52546a9b0e0c tempest-VolumesDeleteCascade-1486359075 None] snapshot: 47fa5c3f-f40e-45da-9f55-b40dec5b967c, volume: 06918892-ada2-4602-9ca7-31f77263bd6b,  {{(pid=83345) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 10 13:17:57 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-c6fc85ce-8e45-49d7-b99b-52546a9b0e0c tempest-VolumesDeleteCascade-1486359075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:17:57 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-c6fc85ce-8e45-49d7-b99b-52546a9b0e0c tempest-VolumesDeleteCascade-1486359075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:17:57 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-c6fc85ce-8e45-49d7-b99b-52546a9b0e0c tempest-VolumesDeleteCascade-1486359075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:17:57 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-c6fc85ce-8e45-49d7-b99b-52546a9b0e0c tempest-VolumesDeleteCascade-1486359075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:17:57 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-c6fc85ce-8e45-49d7-b99b-52546a9b0e0c tempest-VolumesDeleteCascade-1486359075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:17:57 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[db30bca2-8da4-4e57-85a5-3713e8c21deb]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:17:57 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-c6fc85ce-8e45-49d7-b99b-52546a9b0e0c tempest-VolumesDeleteCascade-1486359075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-f3815fbf-307e-4baf-9adc-fb31f253e941.47fa5c3f-f40e-45da-9f55-b40dec5b967c {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:57 devstack sudo[89842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-f3815fbf-307e-4baf-9adc-fb31f253e941.47fa5c3f-f40e-45da-9f55-b40dec5b967c
Apr 10 13:17:57 devstack sudo[89842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:57 devstack sudo[89842]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:57 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-c6fc85ce-8e45-49d7-b99b-52546a9b0e0c tempest-VolumesDeleteCascade-1486359075 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-f3815fbf-307e-4baf-9adc-fb31f253e941.47fa5c3f-f40e-45da-9f55-b40dec5b967c" returned: 0 in 0.490s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:57 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-c6fc85ce-8e45-49d7-b99b-52546a9b0e0c tempest-VolumesDeleteCascade-1486359075 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f3815fbf-307e-4baf-9adc-fb31f253e941(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 13:17:57 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-c6fc85ce-8e45-49d7-b99b-52546a9b0e0c tempest-VolumesDeleteCascade-1486359075 None] will copy from snapshot at /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-f3815fbf-307e-4baf-9adc-fb31f253e941 {{(pid=83345) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 10 13:17:57 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-c6fc85ce-8e45-49d7-b99b-52546a9b0e0c tempest-VolumesDeleteCascade-1486359075 None] Creating direct copy from snapshot {{(pid=83345) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 10 13:17:57 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[c90f2dba-9889-437e-961f-5ce1580d273a]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:17:57 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-c6fc85ce-8e45-49d7-b99b-52546a9b0e0c tempest-VolumesDeleteCascade-1486359075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-f3815fbf-307e-4baf-9adc-fb31f253e941 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:57 devstack sudo[89848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-f3815fbf-307e-4baf-9adc-fb31f253e941
Apr 10 13:17:57 devstack sudo[89848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:58 devstack sudo[89848]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:58 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-c6fc85ce-8e45-49d7-b99b-52546a9b0e0c tempest-VolumesDeleteCascade-1486359075 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-f3815fbf-307e-4baf-9adc-fb31f253e941" returned: 0 in 0.514s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:58 devstack cinder-volume[83345]: DEBUG cinder.utils [None req-c6fc85ce-8e45-49d7-b99b-52546a9b0e0c tempest-VolumesDeleteCascade-1486359075 None] Path /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-06918892-ada2-4602-9ca7-31f77263bd6b not found in is_blk_device check {{(pid=83345) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 10 13:17:58 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-c6fc85ce-8e45-49d7-b99b-52546a9b0e0c tempest-VolumesDeleteCascade-1486359075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-f3815fbf-307e-4baf-9adc-fb31f253e941 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-06918892-ada2-4602-9ca7-31f77263bd6b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:58 devstack sudo[89853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-f3815fbf-307e-4baf-9adc-fb31f253e941 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-06918892-ada2-4602-9ca7-31f77263bd6b
Apr 10 13:17:58 devstack sudo[89853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:17:58 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee6d037d-d673-45c7-a4f7-bf74097024cb tempest-CinderUnicodeTest-470920462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:17:58 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ee6d037d-d673-45c7-a4f7-bf74097024cb tempest-CinderUnicodeTest-470920462 None] Flow 'volume_create_manager' (f571d5fc-2182-43f3-a899-ca53b58d4fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:17:58 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ee6d037d-d673-45c7-a4f7-bf74097024cb tempest-CinderUnicodeTest-470920462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2de84226-1b8b-4535-aff9-da1ebac0b158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:17:58 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ee6d037d-d673-45c7-a4f7-bf74097024cb tempest-CinderUnicodeTest-470920462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2de84226-1b8b-4535-aff9-da1ebac0b158) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:17:58Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43857537-4b6c-49b7-9d7b-4ebce7c7fe15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0eac2106ee834884825c9b0fc9504d86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:17:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:17:58Z,use_quota=True,user_id='81bc11ee9e0747f2bcfda30ffd016b93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:17:58 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ee6d037d-d673-45c7-a4f7-bf74097024cb tempest-CinderUnicodeTest-470920462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6496df7b-23b4-4805-b84f-576c3633a4ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:17:58 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ee6d037d-d673-45c7-a4f7-bf74097024cb tempest-CinderUnicodeTest-470920462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6496df7b-23b4-4805-b84f-576c3633a4ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:17:58 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ee6d037d-d673-45c7-a4f7-bf74097024cb tempest-CinderUnicodeTest-470920462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (573eaed1-721e-482e-9a3a-3a410a3bd405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:17:58 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ee6d037d-d673-45c7-a4f7-bf74097024cb tempest-CinderUnicodeTest-470920462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (573eaed1-721e-482e-9a3a-3a410a3bd405) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43857537-4b6c-49b7-9d7b-4ebce7c7fe15', 'volume_name': 'volume-43857537-4b6c-49b7-9d7b-4ebce7c7fe15', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:17:58 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ee6d037d-d673-45c7-a4f7-bf74097024cb tempest-CinderUnicodeTest-470920462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef9adbf0-1ccb-4011-b319-66e2fdf4e09a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:17:58 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ee6d037d-d673-45c7-a4f7-bf74097024cb tempest-CinderUnicodeTest-470920462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef9adbf0-1ccb-4011-b319-66e2fdf4e09a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:17:58 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ee6d037d-d673-45c7-a4f7-bf74097024cb tempest-CinderUnicodeTest-470920462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7037d1d-80e7-4a46-bee8-3558bb6c074d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:17:58 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-ee6d037d-d673-45c7-a4f7-bf74097024cb tempest-CinderUnicodeTest-470920462 None] Volume 43857537-4b6c-49b7-9d7b-4ebce7c7fe15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43857537-4b6c-49b7-9d7b-4ebce7c7fe15', 'volume_size': 1}
Apr 10 13:17:58 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-ee6d037d-d673-45c7-a4f7-bf74097024cb tempest-CinderUnicodeTest-470920462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:17:59 devstack sudo[89853]: pam_unix(sudo:session): session closed for user root
Apr 10 13:17:59 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-c6fc85ce-8e45-49d7-b99b-52546a9b0e0c tempest-VolumesDeleteCascade-1486359075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-f3815fbf-307e-4baf-9adc-fb31f253e941 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-06918892-ada2-4602-9ca7-31f77263bd6b" returned: 0 in 1.760s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:17:59 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f1f2326-8b88-437b-9f1a-18574089133c]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:17:59 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-c6fc85ce-8e45-49d7-b99b-52546a9b0e0c tempest-VolumesDeleteCascade-1486359075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-f3815fbf-307e-4baf-9adc-fb31f253e941 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:17:59 devstack sudo[89865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-f3815fbf-307e-4baf-9adc-fb31f253e941
Apr 10 13:17:59 devstack sudo[89865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:18:00 devstack sudo[89865]: pam_unix(sudo:session): session closed for user root
Apr 10 13:18:00 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-c6fc85ce-8e45-49d7-b99b-52546a9b0e0c tempest-VolumesDeleteCascade-1486359075 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-f3815fbf-307e-4baf-9adc-fb31f253e941" returned: 0 in 0.573s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:18:00 devstack cinder-volume[83345]: DEBUG cinder.image.image_utils [None req-c6fc85ce-8e45-49d7-b99b-52546a9b0e0c tempest-VolumesDeleteCascade-1486359075 None] Image conversion details: src /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-f3815fbf-307e-4baf-9adc-fb31f253e941, size 1024.00 MB, duration 1.76 sec, destination /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-06918892-ada2-4602-9ca7-31f77263bd6b {{(pid=83345) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 10 13:18:00 devstack cinder-volume[83345]: INFO cinder.image.image_utils [None req-c6fc85ce-8e45-49d7-b99b-52546a9b0e0c tempest-VolumesDeleteCascade-1486359075 None] Converted 1024.00 MB image at 581.69 MB/s
Apr 10 13:18:00 devstack cinder-volume[83345]: WARNING cinder.volume.drivers.remotefs [None req-c6fc85ce-8e45-49d7-b99b-52546a9b0e0c tempest-VolumesDeleteCascade-1486359075 None] /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-06918892-ada2-4602-9ca7-31f77263bd6b is being set with open permissions: ugo+rw
Apr 10 13:18:00 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-c6fc85ce-8e45-49d7-b99b-52546a9b0e0c tempest-VolumesDeleteCascade-1486359075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-06918892-ada2-4602-9ca7-31f77263bd6b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:18:00 devstack sudo[89870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-06918892-ada2-4602-9ca7-31f77263bd6b
Apr 10 13:18:00 devstack sudo[89870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:18:00 devstack sudo[89870]: pam_unix(sudo:session): session closed for user root
Apr 10 13:18:00 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-c6fc85ce-8e45-49d7-b99b-52546a9b0e0c tempest-VolumesDeleteCascade-1486359075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-06918892-ada2-4602-9ca7-31f77263bd6b" returned: 0 in 0.391s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:18:00 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-c6fc85ce-8e45-49d7-b99b-52546a9b0e0c tempest-VolumesDeleteCascade-1486359075 None] Lock "cinder-quobyte-06918892-ada2-4602-9ca7-31f77263bd6b" released by "_copy_volume_from_snapshot" :: held 3.793s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:18:00 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-c6fc85ce-8e45-49d7-b99b-52546a9b0e0c tempest-VolumesDeleteCascade-1486359075 None] Lock "cinder-quobyte-47fa5c3f-f40e-45da-9f55-b40dec5b967c-06918892-ada2-4602-9ca7-31f77263bd6b" released by "_create_volume_from_snapshot" :: held 3.808s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:18:00 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-c6fc85ce-8e45-49d7-b99b-52546a9b0e0c tempest-VolumesDeleteCascade-1486359075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 3.816s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:18:00 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-ee6d037d-d673-45c7-a4f7-bf74097024cb tempest-CinderUnicodeTest-470920462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.446s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:18:00 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-ee6d037d-d673-45c7-a4f7-bf74097024cb tempest-CinderUnicodeTest-470920462 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f252bf08b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:17:58Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43857537-4b6c-49b7-9d7b-4ebce7c7fe15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0eac2106ee834884825c9b0fc9504d86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:17:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:17:58Z,use_quota=True,user_id='81bc11ee9e0747f2bcfda30ffd016b93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)}" {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 13:18:00 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-ee6d037d-d673-45c7-a4f7-bf74097024cb tempest-CinderUnicodeTest-470920462 None] Creating volume 43857537-4b6c-49b7-9d7b-4ebce7c7fe15 {{(pid=83345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 13:18:00 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-ee6d037d-d673-45c7-a4f7-bf74097024cb tempest-CinderUnicodeTest-470920462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:18:00 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-ee6d037d-d673-45c7-a4f7-bf74097024cb tempest-CinderUnicodeTest-470920462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:18:00 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-ee6d037d-d673-45c7-a4f7-bf74097024cb tempest-CinderUnicodeTest-470920462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:18:00 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-ee6d037d-d673-45c7-a4f7-bf74097024cb tempest-CinderUnicodeTest-470920462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:18:00 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-ee6d037d-d673-45c7-a4f7-bf74097024cb tempest-CinderUnicodeTest-470920462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:18:00 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-ee6d037d-d673-45c7-a4f7-bf74097024cb tempest-CinderUnicodeTest-470920462 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:18:00 devstack cinder-volume[83345]: INFO cinder.volume.drivers.remotefs [None req-ee6d037d-d673-45c7-a4f7-bf74097024cb tempest-CinderUnicodeTest-470920462 None] casted to osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331
Apr 10 13:18:00 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ee6d037d-d673-45c7-a4f7-bf74097024cb tempest-CinderUnicodeTest-470920462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-43857537-4b6c-49b7-9d7b-4ebce7c7fe15 1073741824 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:18:00 devstack sudo[89873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-43857537-4b6c-49b7-9d7b-4ebce7c7fe15 1073741824
Apr 10 13:18:00 devstack sudo[89873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:18:00 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-c6fc85ce-8e45-49d7-b99b-52546a9b0e0c tempest-VolumesDeleteCascade-1486359075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d13b3f1a-2a1c-414e-b58e-03a53adb90c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06918892-ada2-4602-9ca7-31f77263bd6b', 'volume_size': 1, 'snapshot_id': '47fa5c3f-f40e-45da-9f55-b40dec5b967c'}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:18:00 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-c6fc85ce-8e45-49d7-b99b-52546a9b0e0c tempest-VolumesDeleteCascade-1486359075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6454246-dfae-4463-b19f-7d2d1af85ef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:18:00 devstack cinder-volume[83345]: DEBUG dbcounter [-] [83345] Writing DB stats cinder:SELECT=186,cinder:UPDATE=228,cinder:INSERT=59,cinder:DELETE=21 {{(pid=83345) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 10 13:18:00 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-c6fc85ce-8e45-49d7-b99b-52546a9b0e0c tempest-VolumesDeleteCascade-1486359075 None] Volume volume-06918892-ada2-4602-9ca7-31f77263bd6b (06918892-ada2-4602-9ca7-31f77263bd6b): created successfully
Apr 10 13:18:00 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-c6fc85ce-8e45-49d7-b99b-52546a9b0e0c tempest-VolumesDeleteCascade-1486359075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6454246-dfae-4463-b19f-7d2d1af85ef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:18:00 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-c6fc85ce-8e45-49d7-b99b-52546a9b0e0c tempest-VolumesDeleteCascade-1486359075 None] Flow 'volume_create_manager' (f6b82d8d-a68d-47b9-83a1-730f0d741d6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:18:00 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-c6fc85ce-8e45-49d7-b99b-52546a9b0e0c tempest-VolumesDeleteCascade-1486359075 None] Created volume successfully.
Apr 10 13:18:01 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-8c990be3-370d-4736-8bbe-014ea8701757 tempest-VolumesDeleteCascade-1486359075 None] Acquiring lock "cinder-f3815fbf-307e-4baf-9adc-fb31f253e941-delete_volume" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:18:01 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-8c990be3-370d-4736-8bbe-014ea8701757 tempest-VolumesDeleteCascade-1486359075 None] Lock "cinder-f3815fbf-307e-4baf-9adc-fb31f253e941-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:18:01 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-8c990be3-370d-4736-8bbe-014ea8701757 tempest-VolumesDeleteCascade-1486359075 None] Performing cascade delete. {{(pid=83345) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Apr 10 13:18:01 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-8c990be3-370d-4736-8bbe-014ea8701757 tempest-VolumesDeleteCascade-1486359075 None] Acquiring lock "cinder-47fa5c3f-f40e-45da-9f55-b40dec5b967c-delete_snapshot" by "delete_snapshot" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:18:01 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-8c990be3-370d-4736-8bbe-014ea8701757 tempest-VolumesDeleteCascade-1486359075 None] Lock "cinder-47fa5c3f-f40e-45da-9f55-b40dec5b967c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:18:01 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-8c990be3-370d-4736-8bbe-014ea8701757 tempest-VolumesDeleteCascade-1486359075 None] Acquiring lock "cinder-quobyte-f3815fbf-307e-4baf-9adc-fb31f253e941" by "delete_snapshot" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:18:01 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-8c990be3-370d-4736-8bbe-014ea8701757 tempest-VolumesDeleteCascade-1486359075 None] Lock "cinder-quobyte-f3815fbf-307e-4baf-9adc-fb31f253e941" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:18:01 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-8c990be3-370d-4736-8bbe-014ea8701757 tempest-VolumesDeleteCascade-1486359075 None] Acquiring lock "cinder-quobyte-47fa5c3f-f40e-45da-9f55-b40dec5b967c" by "_delete_snapshot" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:18:01 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-8c990be3-370d-4736-8bbe-014ea8701757 tempest-VolumesDeleteCascade-1486359075 None] Lock "cinder-quobyte-47fa5c3f-f40e-45da-9f55-b40dec5b967c" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:18:01 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-8c990be3-370d-4736-8bbe-014ea8701757 tempest-VolumesDeleteCascade-1486359075 None] Deleting offline snapshot 47fa5c3f-f40e-45da-9f55-b40dec5b967c of volume f3815fbf-307e-4baf-9adc-fb31f253e941 {{(pid=83345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 10 13:18:01 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-8c990be3-370d-4736-8bbe-014ea8701757 tempest-VolumesDeleteCascade-1486359075 None] snapshot_file for this snap is: volume-f3815fbf-307e-4baf-9adc-fb31f253e941.47fa5c3f-f40e-45da-9f55-b40dec5b967c {{(pid=83345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 10 13:18:01 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[f07996a6-6f71-4196-a1b9-acc7f71546ec]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:18:01 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-8c990be3-370d-4736-8bbe-014ea8701757 tempest-VolumesDeleteCascade-1486359075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-f3815fbf-307e-4baf-9adc-fb31f253e941.47fa5c3f-f40e-45da-9f55-b40dec5b967c {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:18:01 devstack sudo[89873]: pam_unix(sudo:session): session closed for user root
Apr 10 13:18:01 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ee6d037d-d673-45c7-a4f7-bf74097024cb tempest-CinderUnicodeTest-470920462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-43857537-4b6c-49b7-9d7b-4ebce7c7fe15 1073741824" returned: 0 in 0.506s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:18:01 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ee6d037d-d673-45c7-a4f7-bf74097024cb tempest-CinderUnicodeTest-470920462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-43857537-4b6c-49b7-9d7b-4ebce7c7fe15 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:18:01 devstack sudo[89878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-f3815fbf-307e-4baf-9adc-fb31f253e941.47fa5c3f-f40e-45da-9f55-b40dec5b967c
Apr 10 13:18:01 devstack sudo[89878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:18:01 devstack sudo[89879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-43857537-4b6c-49b7-9d7b-4ebce7c7fe15
Apr 10 13:18:01 devstack sudo[89879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:18:01 devstack sudo[89879]: pam_unix(sudo:session): session closed for user root
Apr 10 13:18:01 devstack sudo[89878]: pam_unix(sudo:session): session closed for user root
Apr 10 13:18:01 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ee6d037d-d673-45c7-a4f7-bf74097024cb tempest-CinderUnicodeTest-470920462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-43857537-4b6c-49b7-9d7b-4ebce7c7fe15" returned: 0 in 0.406s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:18:01 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-ee6d037d-d673-45c7-a4f7-bf74097024cb tempest-CinderUnicodeTest-470920462 None] <== create_volume: return (936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'} {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 13:18:01 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-ee6d037d-d673-45c7-a4f7-bf74097024cb tempest-CinderUnicodeTest-470920462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:18:01 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-8c990be3-370d-4736-8bbe-014ea8701757 tempest-VolumesDeleteCascade-1486359075 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-f3815fbf-307e-4baf-9adc-fb31f253e941.47fa5c3f-f40e-45da-9f55-b40dec5b967c" returned: 0 in 0.467s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:18:01 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-8c990be3-370d-4736-8bbe-014ea8701757 tempest-VolumesDeleteCascade-1486359075 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f3815fbf-307e-4baf-9adc-fb31f253e941(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 13:18:01 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ee6d037d-d673-45c7-a4f7-bf74097024cb tempest-CinderUnicodeTest-470920462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7037d1d-80e7-4a46-bee8-3558bb6c074d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43857537-4b6c-49b7-9d7b-4ebce7c7fe15', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:18:01 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ee6d037d-d673-45c7-a4f7-bf74097024cb tempest-CinderUnicodeTest-470920462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22d0e96d-ce83-4fdb-bb13-44ef50a25f44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:18:01 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce52c359-e63d-470d-8f21-629a066d3bdf]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:18:01 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-8c990be3-370d-4736-8bbe-014ea8701757 tempest-VolumesDeleteCascade-1486359075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-f3815fbf-307e-4baf-9adc-fb31f253e941 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:18:01 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-ee6d037d-d673-45c7-a4f7-bf74097024cb tempest-CinderUnicodeTest-470920462 None] Volume volume-43857537-4b6c-49b7-9d7b-4ebce7c7fe15 (43857537-4b6c-49b7-9d7b-4ebce7c7fe15): created successfully
Apr 10 13:18:01 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ee6d037d-d673-45c7-a4f7-bf74097024cb tempest-CinderUnicodeTest-470920462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22d0e96d-ce83-4fdb-bb13-44ef50a25f44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:18:01 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ee6d037d-d673-45c7-a4f7-bf74097024cb tempest-CinderUnicodeTest-470920462 None] Flow 'volume_create_manager' (f571d5fc-2182-43f3-a899-ca53b58d4fe9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:18:01 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-ee6d037d-d673-45c7-a4f7-bf74097024cb tempest-CinderUnicodeTest-470920462 None] Created volume successfully.
Apr 10 13:18:01 devstack sudo[89887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-f3815fbf-307e-4baf-9adc-fb31f253e941
Apr 10 13:18:01 devstack sudo[89887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:18:02 devstack sudo[89887]: pam_unix(sudo:session): session closed for user root
Apr 10 13:18:02 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-8c990be3-370d-4736-8bbe-014ea8701757 tempest-VolumesDeleteCascade-1486359075 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-f3815fbf-307e-4baf-9adc-fb31f253e941" returned: 0 in 0.455s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:18:02 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-8c990be3-370d-4736-8bbe-014ea8701757 tempest-VolumesDeleteCascade-1486359075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-f3815fbf-307e-4baf-9adc-fb31f253e941.47fa5c3f-f40e-45da-9f55-b40dec5b967c {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:18:02 devstack sudo[89892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-f3815fbf-307e-4baf-9adc-fb31f253e941.47fa5c3f-f40e-45da-9f55-b40dec5b967c
Apr 10 13:18:02 devstack sudo[89892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:18:02 devstack sudo[89892]: pam_unix(sudo:session): session closed for user root
Apr 10 13:18:02 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-8c990be3-370d-4736-8bbe-014ea8701757 tempest-VolumesDeleteCascade-1486359075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-f3815fbf-307e-4baf-9adc-fb31f253e941.47fa5c3f-f40e-45da-9f55-b40dec5b967c" returned: 0 in 0.461s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:18:02 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-8c990be3-370d-4736-8bbe-014ea8701757 tempest-VolumesDeleteCascade-1486359075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-f3815fbf-307e-4baf-9adc-fb31f253e941.47fa5c3f-f40e-45da-9f55-b40dec5b967c {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:18:02 devstack sudo[89897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-f3815fbf-307e-4baf-9adc-fb31f253e941.47fa5c3f-f40e-45da-9f55-b40dec5b967c
Apr 10 13:18:02 devstack sudo[89897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:18:02 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-adfd8179-8e4f-42a6-80e6-81d189c1d567 tempest-CinderUnicodeTest-470920462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:18:02 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-adfd8179-8e4f-42a6-80e6-81d189c1d567 tempest-CinderUnicodeTest-470920462 None] Flow 'volume_create_manager' (87a71c24-2cae-49c7-8019-4e5650b645db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:18:02 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-adfd8179-8e4f-42a6-80e6-81d189c1d567 tempest-CinderUnicodeTest-470920462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47f799e5-002f-4efe-951a-e99bfd9232ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:18:02 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-adfd8179-8e4f-42a6-80e6-81d189c1d567 tempest-CinderUnicodeTest-470920462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47f799e5-002f-4efe-951a-e99bfd9232ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:18:03Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1441663875',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99e1fe7e-fcdc-436e-abea-25d4fa65f1b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0eac2106ee834884825c9b0fc9504d86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:18:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:18:03Z,use_quota=True,user_id='81bc11ee9e0747f2bcfda30ffd016b93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:18:02 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-adfd8179-8e4f-42a6-80e6-81d189c1d567 tempest-CinderUnicodeTest-470920462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f35cb771-e5df-45fb-939d-50f2bdd33541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:18:02 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-adfd8179-8e4f-42a6-80e6-81d189c1d567 tempest-CinderUnicodeTest-470920462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f35cb771-e5df-45fb-939d-50f2bdd33541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:18:02 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-adfd8179-8e4f-42a6-80e6-81d189c1d567 tempest-CinderUnicodeTest-470920462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20c36b87-1490-47d9-aa94-45daf9dca583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:18:02 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-adfd8179-8e4f-42a6-80e6-81d189c1d567 tempest-CinderUnicodeTest-470920462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20c36b87-1490-47d9-aa94-45daf9dca583) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99e1fe7e-fcdc-436e-abea-25d4fa65f1b2', 'volume_name': 'volume-99e1fe7e-fcdc-436e-abea-25d4fa65f1b2', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:18:02 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-adfd8179-8e4f-42a6-80e6-81d189c1d567 tempest-CinderUnicodeTest-470920462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c700f9c-04fd-4429-90ee-005ea1e67b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:18:02 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-adfd8179-8e4f-42a6-80e6-81d189c1d567 tempest-CinderUnicodeTest-470920462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c700f9c-04fd-4429-90ee-005ea1e67b79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:18:02 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-adfd8179-8e4f-42a6-80e6-81d189c1d567 tempest-CinderUnicodeTest-470920462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a74ff63-6e5b-49bd-86d6-f7d3c6db24a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:18:02 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-adfd8179-8e4f-42a6-80e6-81d189c1d567 tempest-CinderUnicodeTest-470920462 None] Volume 99e1fe7e-fcdc-436e-abea-25d4fa65f1b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99e1fe7e-fcdc-436e-abea-25d4fa65f1b2', 'volume_size': 1}
Apr 10 13:18:02 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-adfd8179-8e4f-42a6-80e6-81d189c1d567 tempest-CinderUnicodeTest-470920462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:18:02 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-adfd8179-8e4f-42a6-80e6-81d189c1d567 tempest-CinderUnicodeTest-470920462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:18:02 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-adfd8179-8e4f-42a6-80e6-81d189c1d567 tempest-CinderUnicodeTest-470920462 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f252bf08b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:18:03Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1441663875',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99e1fe7e-fcdc-436e-abea-25d4fa65f1b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0eac2106ee834884825c9b0fc9504d86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:18:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:18:03Z,use_quota=True,user_id='81bc11ee9e0747f2bcfda30ffd016b93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)}" {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 13:18:02 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-adfd8179-8e4f-42a6-80e6-81d189c1d567 tempest-CinderUnicodeTest-470920462 None] Creating volume 99e1fe7e-fcdc-436e-abea-25d4fa65f1b2 {{(pid=83345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 13:18:02 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-adfd8179-8e4f-42a6-80e6-81d189c1d567 tempest-CinderUnicodeTest-470920462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:18:02 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-adfd8179-8e4f-42a6-80e6-81d189c1d567 tempest-CinderUnicodeTest-470920462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:18:02 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-adfd8179-8e4f-42a6-80e6-81d189c1d567 tempest-CinderUnicodeTest-470920462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:18:02 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-adfd8179-8e4f-42a6-80e6-81d189c1d567 tempest-CinderUnicodeTest-470920462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:18:02 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-adfd8179-8e4f-42a6-80e6-81d189c1d567 tempest-CinderUnicodeTest-470920462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:18:02 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-adfd8179-8e4f-42a6-80e6-81d189c1d567 tempest-CinderUnicodeTest-470920462 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:18:02 devstack cinder-volume[83345]: INFO cinder.volume.drivers.remotefs [None req-adfd8179-8e4f-42a6-80e6-81d189c1d567 tempest-CinderUnicodeTest-470920462 None] casted to osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331
Apr 10 13:18:02 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-adfd8179-8e4f-42a6-80e6-81d189c1d567 tempest-CinderUnicodeTest-470920462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-99e1fe7e-fcdc-436e-abea-25d4fa65f1b2 1073741824 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:18:02 devstack sudo[89899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-99e1fe7e-fcdc-436e-abea-25d4fa65f1b2 1073741824
Apr 10 13:18:02 devstack sudo[89899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:18:03 devstack sudo[89897]: pam_unix(sudo:session): session closed for user root
Apr 10 13:18:03 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-8c990be3-370d-4736-8bbe-014ea8701757 tempest-VolumesDeleteCascade-1486359075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-f3815fbf-307e-4baf-9adc-fb31f253e941.47fa5c3f-f40e-45da-9f55-b40dec5b967c" returned: 0 in 0.422s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:18:03 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-8c990be3-370d-4736-8bbe-014ea8701757 tempest-VolumesDeleteCascade-1486359075 None] Lock "cinder-quobyte-47fa5c3f-f40e-45da-9f55-b40dec5b967c" released by "_delete_snapshot" :: held 1.859s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:18:03 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-8c990be3-370d-4736-8bbe-014ea8701757 tempest-VolumesDeleteCascade-1486359075 None] Lock "cinder-quobyte-f3815fbf-307e-4baf-9adc-fb31f253e941" released by "delete_snapshot" :: held 1.869s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:18:03 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-8c990be3-370d-4736-8bbe-014ea8701757 tempest-VolumesDeleteCascade-1486359075 None] Created reservations ['b8c38176-7b65-4eba-ae31-3ccaccfe3679', '8799832a-1cc7-4383-b88f-00c1692d5ff2', '22cb0e4a-bce3-4f07-94e6-878f4ca5e330', 'e584d724-a14f-432a-a58b-10492e9cf69e'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:18:03 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-8c990be3-370d-4736-8bbe-014ea8701757 tempest-VolumesDeleteCascade-1486359075 None] Delete snapshot completed successfully.
Apr 10 13:18:03 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-8c990be3-370d-4736-8bbe-014ea8701757 tempest-VolumesDeleteCascade-1486359075 None] Lock "cinder-47fa5c3f-f40e-45da-9f55-b40dec5b967c-delete_snapshot" released by "delete_snapshot" :: held 1.965s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:18:03 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-8c990be3-370d-4736-8bbe-014ea8701757 tempest-VolumesDeleteCascade-1486359075 None] Snapshots deleted, issuing volume delete {{(pid=83345) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Apr 10 13:18:03 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-8c990be3-370d-4736-8bbe-014ea8701757 tempest-VolumesDeleteCascade-1486359075 None] Acquiring lock "cinder-quobyte-f3815fbf-307e-4baf-9adc-fb31f253e941" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:18:03 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-8c990be3-370d-4736-8bbe-014ea8701757 tempest-VolumesDeleteCascade-1486359075 None] Lock "cinder-quobyte-f3815fbf-307e-4baf-9adc-fb31f253e941" acquired by "delete_volume" :: waited 0.007s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:18:03 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2e7e8fe-9bbd-493e-8d0a-82917bd174ee]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:18:03 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-8c990be3-370d-4736-8bbe-014ea8701757 tempest-VolumesDeleteCascade-1486359075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-f3815fbf-307e-4baf-9adc-fb31f253e941 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:18:03 devstack sudo[89902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-f3815fbf-307e-4baf-9adc-fb31f253e941
Apr 10 13:18:03 devstack sudo[89902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:18:03 devstack sudo[89899]: pam_unix(sudo:session): session closed for user root
Apr 10 13:18:03 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-adfd8179-8e4f-42a6-80e6-81d189c1d567 tempest-CinderUnicodeTest-470920462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-99e1fe7e-fcdc-436e-abea-25d4fa65f1b2 1073741824" returned: 0 in 0.507s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:18:03 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-adfd8179-8e4f-42a6-80e6-81d189c1d567 tempest-CinderUnicodeTest-470920462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-99e1fe7e-fcdc-436e-abea-25d4fa65f1b2 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:18:03 devstack sudo[89907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-99e1fe7e-fcdc-436e-abea-25d4fa65f1b2
Apr 10 13:18:03 devstack sudo[89907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:18:03 devstack sudo[89902]: pam_unix(sudo:session): session closed for user root
Apr 10 13:18:03 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-8c990be3-370d-4736-8bbe-014ea8701757 tempest-VolumesDeleteCascade-1486359075 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-f3815fbf-307e-4baf-9adc-fb31f253e941" returned: 0 in 0.481s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:18:03 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-8c990be3-370d-4736-8bbe-014ea8701757 tempest-VolumesDeleteCascade-1486359075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-f3815fbf-307e-4baf-9adc-fb31f253e941 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:18:03 devstack sudo[89912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-f3815fbf-307e-4baf-9adc-fb31f253e941
Apr 10 13:18:03 devstack sudo[89912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:18:03 devstack sudo[89907]: pam_unix(sudo:session): session closed for user root
Apr 10 13:18:03 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-adfd8179-8e4f-42a6-80e6-81d189c1d567 tempest-CinderUnicodeTest-470920462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-99e1fe7e-fcdc-436e-abea-25d4fa65f1b2" returned: 0 in 0.405s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:18:03 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-adfd8179-8e4f-42a6-80e6-81d189c1d567 tempest-CinderUnicodeTest-470920462 None] <== create_volume: return (939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'} {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 13:18:03 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-adfd8179-8e4f-42a6-80e6-81d189c1d567 tempest-CinderUnicodeTest-470920462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:18:03 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-adfd8179-8e4f-42a6-80e6-81d189c1d567 tempest-CinderUnicodeTest-470920462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a74ff63-6e5b-49bd-86d6-f7d3c6db24a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99e1fe7e-fcdc-436e-abea-25d4fa65f1b2', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:18:03 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-adfd8179-8e4f-42a6-80e6-81d189c1d567 tempest-CinderUnicodeTest-470920462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (095855f8-9203-484a-afd8-971fa90780b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:18:03 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-adfd8179-8e4f-42a6-80e6-81d189c1d567 tempest-CinderUnicodeTest-470920462 None] Volume volume-99e1fe7e-fcdc-436e-abea-25d4fa65f1b2 (99e1fe7e-fcdc-436e-abea-25d4fa65f1b2): created successfully
Apr 10 13:18:03 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-adfd8179-8e4f-42a6-80e6-81d189c1d567 tempest-CinderUnicodeTest-470920462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (095855f8-9203-484a-afd8-971fa90780b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:18:03 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-adfd8179-8e4f-42a6-80e6-81d189c1d567 tempest-CinderUnicodeTest-470920462 None] Flow 'volume_create_manager' (87a71c24-2cae-49c7-8019-4e5650b645db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:18:03 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-adfd8179-8e4f-42a6-80e6-81d189c1d567 tempest-CinderUnicodeTest-470920462 None] Created volume successfully.
Apr 10 13:18:04 devstack sudo[89912]: pam_unix(sudo:session): session closed for user root
Apr 10 13:18:04 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-8c990be3-370d-4736-8bbe-014ea8701757 tempest-VolumesDeleteCascade-1486359075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-f3815fbf-307e-4baf-9adc-fb31f253e941" returned: 0 in 0.401s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:18:04 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-8c990be3-370d-4736-8bbe-014ea8701757 tempest-VolumesDeleteCascade-1486359075 None] Lock "cinder-quobyte-f3815fbf-307e-4baf-9adc-fb31f253e941" released by "delete_volume" :: held 0.907s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:18:04 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-8c990be3-370d-4736-8bbe-014ea8701757 tempest-VolumesDeleteCascade-1486359075 None] Created reservations ['bf2f447a-d275-4de5-aca0-c2bbcadad1ea', '3474e46c-b445-4ffc-b816-a7c2c5c36ddb', '56bc255a-51fb-4b57-95f8-146522ded076', '1a472b32-a018-47c5-b104-5f5bc5bbd665'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:18:04 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-8c990be3-370d-4736-8bbe-014ea8701757 tempest-VolumesDeleteCascade-1486359075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:18:04 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-8c990be3-370d-4736-8bbe-014ea8701757 tempest-VolumesDeleteCascade-1486359075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:18:04 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-8c990be3-370d-4736-8bbe-014ea8701757 tempest-VolumesDeleteCascade-1486359075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:18:04 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-8c990be3-370d-4736-8bbe-014ea8701757 tempest-VolumesDeleteCascade-1486359075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:18:04 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-8c990be3-370d-4736-8bbe-014ea8701757 tempest-VolumesDeleteCascade-1486359075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:18:04 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-8c990be3-370d-4736-8bbe-014ea8701757 tempest-VolumesDeleteCascade-1486359075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:18:04 devstack sudo[89916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:18:04 devstack sudo[89916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:18:04 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-3fb411bb-12b4-485e-9c68-621d52173cbc tempest-VolumesDeleteCascade-1486359075 None] Acquiring lock "cinder-06918892-ada2-4602-9ca7-31f77263bd6b-delete_volume" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:18:04 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-3fb411bb-12b4-485e-9c68-621d52173cbc tempest-VolumesDeleteCascade-1486359075 None] Lock "cinder-06918892-ada2-4602-9ca7-31f77263bd6b-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:18:04 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-3fb411bb-12b4-485e-9c68-621d52173cbc tempest-VolumesDeleteCascade-1486359075 None] Acquiring lock "cinder-quobyte-06918892-ada2-4602-9ca7-31f77263bd6b" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:18:04 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-3fb411bb-12b4-485e-9c68-621d52173cbc tempest-VolumesDeleteCascade-1486359075 None] Lock "cinder-quobyte-06918892-ada2-4602-9ca7-31f77263bd6b" acquired by "delete_volume" :: waited 0.008s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:18:04 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[abe1baeb-a55b-4e66-b89a-4fa2cb6092bf]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:18:04 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-3fb411bb-12b4-485e-9c68-621d52173cbc tempest-VolumesDeleteCascade-1486359075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-06918892-ada2-4602-9ca7-31f77263bd6b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:18:04 devstack sudo[89919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-06918892-ada2-4602-9ca7-31f77263bd6b
Apr 10 13:18:04 devstack sudo[89919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:18:04 devstack sudo[89916]: pam_unix(sudo:session): session closed for user root
Apr 10 13:18:04 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-8c990be3-370d-4736-8bbe-014ea8701757 tempest-VolumesDeleteCascade-1486359075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.432s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:18:04 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-8c990be3-370d-4736-8bbe-014ea8701757 tempest-VolumesDeleteCascade-1486359075 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:18:04 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-8c990be3-370d-4736-8bbe-014ea8701757 tempest-VolumesDeleteCascade-1486359075 None] Deleted volume successfully.
Apr 10 13:18:04 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-8c990be3-370d-4736-8bbe-014ea8701757 tempest-VolumesDeleteCascade-1486359075 None] Lock "cinder-f3815fbf-307e-4baf-9adc-fb31f253e941-delete_volume" released by "delete_volume" :: held 3.434s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:18:05 devstack sudo[89919]: pam_unix(sudo:session): session closed for user root
Apr 10 13:18:05 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-3fb411bb-12b4-485e-9c68-621d52173cbc tempest-VolumesDeleteCascade-1486359075 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-06918892-ada2-4602-9ca7-31f77263bd6b" returned: 0 in 0.472s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:18:05 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-3fb411bb-12b4-485e-9c68-621d52173cbc tempest-VolumesDeleteCascade-1486359075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-06918892-ada2-4602-9ca7-31f77263bd6b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:18:05 devstack sudo[89924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-06918892-ada2-4602-9ca7-31f77263bd6b
Apr 10 13:18:05 devstack sudo[89924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:18:05 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-ab83b3bc-13be-4a22-bd42-ab24e19df28d tempest-CinderUnicodeTest-470920462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:18:05 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-ab83b3bc-13be-4a22-bd42-ab24e19df28d tempest-CinderUnicodeTest-470920462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:18:05 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-ab83b3bc-13be-4a22-bd42-ab24e19df28d tempest-CinderUnicodeTest-470920462 None] Creating offline snapshot ef70e9ab-21aa-4b77-9feb-253f7db73546 of volume 99e1fe7e-fcdc-436e-abea-25d4fa65f1b2 {{(pid=83345) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 10 13:18:05 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1248346-8dea-4acf-adc6-b23a32721d9f]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:18:05 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ab83b3bc-13be-4a22-bd42-ab24e19df28d tempest-CinderUnicodeTest-470920462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-99e1fe7e-fcdc-436e-abea-25d4fa65f1b2 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:18:05 devstack sudo[89926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-99e1fe7e-fcdc-436e-abea-25d4fa65f1b2
Apr 10 13:18:05 devstack sudo[89926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:18:05 devstack sudo[89924]: pam_unix(sudo:session): session closed for user root
Apr 10 13:18:05 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-3fb411bb-12b4-485e-9c68-621d52173cbc tempest-VolumesDeleteCascade-1486359075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-06918892-ada2-4602-9ca7-31f77263bd6b" returned: 0 in 0.403s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:18:05 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-3fb411bb-12b4-485e-9c68-621d52173cbc tempest-VolumesDeleteCascade-1486359075 None] Lock "cinder-quobyte-06918892-ada2-4602-9ca7-31f77263bd6b" released by "delete_volume" :: held 0.906s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:18:05 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-3fb411bb-12b4-485e-9c68-621d52173cbc tempest-VolumesDeleteCascade-1486359075 None] Created reservations ['42880d00-4467-4666-b4d0-1dc6ba5a8f82', 'b6e4f71b-8f86-479a-9a21-f4ed3ec3bc12', '774af25d-0b8d-4188-b7e1-8ff0c369ccf2', '4f60f891-4034-4b6c-87be-9bdc28ff8c36'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:18:05 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-3fb411bb-12b4-485e-9c68-621d52173cbc tempest-VolumesDeleteCascade-1486359075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:18:05 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-3fb411bb-12b4-485e-9c68-621d52173cbc tempest-VolumesDeleteCascade-1486359075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:18:05 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-3fb411bb-12b4-485e-9c68-621d52173cbc tempest-VolumesDeleteCascade-1486359075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:18:05 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-3fb411bb-12b4-485e-9c68-621d52173cbc tempest-VolumesDeleteCascade-1486359075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:18:05 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-3fb411bb-12b4-485e-9c68-621d52173cbc tempest-VolumesDeleteCascade-1486359075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:18:05 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-3fb411bb-12b4-485e-9c68-621d52173cbc tempest-VolumesDeleteCascade-1486359075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:18:05 devstack sudo[89932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:18:05 devstack sudo[89932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:18:05 devstack sudo[89926]: pam_unix(sudo:session): session closed for user root
Apr 10 13:18:05 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ab83b3bc-13be-4a22-bd42-ab24e19df28d tempest-CinderUnicodeTest-470920462 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-99e1fe7e-fcdc-436e-abea-25d4fa65f1b2" returned: 0 in 0.467s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:18:05 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ab83b3bc-13be-4a22-bd42-ab24e19df28d tempest-CinderUnicodeTest-470920462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-99e1fe7e-fcdc-436e-abea-25d4fa65f1b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-99e1fe7e-fcdc-436e-abea-25d4fa65f1b2.ef70e9ab-21aa-4b77-9feb-253f7db73546 1G {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:18:05 devstack sudo[89934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-99e1fe7e-fcdc-436e-abea-25d4fa65f1b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-99e1fe7e-fcdc-436e-abea-25d4fa65f1b2.ef70e9ab-21aa-4b77-9feb-253f7db73546 1G
Apr 10 13:18:05 devstack sudo[89934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:18:05 devstack sudo[89932]: pam_unix(sudo:session): session closed for user root
Apr 10 13:18:05 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-3fb411bb-12b4-485e-9c68-621d52173cbc tempest-VolumesDeleteCascade-1486359075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.442s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:18:05 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-3fb411bb-12b4-485e-9c68-621d52173cbc tempest-VolumesDeleteCascade-1486359075 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:18:05 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-3fb411bb-12b4-485e-9c68-621d52173cbc tempest-VolumesDeleteCascade-1486359075 None] Deleted volume successfully.
Apr 10 13:18:05 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-3fb411bb-12b4-485e-9c68-621d52173cbc tempest-VolumesDeleteCascade-1486359075 None] Lock "cinder-06918892-ada2-4602-9ca7-31f77263bd6b-delete_volume" released by "delete_volume" :: held 1.480s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:18:06 devstack sudo[89934]: pam_unix(sudo:session): session closed for user root
Apr 10 13:18:06 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ab83b3bc-13be-4a22-bd42-ab24e19df28d tempest-CinderUnicodeTest-470920462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-99e1fe7e-fcdc-436e-abea-25d4fa65f1b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-99e1fe7e-fcdc-436e-abea-25d4fa65f1b2.ef70e9ab-21aa-4b77-9feb-253f7db73546 1G" returned: 0 in 0.540s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:18:06 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ab83b3bc-13be-4a22-bd42-ab24e19df28d tempest-CinderUnicodeTest-470920462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99e1fe7e-fcdc-436e-abea-25d4fa65f1b2 -F qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-99e1fe7e-fcdc-436e-abea-25d4fa65f1b2.ef70e9ab-21aa-4b77-9feb-253f7db73546 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:18:06 devstack sudo[89940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99e1fe7e-fcdc-436e-abea-25d4fa65f1b2 -F qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-99e1fe7e-fcdc-436e-abea-25d4fa65f1b2.ef70e9ab-21aa-4b77-9feb-253f7db73546
Apr 10 13:18:06 devstack sudo[89940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:18:06 devstack sudo[89940]: pam_unix(sudo:session): session closed for user root
Apr 10 13:18:06 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ab83b3bc-13be-4a22-bd42-ab24e19df28d tempest-CinderUnicodeTest-470920462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99e1fe7e-fcdc-436e-abea-25d4fa65f1b2 -F qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-99e1fe7e-fcdc-436e-abea-25d4fa65f1b2.ef70e9ab-21aa-4b77-9feb-253f7db73546" returned: 0 in 0.468s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:18:06 devstack cinder-volume[83345]: WARNING cinder.volume.drivers.remotefs [None req-ab83b3bc-13be-4a22-bd42-ab24e19df28d tempest-CinderUnicodeTest-470920462 None] /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-99e1fe7e-fcdc-436e-abea-25d4fa65f1b2.ef70e9ab-21aa-4b77-9feb-253f7db73546 is being set with open permissions: ugo+rw
Apr 10 13:18:06 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ab83b3bc-13be-4a22-bd42-ab24e19df28d tempest-CinderUnicodeTest-470920462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-99e1fe7e-fcdc-436e-abea-25d4fa65f1b2.ef70e9ab-21aa-4b77-9feb-253f7db73546 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:18:06 devstack sudo[89945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-99e1fe7e-fcdc-436e-abea-25d4fa65f1b2.ef70e9ab-21aa-4b77-9feb-253f7db73546
Apr 10 13:18:06 devstack sudo[89945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:18:07 devstack sudo[89945]: pam_unix(sudo:session): session closed for user root
Apr 10 13:18:07 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ab83b3bc-13be-4a22-bd42-ab24e19df28d tempest-CinderUnicodeTest-470920462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-99e1fe7e-fcdc-436e-abea-25d4fa65f1b2.ef70e9ab-21aa-4b77-9feb-253f7db73546" returned: 0 in 0.455s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:18:07 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ab83b3bc-13be-4a22-bd42-ab24e19df28d tempest-CinderUnicodeTest-470920462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-99e1fe7e-fcdc-436e-abea-25d4fa65f1b2.info {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:18:07 devstack sudo[89948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-99e1fe7e-fcdc-436e-abea-25d4fa65f1b2.info
Apr 10 13:18:07 devstack sudo[89948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:18:07 devstack sudo[89948]: pam_unix(sudo:session): session closed for user root
Apr 10 13:18:07 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ab83b3bc-13be-4a22-bd42-ab24e19df28d tempest-CinderUnicodeTest-470920462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-99e1fe7e-fcdc-436e-abea-25d4fa65f1b2.info" returned: 0 in 0.435s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:18:07 devstack cinder-volume[83345]: WARNING cinder.volume.drivers.remotefs [None req-ab83b3bc-13be-4a22-bd42-ab24e19df28d tempest-CinderUnicodeTest-470920462 None] /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-99e1fe7e-fcdc-436e-abea-25d4fa65f1b2.info is being set with open permissions: ugo+rw
Apr 10 13:18:07 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ab83b3bc-13be-4a22-bd42-ab24e19df28d tempest-CinderUnicodeTest-470920462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-99e1fe7e-fcdc-436e-abea-25d4fa65f1b2.info {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:18:07 devstack sudo[89951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-99e1fe7e-fcdc-436e-abea-25d4fa65f1b2.info
Apr 10 13:18:07 devstack sudo[89951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:18:07 devstack sudo[89951]: pam_unix(sudo:session): session closed for user root
Apr 10 13:18:07 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ab83b3bc-13be-4a22-bd42-ab24e19df28d tempest-CinderUnicodeTest-470920462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-99e1fe7e-fcdc-436e-abea-25d4fa65f1b2.info" returned: 0 in 0.435s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:18:07 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-ab83b3bc-13be-4a22-bd42-ab24e19df28d tempest-CinderUnicodeTest-470920462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.853s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:18:07 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-ab83b3bc-13be-4a22-bd42-ab24e19df28d tempest-CinderUnicodeTest-470920462 None] Create snapshot completed successfully
Apr 10 13:18:08 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-f91580b6-4c1a-478e-bcce-d57e14cf3513 tempest-VolumesTransfersV357Test-1961886484 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:18:08 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-f91580b6-4c1a-478e-bcce-d57e14cf3513 tempest-VolumesTransfersV357Test-1961886484 None] Flow 'volume_create_manager' (ceceb08b-5dba-4ed6-8cd9-54d27d45569e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:18:08 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-f91580b6-4c1a-478e-bcce-d57e14cf3513 tempest-VolumesTransfersV357Test-1961886484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11e15a28-1328-4d05-9048-6fed8772d4fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:18:08 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-f91580b6-4c1a-478e-bcce-d57e14cf3513 tempest-VolumesTransfersV357Test-1961886484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11e15a28-1328-4d05-9048-6fed8772d4fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:18:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-904770880',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c43495c7-8d44-48ed-9ce6-0e9de84f5400,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8b746aa30b34251b094dd4b16c934d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:18:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:18:08Z,use_quota=True,user_id='de151fa68bbc49379c5181841b5c0760',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:18:08 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-f91580b6-4c1a-478e-bcce-d57e14cf3513 tempest-VolumesTransfersV357Test-1961886484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3c8a7fc-b1d2-4e1e-b02f-2975ce787bac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:18:08 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-f91580b6-4c1a-478e-bcce-d57e14cf3513 tempest-VolumesTransfersV357Test-1961886484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3c8a7fc-b1d2-4e1e-b02f-2975ce787bac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:18:08 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-f91580b6-4c1a-478e-bcce-d57e14cf3513 tempest-VolumesTransfersV357Test-1961886484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31c1f3aa-1a2b-4123-a250-9a0817981dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:18:08 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-f91580b6-4c1a-478e-bcce-d57e14cf3513 tempest-VolumesTransfersV357Test-1961886484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31c1f3aa-1a2b-4123-a250-9a0817981dd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c43495c7-8d44-48ed-9ce6-0e9de84f5400', 'volume_name': 'volume-c43495c7-8d44-48ed-9ce6-0e9de84f5400', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:18:08 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-f91580b6-4c1a-478e-bcce-d57e14cf3513 tempest-VolumesTransfersV357Test-1961886484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a266063-bbb5-48e8-b1b8-59bc0a35a56b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:18:08 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-f91580b6-4c1a-478e-bcce-d57e14cf3513 tempest-VolumesTransfersV357Test-1961886484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a266063-bbb5-48e8-b1b8-59bc0a35a56b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:18:08 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-f91580b6-4c1a-478e-bcce-d57e14cf3513 tempest-VolumesTransfersV357Test-1961886484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (614db554-9e7f-42bb-ba2d-90eb59525a32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:18:08 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-f91580b6-4c1a-478e-bcce-d57e14cf3513 tempest-VolumesTransfersV357Test-1961886484 None] Volume c43495c7-8d44-48ed-9ce6-0e9de84f5400: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c43495c7-8d44-48ed-9ce6-0e9de84f5400', 'volume_size': 1}
Apr 10 13:18:08 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-f91580b6-4c1a-478e-bcce-d57e14cf3513 tempest-VolumesTransfersV357Test-1961886484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:18:08 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-f91580b6-4c1a-478e-bcce-d57e14cf3513 tempest-VolumesTransfersV357Test-1961886484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:18:08 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-f91580b6-4c1a-478e-bcce-d57e14cf3513 tempest-VolumesTransfersV357Test-1961886484 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f252bf08b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:18:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-904770880',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c43495c7-8d44-48ed-9ce6-0e9de84f5400,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8b746aa30b34251b094dd4b16c934d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:18:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:18:08Z,use_quota=True,user_id='de151fa68bbc49379c5181841b5c0760',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)}" {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 13:18:08 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-f91580b6-4c1a-478e-bcce-d57e14cf3513 tempest-VolumesTransfersV357Test-1961886484 None] Creating volume c43495c7-8d44-48ed-9ce6-0e9de84f5400 {{(pid=83345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 13:18:08 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-f91580b6-4c1a-478e-bcce-d57e14cf3513 tempest-VolumesTransfersV357Test-1961886484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:18:08 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-f91580b6-4c1a-478e-bcce-d57e14cf3513 tempest-VolumesTransfersV357Test-1961886484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:18:08 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-f91580b6-4c1a-478e-bcce-d57e14cf3513 tempest-VolumesTransfersV357Test-1961886484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:18:08 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-f91580b6-4c1a-478e-bcce-d57e14cf3513 tempest-VolumesTransfersV357Test-1961886484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:18:08 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-f91580b6-4c1a-478e-bcce-d57e14cf3513 tempest-VolumesTransfersV357Test-1961886484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:18:08 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-f91580b6-4c1a-478e-bcce-d57e14cf3513 tempest-VolumesTransfersV357Test-1961886484 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:18:08 devstack cinder-volume[83345]: INFO cinder.volume.drivers.remotefs [None req-f91580b6-4c1a-478e-bcce-d57e14cf3513 tempest-VolumesTransfersV357Test-1961886484 None] casted to osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331
Apr 10 13:18:08 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-f91580b6-4c1a-478e-bcce-d57e14cf3513 tempest-VolumesTransfersV357Test-1961886484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-c43495c7-8d44-48ed-9ce6-0e9de84f5400 1073741824 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:18:08 devstack sudo[89954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-c43495c7-8d44-48ed-9ce6-0e9de84f5400 1073741824
Apr 10 13:18:08 devstack sudo[89954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:18:08 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-edf3bfb5-ed12-45eb-a947-87052f6a2f79 tempest-CinderUnicodeTest-470920462 None] Acquiring lock "cinder-ef70e9ab-21aa-4b77-9feb-253f7db73546-delete_snapshot" by "delete_snapshot" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:18:08 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-edf3bfb5-ed12-45eb-a947-87052f6a2f79 tempest-CinderUnicodeTest-470920462 None] Lock "cinder-ef70e9ab-21aa-4b77-9feb-253f7db73546-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:18:08 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-edf3bfb5-ed12-45eb-a947-87052f6a2f79 tempest-CinderUnicodeTest-470920462 None] Acquiring lock "cinder-quobyte-99e1fe7e-fcdc-436e-abea-25d4fa65f1b2" by "delete_snapshot" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:18:08 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-edf3bfb5-ed12-45eb-a947-87052f6a2f79 tempest-CinderUnicodeTest-470920462 None] Lock "cinder-quobyte-99e1fe7e-fcdc-436e-abea-25d4fa65f1b2" acquired by "delete_snapshot" :: waited 0.007s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:18:08 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-edf3bfb5-ed12-45eb-a947-87052f6a2f79 tempest-CinderUnicodeTest-470920462 None] Acquiring lock "cinder-quobyte-ef70e9ab-21aa-4b77-9feb-253f7db73546" by "_delete_snapshot" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:18:08 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-edf3bfb5-ed12-45eb-a947-87052f6a2f79 tempest-CinderUnicodeTest-470920462 None] Lock "cinder-quobyte-ef70e9ab-21aa-4b77-9feb-253f7db73546" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:18:08 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-edf3bfb5-ed12-45eb-a947-87052f6a2f79 tempest-CinderUnicodeTest-470920462 None] Deleting offline snapshot ef70e9ab-21aa-4b77-9feb-253f7db73546 of volume 99e1fe7e-fcdc-436e-abea-25d4fa65f1b2 {{(pid=83345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 10 13:18:08 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-edf3bfb5-ed12-45eb-a947-87052f6a2f79 tempest-CinderUnicodeTest-470920462 None] snapshot_file for this snap is: volume-99e1fe7e-fcdc-436e-abea-25d4fa65f1b2.ef70e9ab-21aa-4b77-9feb-253f7db73546 {{(pid=83345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 10 13:18:08 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[222c9f54-1c8a-4287-9e7c-f1ba80b2a681]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:18:08 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-edf3bfb5-ed12-45eb-a947-87052f6a2f79 tempest-CinderUnicodeTest-470920462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-99e1fe7e-fcdc-436e-abea-25d4fa65f1b2.ef70e9ab-21aa-4b77-9feb-253f7db73546 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:18:08 devstack sudo[89956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-99e1fe7e-fcdc-436e-abea-25d4fa65f1b2.ef70e9ab-21aa-4b77-9feb-253f7db73546
Apr 10 13:18:08 devstack sudo[89956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:18:08 devstack sudo[89954]: pam_unix(sudo:session): session closed for user root
Apr 10 13:18:08 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-f91580b6-4c1a-478e-bcce-d57e14cf3513 tempest-VolumesTransfersV357Test-1961886484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-c43495c7-8d44-48ed-9ce6-0e9de84f5400 1073741824" returned: 0 in 0.487s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:18:08 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-f91580b6-4c1a-478e-bcce-d57e14cf3513 tempest-VolumesTransfersV357Test-1961886484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-c43495c7-8d44-48ed-9ce6-0e9de84f5400 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:18:08 devstack sudo[89964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-c43495c7-8d44-48ed-9ce6-0e9de84f5400
Apr 10 13:18:08 devstack sudo[89964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:18:08 devstack sudo[89956]: pam_unix(sudo:session): session closed for user root
Apr 10 13:18:08 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-edf3bfb5-ed12-45eb-a947-87052f6a2f79 tempest-CinderUnicodeTest-470920462 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-99e1fe7e-fcdc-436e-abea-25d4fa65f1b2.ef70e9ab-21aa-4b77-9feb-253f7db73546" returned: 0 in 0.473s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:18:08 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-edf3bfb5-ed12-45eb-a947-87052f6a2f79 tempest-CinderUnicodeTest-470920462 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-99e1fe7e-fcdc-436e-abea-25d4fa65f1b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 13:18:08 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe399e88-5f82-4a41-b3ae-032ba9aa12e9]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:18:08 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-edf3bfb5-ed12-45eb-a947-87052f6a2f79 tempest-CinderUnicodeTest-470920462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-99e1fe7e-fcdc-436e-abea-25d4fa65f1b2 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:18:08 devstack sudo[89966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-99e1fe7e-fcdc-436e-abea-25d4fa65f1b2
Apr 10 13:18:08 devstack sudo[89966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:18:09 devstack sudo[89964]: pam_unix(sudo:session): session closed for user root
Apr 10 13:18:09 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-f91580b6-4c1a-478e-bcce-d57e14cf3513 tempest-VolumesTransfersV357Test-1961886484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-c43495c7-8d44-48ed-9ce6-0e9de84f5400" returned: 0 in 0.431s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:18:09 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-f91580b6-4c1a-478e-bcce-d57e14cf3513 tempest-VolumesTransfersV357Test-1961886484 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'} {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 13:18:09 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-f91580b6-4c1a-478e-bcce-d57e14cf3513 tempest-VolumesTransfersV357Test-1961886484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:18:09 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-f91580b6-4c1a-478e-bcce-d57e14cf3513 tempest-VolumesTransfersV357Test-1961886484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (614db554-9e7f-42bb-ba2d-90eb59525a32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c43495c7-8d44-48ed-9ce6-0e9de84f5400', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:18:09 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-f91580b6-4c1a-478e-bcce-d57e14cf3513 tempest-VolumesTransfersV357Test-1961886484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40e791c9-1b45-412e-850c-a36e3caa208e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:18:09 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-f91580b6-4c1a-478e-bcce-d57e14cf3513 tempest-VolumesTransfersV357Test-1961886484 None] Volume volume-c43495c7-8d44-48ed-9ce6-0e9de84f5400 (c43495c7-8d44-48ed-9ce6-0e9de84f5400): created successfully
Apr 10 13:18:09 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-f91580b6-4c1a-478e-bcce-d57e14cf3513 tempest-VolumesTransfersV357Test-1961886484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40e791c9-1b45-412e-850c-a36e3caa208e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:18:09 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-f91580b6-4c1a-478e-bcce-d57e14cf3513 tempest-VolumesTransfersV357Test-1961886484 None] Flow 'volume_create_manager' (ceceb08b-5dba-4ed6-8cd9-54d27d45569e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:18:09 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-f91580b6-4c1a-478e-bcce-d57e14cf3513 tempest-VolumesTransfersV357Test-1961886484 None] Created volume successfully.
Apr 10 13:18:09 devstack sudo[89966]: pam_unix(sudo:session): session closed for user root
Apr 10 13:18:09 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-edf3bfb5-ed12-45eb-a947-87052f6a2f79 tempest-CinderUnicodeTest-470920462 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-99e1fe7e-fcdc-436e-abea-25d4fa65f1b2" returned: 0 in 0.515s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:18:09 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-edf3bfb5-ed12-45eb-a947-87052f6a2f79 tempest-CinderUnicodeTest-470920462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-99e1fe7e-fcdc-436e-abea-25d4fa65f1b2.ef70e9ab-21aa-4b77-9feb-253f7db73546 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:18:09 devstack sudo[89973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-99e1fe7e-fcdc-436e-abea-25d4fa65f1b2.ef70e9ab-21aa-4b77-9feb-253f7db73546
Apr 10 13:18:09 devstack sudo[89973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:18:09 devstack sudo[89973]: pam_unix(sudo:session): session closed for user root
Apr 10 13:18:09 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-edf3bfb5-ed12-45eb-a947-87052f6a2f79 tempest-CinderUnicodeTest-470920462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-99e1fe7e-fcdc-436e-abea-25d4fa65f1b2.ef70e9ab-21aa-4b77-9feb-253f7db73546" returned: 0 in 0.426s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:18:09 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-edf3bfb5-ed12-45eb-a947-87052f6a2f79 tempest-CinderUnicodeTest-470920462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-99e1fe7e-fcdc-436e-abea-25d4fa65f1b2.ef70e9ab-21aa-4b77-9feb-253f7db73546 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:18:09 devstack sudo[89978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-99e1fe7e-fcdc-436e-abea-25d4fa65f1b2.ef70e9ab-21aa-4b77-9feb-253f7db73546
Apr 10 13:18:09 devstack sudo[89978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:18:10 devstack sudo[89978]: pam_unix(sudo:session): session closed for user root
Apr 10 13:18:10 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-edf3bfb5-ed12-45eb-a947-87052f6a2f79 tempest-CinderUnicodeTest-470920462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-99e1fe7e-fcdc-436e-abea-25d4fa65f1b2.ef70e9ab-21aa-4b77-9feb-253f7db73546" returned: 0 in 0.409s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:18:10 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-edf3bfb5-ed12-45eb-a947-87052f6a2f79 tempest-CinderUnicodeTest-470920462 None] Lock "cinder-quobyte-ef70e9ab-21aa-4b77-9feb-253f7db73546" released by "_delete_snapshot" :: held 1.885s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:18:10 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-edf3bfb5-ed12-45eb-a947-87052f6a2f79 tempest-CinderUnicodeTest-470920462 None] Lock "cinder-quobyte-99e1fe7e-fcdc-436e-abea-25d4fa65f1b2" released by "delete_snapshot" :: held 1.895s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:18:10 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-edf3bfb5-ed12-45eb-a947-87052f6a2f79 tempest-CinderUnicodeTest-470920462 None] Created reservations ['9ee0df29-e34c-4ddc-a21e-32995a9d2303', 'ebd2032a-1b63-485d-a2d9-940d8d992d00', 'e6427590-03af-4701-9673-c19445ffa0cd', '87f616ab-71cf-4094-aa81-15c6f4a9a750'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:18:10 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-edf3bfb5-ed12-45eb-a947-87052f6a2f79 tempest-CinderUnicodeTest-470920462 None] Delete snapshot completed successfully.
Apr 10 13:18:10 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-edf3bfb5-ed12-45eb-a947-87052f6a2f79 tempest-CinderUnicodeTest-470920462 None] Lock "cinder-ef70e9ab-21aa-4b77-9feb-253f7db73546-delete_snapshot" released by "delete_snapshot" :: held 1.973s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:18:10 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-26d28a1e-4e7b-426b-b3d5-e7eb02c4c8da tempest-CinderUnicodeTest-470920462 None] Acquiring lock "cinder-99e1fe7e-fcdc-436e-abea-25d4fa65f1b2-delete_volume" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:18:10 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-26d28a1e-4e7b-426b-b3d5-e7eb02c4c8da tempest-CinderUnicodeTest-470920462 None] Lock "cinder-99e1fe7e-fcdc-436e-abea-25d4fa65f1b2-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:18:10 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-26d28a1e-4e7b-426b-b3d5-e7eb02c4c8da tempest-CinderUnicodeTest-470920462 None] Acquiring lock "cinder-quobyte-99e1fe7e-fcdc-436e-abea-25d4fa65f1b2" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:18:10 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-26d28a1e-4e7b-426b-b3d5-e7eb02c4c8da tempest-CinderUnicodeTest-470920462 None] Lock "cinder-quobyte-99e1fe7e-fcdc-436e-abea-25d4fa65f1b2" acquired by "delete_volume" :: waited 0.007s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:18:10 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[36b7ab93-49f8-4f03-bb89-7a05abf1f326]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:18:10 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-26d28a1e-4e7b-426b-b3d5-e7eb02c4c8da tempest-CinderUnicodeTest-470920462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-99e1fe7e-fcdc-436e-abea-25d4fa65f1b2 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:18:10 devstack sudo[89981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-99e1fe7e-fcdc-436e-abea-25d4fa65f1b2
Apr 10 13:18:10 devstack sudo[89981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:18:10 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-8de25432-d5d3-4cf0-8cf8-c63f642014e8 tempest-VolumesTransfersV357Test-1278134615 None] Transfer volume completed successfully.
Apr 10 13:18:10 devstack sudo[89981]: pam_unix(sudo:session): session closed for user root
Apr 10 13:18:10 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-26d28a1e-4e7b-426b-b3d5-e7eb02c4c8da tempest-CinderUnicodeTest-470920462 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-99e1fe7e-fcdc-436e-abea-25d4fa65f1b2" returned: 0 in 0.492s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:18:10 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-26d28a1e-4e7b-426b-b3d5-e7eb02c4c8da tempest-CinderUnicodeTest-470920462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-99e1fe7e-fcdc-436e-abea-25d4fa65f1b2 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:18:10 devstack sudo[89986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-99e1fe7e-fcdc-436e-abea-25d4fa65f1b2
Apr 10 13:18:10 devstack sudo[89986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:18:11 devstack sudo[89986]: pam_unix(sudo:session): session closed for user root
Apr 10 13:18:11 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-26d28a1e-4e7b-426b-b3d5-e7eb02c4c8da tempest-CinderUnicodeTest-470920462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-99e1fe7e-fcdc-436e-abea-25d4fa65f1b2" returned: 0 in 0.422s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:18:11 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-26d28a1e-4e7b-426b-b3d5-e7eb02c4c8da tempest-CinderUnicodeTest-470920462 None] Lock "cinder-quobyte-99e1fe7e-fcdc-436e-abea-25d4fa65f1b2" released by "delete_volume" :: held 0.956s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:18:11 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-26d28a1e-4e7b-426b-b3d5-e7eb02c4c8da tempest-CinderUnicodeTest-470920462 None] Created reservations ['ec7e11b8-7e06-414a-903d-2a06bd29aa52', 'bd7421b7-eee4-44dc-b2b0-48b5017880fa', 'fbc71bfa-16e3-4caf-8ff8-f1a42284cd7b', 'bf4e4edc-ff35-4b34-b5be-a9388f08b045'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:18:11 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-26d28a1e-4e7b-426b-b3d5-e7eb02c4c8da tempest-CinderUnicodeTest-470920462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:18:11 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-26d28a1e-4e7b-426b-b3d5-e7eb02c4c8da tempest-CinderUnicodeTest-470920462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:18:11 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-26d28a1e-4e7b-426b-b3d5-e7eb02c4c8da tempest-CinderUnicodeTest-470920462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:18:11 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-26d28a1e-4e7b-426b-b3d5-e7eb02c4c8da tempest-CinderUnicodeTest-470920462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:18:11 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-26d28a1e-4e7b-426b-b3d5-e7eb02c4c8da tempest-CinderUnicodeTest-470920462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:18:11 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-26d28a1e-4e7b-426b-b3d5-e7eb02c4c8da tempest-CinderUnicodeTest-470920462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:18:11 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-0691e292-2db2-4c0f-89b5-edd8fff46d97 tempest-VolumesTransfersV357Test-930713215 None] Acquiring lock "cinder-c43495c7-8d44-48ed-9ce6-0e9de84f5400-delete_volume" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:18:11 devstack sudo[89989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:18:11 devstack sudo[89989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:18:11 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-0691e292-2db2-4c0f-89b5-edd8fff46d97 tempest-VolumesTransfersV357Test-930713215 None] Lock "cinder-c43495c7-8d44-48ed-9ce6-0e9de84f5400-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:18:11 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-0691e292-2db2-4c0f-89b5-edd8fff46d97 tempest-VolumesTransfersV357Test-930713215 None] Acquiring lock "cinder-quobyte-c43495c7-8d44-48ed-9ce6-0e9de84f5400" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:18:11 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-9e5dbe6e-188b-4f03-8d38-145d02cffbff tempest-CinderUnicodeTest-470920462 None] Acquiring lock "cinder-43857537-4b6c-49b7-9d7b-4ebce7c7fe15-delete_volume" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:18:11 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-0691e292-2db2-4c0f-89b5-edd8fff46d97 tempest-VolumesTransfersV357Test-930713215 None] Lock "cinder-quobyte-c43495c7-8d44-48ed-9ce6-0e9de84f5400" acquired by "delete_volume" :: waited 0.015s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:18:11 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-9e5dbe6e-188b-4f03-8d38-145d02cffbff tempest-CinderUnicodeTest-470920462 None] Lock "cinder-43857537-4b6c-49b7-9d7b-4ebce7c7fe15-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:18:11 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[87633cc1-5d15-4153-855e-1ce8d7026193]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:18:11 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-0691e292-2db2-4c0f-89b5-edd8fff46d97 tempest-VolumesTransfersV357Test-930713215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-c43495c7-8d44-48ed-9ce6-0e9de84f5400 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:18:11 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-9e5dbe6e-188b-4f03-8d38-145d02cffbff tempest-CinderUnicodeTest-470920462 None] Acquiring lock "cinder-quobyte-43857537-4b6c-49b7-9d7b-4ebce7c7fe15" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:18:11 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-9e5dbe6e-188b-4f03-8d38-145d02cffbff tempest-CinderUnicodeTest-470920462 None] Lock "cinder-quobyte-43857537-4b6c-49b7-9d7b-4ebce7c7fe15" acquired by "delete_volume" :: waited 0.009s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:18:11 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[9041d66e-d868-442c-924f-a2c85927905a]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:18:11 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-9e5dbe6e-188b-4f03-8d38-145d02cffbff tempest-CinderUnicodeTest-470920462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-43857537-4b6c-49b7-9d7b-4ebce7c7fe15 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:18:11 devstack sudo[89992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-c43495c7-8d44-48ed-9ce6-0e9de84f5400
Apr 10 13:18:11 devstack sudo[89992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:18:11 devstack sudo[89993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-43857537-4b6c-49b7-9d7b-4ebce7c7fe15
Apr 10 13:18:11 devstack sudo[89993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:18:11 devstack sudo[89989]: pam_unix(sudo:session): session closed for user root
Apr 10 13:18:11 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-26d28a1e-4e7b-426b-b3d5-e7eb02c4c8da tempest-CinderUnicodeTest-470920462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.422s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:18:11 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-26d28a1e-4e7b-426b-b3d5-e7eb02c4c8da tempest-CinderUnicodeTest-470920462 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:18:11 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-26d28a1e-4e7b-426b-b3d5-e7eb02c4c8da tempest-CinderUnicodeTest-470920462 None] Deleted volume successfully.
Apr 10 13:18:11 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-26d28a1e-4e7b-426b-b3d5-e7eb02c4c8da tempest-CinderUnicodeTest-470920462 None] Lock "cinder-99e1fe7e-fcdc-436e-abea-25d4fa65f1b2-delete_volume" released by "delete_volume" :: held 1.509s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:18:12 devstack sudo[89992]: pam_unix(sudo:session): session closed for user root
Apr 10 13:18:12 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-0691e292-2db2-4c0f-89b5-edd8fff46d97 tempest-VolumesTransfersV357Test-930713215 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-c43495c7-8d44-48ed-9ce6-0e9de84f5400" returned: 0 in 0.524s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:18:12 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-0691e292-2db2-4c0f-89b5-edd8fff46d97 tempest-VolumesTransfersV357Test-930713215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-c43495c7-8d44-48ed-9ce6-0e9de84f5400 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:18:12 devstack sudo[90003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-c43495c7-8d44-48ed-9ce6-0e9de84f5400
Apr 10 13:18:12 devstack sudo[90003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:18:12 devstack sudo[89993]: pam_unix(sudo:session): session closed for user root
Apr 10 13:18:12 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-9e5dbe6e-188b-4f03-8d38-145d02cffbff tempest-CinderUnicodeTest-470920462 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-43857537-4b6c-49b7-9d7b-4ebce7c7fe15" returned: 0 in 0.498s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:18:12 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-9e5dbe6e-188b-4f03-8d38-145d02cffbff tempest-CinderUnicodeTest-470920462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-43857537-4b6c-49b7-9d7b-4ebce7c7fe15 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:18:12 devstack sudo[90005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-43857537-4b6c-49b7-9d7b-4ebce7c7fe15
Apr 10 13:18:12 devstack sudo[90005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:18:12 devstack sudo[90003]: pam_unix(sudo:session): session closed for user root
Apr 10 13:18:12 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-0691e292-2db2-4c0f-89b5-edd8fff46d97 tempest-VolumesTransfersV357Test-930713215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-c43495c7-8d44-48ed-9ce6-0e9de84f5400" returned: 0 in 0.401s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:18:12 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-0691e292-2db2-4c0f-89b5-edd8fff46d97 tempest-VolumesTransfersV357Test-930713215 None] Lock "cinder-quobyte-c43495c7-8d44-48ed-9ce6-0e9de84f5400" released by "delete_volume" :: held 0.950s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:18:12 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-0691e292-2db2-4c0f-89b5-edd8fff46d97 tempest-VolumesTransfersV357Test-930713215 None] Created reservations ['3a26c44f-a4a5-4f4f-a0cc-f4ac653fafc3', '04c51ed5-aa9b-4963-a914-8ef6f163127d', 'bd3f8cea-d781-49b6-81b8-7eae342f323c', 'aa0c96a2-c9e9-44e7-892c-cee151b1f959'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:18:12 devstack sudo[90005]: pam_unix(sudo:session): session closed for user root
Apr 10 13:18:12 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-9e5dbe6e-188b-4f03-8d38-145d02cffbff tempest-CinderUnicodeTest-470920462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-43857537-4b6c-49b7-9d7b-4ebce7c7fe15" returned: 0 in 0.421s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:18:12 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-9e5dbe6e-188b-4f03-8d38-145d02cffbff tempest-CinderUnicodeTest-470920462 None] Lock "cinder-quobyte-43857537-4b6c-49b7-9d7b-4ebce7c7fe15" released by "delete_volume" :: held 0.946s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:18:12 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-0691e292-2db2-4c0f-89b5-edd8fff46d97 tempest-VolumesTransfersV357Test-930713215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:18:12 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-0691e292-2db2-4c0f-89b5-edd8fff46d97 tempest-VolumesTransfersV357Test-930713215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:18:12 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-0691e292-2db2-4c0f-89b5-edd8fff46d97 tempest-VolumesTransfersV357Test-930713215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:18:12 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-0691e292-2db2-4c0f-89b5-edd8fff46d97 tempest-VolumesTransfersV357Test-930713215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:18:12 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-0691e292-2db2-4c0f-89b5-edd8fff46d97 tempest-VolumesTransfersV357Test-930713215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:18:12 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-0691e292-2db2-4c0f-89b5-edd8fff46d97 tempest-VolumesTransfersV357Test-930713215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:18:12 devstack sudo[90009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:18:12 devstack sudo[90009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:18:12 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-9e5dbe6e-188b-4f03-8d38-145d02cffbff tempest-CinderUnicodeTest-470920462 None] Created reservations ['6329ac62-cb31-4af8-b715-c41bc6b04cb9', 'ffc66ebf-2468-47aa-8187-a881a6321078', 'dff28687-1e9d-4142-9811-57cba5f276f2', '232e9375-9bb2-4e32-8048-946fdec82145'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:18:12 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-9e5dbe6e-188b-4f03-8d38-145d02cffbff tempest-CinderUnicodeTest-470920462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:18:12 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-9e5dbe6e-188b-4f03-8d38-145d02cffbff tempest-CinderUnicodeTest-470920462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:18:12 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-9e5dbe6e-188b-4f03-8d38-145d02cffbff tempest-CinderUnicodeTest-470920462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:18:12 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-9e5dbe6e-188b-4f03-8d38-145d02cffbff tempest-CinderUnicodeTest-470920462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:18:12 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-9e5dbe6e-188b-4f03-8d38-145d02cffbff tempest-CinderUnicodeTest-470920462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:18:12 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-9e5dbe6e-188b-4f03-8d38-145d02cffbff tempest-CinderUnicodeTest-470920462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:18:12 devstack sudo[90011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:18:12 devstack sudo[90011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:18:12 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9fdafca-87f2-46b9-87b6-f98428dd6edf tempest-VolumesTransfersV357Test-1961886484 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:18:12 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-d9fdafca-87f2-46b9-87b6-f98428dd6edf tempest-VolumesTransfersV357Test-1961886484 None] Flow 'volume_create_manager' (d66fdfc0-7eeb-4c5f-a2ea-8b95be4edad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:18:12 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-d9fdafca-87f2-46b9-87b6-f98428dd6edf tempest-VolumesTransfersV357Test-1961886484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48cb9e54-2ed3-4f3b-88f3-9e4bbb27b2ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:18:12 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-d9fdafca-87f2-46b9-87b6-f98428dd6edf tempest-VolumesTransfersV357Test-1961886484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48cb9e54-2ed3-4f3b-88f3-9e4bbb27b2ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:18:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1749491509',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7328ff2b-151d-4618-b5bf-deff0ebc5097,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8b746aa30b34251b094dd4b16c934d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:18:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:18:13Z,use_quota=True,user_id='de151fa68bbc49379c5181841b5c0760',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:18:12 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-d9fdafca-87f2-46b9-87b6-f98428dd6edf tempest-VolumesTransfersV357Test-1961886484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5897185d-30eb-4560-bd47-1848ca7c6002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:18:12 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-d9fdafca-87f2-46b9-87b6-f98428dd6edf tempest-VolumesTransfersV357Test-1961886484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5897185d-30eb-4560-bd47-1848ca7c6002) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:18:12 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-d9fdafca-87f2-46b9-87b6-f98428dd6edf tempest-VolumesTransfersV357Test-1961886484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93662542-6dd3-4714-b8b0-ee1cadca6f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:18:12 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-d9fdafca-87f2-46b9-87b6-f98428dd6edf tempest-VolumesTransfersV357Test-1961886484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93662542-6dd3-4714-b8b0-ee1cadca6f83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7328ff2b-151d-4618-b5bf-deff0ebc5097', 'volume_name': 'volume-7328ff2b-151d-4618-b5bf-deff0ebc5097', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:18:12 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-d9fdafca-87f2-46b9-87b6-f98428dd6edf tempest-VolumesTransfersV357Test-1961886484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84f94160-d108-49d5-9eab-45ab19558e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:18:12 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-d9fdafca-87f2-46b9-87b6-f98428dd6edf tempest-VolumesTransfersV357Test-1961886484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84f94160-d108-49d5-9eab-45ab19558e77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:18:12 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-d9fdafca-87f2-46b9-87b6-f98428dd6edf tempest-VolumesTransfersV357Test-1961886484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07159bbb-f37b-481b-add9-a5ff4abb6048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:18:12 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-d9fdafca-87f2-46b9-87b6-f98428dd6edf tempest-VolumesTransfersV357Test-1961886484 None] Volume 7328ff2b-151d-4618-b5bf-deff0ebc5097: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7328ff2b-151d-4618-b5bf-deff0ebc5097', 'volume_size': 1}
Apr 10 13:18:12 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-d9fdafca-87f2-46b9-87b6-f98428dd6edf tempest-VolumesTransfersV357Test-1961886484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:18:12 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-d9fdafca-87f2-46b9-87b6-f98428dd6edf tempest-VolumesTransfersV357Test-1961886484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:18:12 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-d9fdafca-87f2-46b9-87b6-f98428dd6edf tempest-VolumesTransfersV357Test-1961886484 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f252bf08b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:18:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1749491509',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7328ff2b-151d-4618-b5bf-deff0ebc5097,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8b746aa30b34251b094dd4b16c934d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:18:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:18:13Z,use_quota=True,user_id='de151fa68bbc49379c5181841b5c0760',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)}" {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 13:18:12 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-d9fdafca-87f2-46b9-87b6-f98428dd6edf tempest-VolumesTransfersV357Test-1961886484 None] Creating volume 7328ff2b-151d-4618-b5bf-deff0ebc5097 {{(pid=83345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 13:18:12 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-d9fdafca-87f2-46b9-87b6-f98428dd6edf tempest-VolumesTransfersV357Test-1961886484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:18:12 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-d9fdafca-87f2-46b9-87b6-f98428dd6edf tempest-VolumesTransfersV357Test-1961886484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:18:12 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-d9fdafca-87f2-46b9-87b6-f98428dd6edf tempest-VolumesTransfersV357Test-1961886484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:18:12 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-d9fdafca-87f2-46b9-87b6-f98428dd6edf tempest-VolumesTransfersV357Test-1961886484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:18:12 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-d9fdafca-87f2-46b9-87b6-f98428dd6edf tempest-VolumesTransfersV357Test-1961886484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:18:12 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-d9fdafca-87f2-46b9-87b6-f98428dd6edf tempest-VolumesTransfersV357Test-1961886484 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:18:12 devstack cinder-volume[83345]: INFO cinder.volume.drivers.remotefs [None req-d9fdafca-87f2-46b9-87b6-f98428dd6edf tempest-VolumesTransfersV357Test-1961886484 None] casted to osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331
Apr 10 13:18:12 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-d9fdafca-87f2-46b9-87b6-f98428dd6edf tempest-VolumesTransfersV357Test-1961886484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7328ff2b-151d-4618-b5bf-deff0ebc5097 1073741824 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:18:12 devstack sudo[90014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7328ff2b-151d-4618-b5bf-deff0ebc5097 1073741824
Apr 10 13:18:12 devstack sudo[90014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:18:12 devstack sudo[90009]: pam_unix(sudo:session): session closed for user root
Apr 10 13:18:12 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-0691e292-2db2-4c0f-89b5-edd8fff46d97 tempest-VolumesTransfersV357Test-930713215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.485s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:18:12 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-0691e292-2db2-4c0f-89b5-edd8fff46d97 tempest-VolumesTransfersV357Test-930713215 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:18:13 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-0691e292-2db2-4c0f-89b5-edd8fff46d97 tempest-VolumesTransfersV357Test-930713215 None] Deleted volume successfully.
Apr 10 13:18:13 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-0691e292-2db2-4c0f-89b5-edd8fff46d97 tempest-VolumesTransfersV357Test-930713215 None] Lock "cinder-c43495c7-8d44-48ed-9ce6-0e9de84f5400-delete_volume" released by "delete_volume" :: held 1.581s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:18:13 devstack sudo[90011]: pam_unix(sudo:session): session closed for user root
Apr 10 13:18:13 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-9e5dbe6e-188b-4f03-8d38-145d02cffbff tempest-CinderUnicodeTest-470920462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.431s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:18:13 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-9e5dbe6e-188b-4f03-8d38-145d02cffbff tempest-CinderUnicodeTest-470920462 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:18:13 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-9e5dbe6e-188b-4f03-8d38-145d02cffbff tempest-CinderUnicodeTest-470920462 None] Deleted volume successfully.
Apr 10 13:18:13 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-9e5dbe6e-188b-4f03-8d38-145d02cffbff tempest-CinderUnicodeTest-470920462 None] Lock "cinder-43857537-4b6c-49b7-9d7b-4ebce7c7fe15-delete_volume" released by "delete_volume" :: held 1.554s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:18:13 devstack sudo[90014]: pam_unix(sudo:session): session closed for user root
Apr 10 13:18:13 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-d9fdafca-87f2-46b9-87b6-f98428dd6edf tempest-VolumesTransfersV357Test-1961886484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7328ff2b-151d-4618-b5bf-deff0ebc5097 1073741824" returned: 0 in 0.468s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:18:13 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-d9fdafca-87f2-46b9-87b6-f98428dd6edf tempest-VolumesTransfersV357Test-1961886484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7328ff2b-151d-4618-b5bf-deff0ebc5097 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:18:13 devstack sudo[90020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7328ff2b-151d-4618-b5bf-deff0ebc5097
Apr 10 13:18:13 devstack sudo[90020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:18:13 devstack sudo[90020]: pam_unix(sudo:session): session closed for user root
Apr 10 13:18:13 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-d9fdafca-87f2-46b9-87b6-f98428dd6edf tempest-VolumesTransfersV357Test-1961886484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7328ff2b-151d-4618-b5bf-deff0ebc5097" returned: 0 in 0.435s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:18:13 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-d9fdafca-87f2-46b9-87b6-f98428dd6edf tempest-VolumesTransfersV357Test-1961886484 None] <== create_volume: return (925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'} {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 13:18:13 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-d9fdafca-87f2-46b9-87b6-f98428dd6edf tempest-VolumesTransfersV357Test-1961886484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.928s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:18:13 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-d9fdafca-87f2-46b9-87b6-f98428dd6edf tempest-VolumesTransfersV357Test-1961886484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07159bbb-f37b-481b-add9-a5ff4abb6048) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7328ff2b-151d-4618-b5bf-deff0ebc5097', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:18:13 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-d9fdafca-87f2-46b9-87b6-f98428dd6edf tempest-VolumesTransfersV357Test-1961886484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f8252a2-2f03-40ff-a58d-6b3abf675cb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:18:13 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-d9fdafca-87f2-46b9-87b6-f98428dd6edf tempest-VolumesTransfersV357Test-1961886484 None] Volume volume-7328ff2b-151d-4618-b5bf-deff0ebc5097 (7328ff2b-151d-4618-b5bf-deff0ebc5097): created successfully
Apr 10 13:18:13 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-d9fdafca-87f2-46b9-87b6-f98428dd6edf tempest-VolumesTransfersV357Test-1961886484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f8252a2-2f03-40ff-a58d-6b3abf675cb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:18:13 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-d9fdafca-87f2-46b9-87b6-f98428dd6edf tempest-VolumesTransfersV357Test-1961886484 None] Flow 'volume_create_manager' (d66fdfc0-7eeb-4c5f-a2ea-8b95be4edad0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:18:13 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-d9fdafca-87f2-46b9-87b6-f98428dd6edf tempest-VolumesTransfersV357Test-1961886484 None] Created volume successfully.
Apr 10 13:18:15 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-c966a757-a8c0-4567-9c13-6c93bfffa49a tempest-VolumesTransfersV357Test-930713215 None] Acquiring lock "cinder-7328ff2b-151d-4618-b5bf-deff0ebc5097-delete_volume" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:18:15 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-c966a757-a8c0-4567-9c13-6c93bfffa49a tempest-VolumesTransfersV357Test-930713215 None] Lock "cinder-7328ff2b-151d-4618-b5bf-deff0ebc5097-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:18:15 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-c966a757-a8c0-4567-9c13-6c93bfffa49a tempest-VolumesTransfersV357Test-930713215 None] Acquiring lock "cinder-quobyte-7328ff2b-151d-4618-b5bf-deff0ebc5097" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:18:15 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-c966a757-a8c0-4567-9c13-6c93bfffa49a tempest-VolumesTransfersV357Test-930713215 None] Lock "cinder-quobyte-7328ff2b-151d-4618-b5bf-deff0ebc5097" acquired by "delete_volume" :: waited 0.007s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:18:15 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fb2bd40-4c4f-4384-8a88-77459ef69e7b]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:18:15 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-c966a757-a8c0-4567-9c13-6c93bfffa49a tempest-VolumesTransfersV357Test-930713215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7328ff2b-151d-4618-b5bf-deff0ebc5097 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:18:15 devstack sudo[90023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7328ff2b-151d-4618-b5bf-deff0ebc5097
Apr 10 13:18:15 devstack sudo[90023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:18:15 devstack sudo[90023]: pam_unix(sudo:session): session closed for user root
Apr 10 13:18:15 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-c966a757-a8c0-4567-9c13-6c93bfffa49a tempest-VolumesTransfersV357Test-930713215 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7328ff2b-151d-4618-b5bf-deff0ebc5097" returned: 0 in 0.517s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:18:15 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-c966a757-a8c0-4567-9c13-6c93bfffa49a tempest-VolumesTransfersV357Test-930713215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7328ff2b-151d-4618-b5bf-deff0ebc5097 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:18:15 devstack sudo[90028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7328ff2b-151d-4618-b5bf-deff0ebc5097
Apr 10 13:18:15 devstack sudo[90028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:18:16 devstack sudo[90028]: pam_unix(sudo:session): session closed for user root
Apr 10 13:18:16 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-c966a757-a8c0-4567-9c13-6c93bfffa49a tempest-VolumesTransfersV357Test-930713215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7328ff2b-151d-4618-b5bf-deff0ebc5097" returned: 0 in 0.429s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:18:16 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-c966a757-a8c0-4567-9c13-6c93bfffa49a tempest-VolumesTransfersV357Test-930713215 None] Lock "cinder-quobyte-7328ff2b-151d-4618-b5bf-deff0ebc5097" released by "delete_volume" :: held 0.969s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:18:16 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-c966a757-a8c0-4567-9c13-6c93bfffa49a tempest-VolumesTransfersV357Test-930713215 None] Created reservations ['71b0ba9a-779f-49da-a5e1-ebeb372f49ee', 'df9bf99f-c6b9-4d61-834d-7d136db31d90', '17bad52a-fe05-4fb3-8222-107e3c8b8f99', 'd928af97-44db-4ed2-be3b-8cc2f8eda1b4'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:18:16 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-c966a757-a8c0-4567-9c13-6c93bfffa49a tempest-VolumesTransfersV357Test-930713215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:18:16 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-c966a757-a8c0-4567-9c13-6c93bfffa49a tempest-VolumesTransfersV357Test-930713215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:18:16 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-c966a757-a8c0-4567-9c13-6c93bfffa49a tempest-VolumesTransfersV357Test-930713215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:18:16 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-c966a757-a8c0-4567-9c13-6c93bfffa49a tempest-VolumesTransfersV357Test-930713215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:18:16 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-c966a757-a8c0-4567-9c13-6c93bfffa49a tempest-VolumesTransfersV357Test-930713215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:18:16 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-c966a757-a8c0-4567-9c13-6c93bfffa49a tempest-VolumesTransfersV357Test-930713215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:18:16 devstack sudo[90031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:18:16 devstack sudo[90031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:18:16 devstack sudo[90031]: pam_unix(sudo:session): session closed for user root
Apr 10 13:18:16 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-c966a757-a8c0-4567-9c13-6c93bfffa49a tempest-VolumesTransfersV357Test-930713215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.508s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:18:16 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-c966a757-a8c0-4567-9c13-6c93bfffa49a tempest-VolumesTransfersV357Test-930713215 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:18:16 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-c966a757-a8c0-4567-9c13-6c93bfffa49a tempest-VolumesTransfersV357Test-930713215 None] Deleted volume successfully.
Apr 10 13:18:16 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-c966a757-a8c0-4567-9c13-6c93bfffa49a tempest-VolumesTransfersV357Test-930713215 None] Lock "cinder-7328ff2b-151d-4618-b5bf-deff0ebc5097-delete_volume" released by "delete_volume" :: held 1.595s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:18:20 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-21542013-30af-4e8b-9e5b-f6872819c679 tempest-VolumesListTestJSON-1428813371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:18:20 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-21542013-30af-4e8b-9e5b-f6872819c679 tempest-VolumesListTestJSON-1428813371 None] Flow 'volume_create_manager' (7b6b4a99-b701-4723-b789-218b5fd5a889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:18:20 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-21542013-30af-4e8b-9e5b-f6872819c679 tempest-VolumesListTestJSON-1428813371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc8c1647-6433-415f-a577-53e1ab70e395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:18:20 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-21542013-30af-4e8b-9e5b-f6872819c679 tempest-VolumesListTestJSON-1428813371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc8c1647-6433-415f-a577-53e1ab70e395) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:18:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-884992955',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0c4b316-bccc-4402-a3bb-fcde3546c4d2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='097dfee2b6eb4a8dbf0afb331499eeb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:18:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:18:21Z,use_quota=True,user_id='f5d164b82fcc4b94a5e9fd68b1b55ab2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:18:20 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-21542013-30af-4e8b-9e5b-f6872819c679 tempest-VolumesListTestJSON-1428813371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50780856-65d6-4ac4-b984-894f945eed19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:18:20 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-21542013-30af-4e8b-9e5b-f6872819c679 tempest-VolumesListTestJSON-1428813371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50780856-65d6-4ac4-b984-894f945eed19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:18:20 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-21542013-30af-4e8b-9e5b-f6872819c679 tempest-VolumesListTestJSON-1428813371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8285433-3a32-402b-8866-19b7e86b8008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:18:20 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-21542013-30af-4e8b-9e5b-f6872819c679 tempest-VolumesListTestJSON-1428813371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8285433-3a32-402b-8866-19b7e86b8008) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0c4b316-bccc-4402-a3bb-fcde3546c4d2', 'volume_name': 'volume-e0c4b316-bccc-4402-a3bb-fcde3546c4d2', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:18:20 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-21542013-30af-4e8b-9e5b-f6872819c679 tempest-VolumesListTestJSON-1428813371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cdf13bf-873e-47b6-8b5b-9f1124102b57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:18:20 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-21542013-30af-4e8b-9e5b-f6872819c679 tempest-VolumesListTestJSON-1428813371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cdf13bf-873e-47b6-8b5b-9f1124102b57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:18:20 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-21542013-30af-4e8b-9e5b-f6872819c679 tempest-VolumesListTestJSON-1428813371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cc1c0fc-c901-4352-b058-4acf9226aed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:18:20 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-21542013-30af-4e8b-9e5b-f6872819c679 tempest-VolumesListTestJSON-1428813371 None] Volume e0c4b316-bccc-4402-a3bb-fcde3546c4d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0c4b316-bccc-4402-a3bb-fcde3546c4d2', 'volume_size': 1}
Apr 10 13:18:20 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-21542013-30af-4e8b-9e5b-f6872819c679 tempest-VolumesListTestJSON-1428813371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:18:20 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-21542013-30af-4e8b-9e5b-f6872819c679 tempest-VolumesListTestJSON-1428813371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:18:20 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-21542013-30af-4e8b-9e5b-f6872819c679 tempest-VolumesListTestJSON-1428813371 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f252bf08b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:18:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-884992955',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0c4b316-bccc-4402-a3bb-fcde3546c4d2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='097dfee2b6eb4a8dbf0afb331499eeb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:18:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:18:21Z,use_quota=True,user_id='f5d164b82fcc4b94a5e9fd68b1b55ab2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)}" {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 13:18:20 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-21542013-30af-4e8b-9e5b-f6872819c679 tempest-VolumesListTestJSON-1428813371 None] Creating volume e0c4b316-bccc-4402-a3bb-fcde3546c4d2 {{(pid=83345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 13:18:20 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-21542013-30af-4e8b-9e5b-f6872819c679 tempest-VolumesListTestJSON-1428813371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:18:20 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-21542013-30af-4e8b-9e5b-f6872819c679 tempest-VolumesListTestJSON-1428813371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:18:20 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-21542013-30af-4e8b-9e5b-f6872819c679 tempest-VolumesListTestJSON-1428813371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:18:20 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-21542013-30af-4e8b-9e5b-f6872819c679 tempest-VolumesListTestJSON-1428813371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:18:20 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-21542013-30af-4e8b-9e5b-f6872819c679 tempest-VolumesListTestJSON-1428813371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:18:20 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-21542013-30af-4e8b-9e5b-f6872819c679 tempest-VolumesListTestJSON-1428813371 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:18:20 devstack cinder-volume[83345]: INFO cinder.volume.drivers.remotefs [None req-21542013-30af-4e8b-9e5b-f6872819c679 tempest-VolumesListTestJSON-1428813371 None] casted to osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331
Apr 10 13:18:20 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-21542013-30af-4e8b-9e5b-f6872819c679 tempest-VolumesListTestJSON-1428813371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e0c4b316-bccc-4402-a3bb-fcde3546c4d2 1073741824 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:18:20 devstack sudo[90040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e0c4b316-bccc-4402-a3bb-fcde3546c4d2 1073741824
Apr 10 13:18:20 devstack sudo[90040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:18:21 devstack sudo[90040]: pam_unix(sudo:session): session closed for user root
Apr 10 13:18:21 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-21542013-30af-4e8b-9e5b-f6872819c679 tempest-VolumesListTestJSON-1428813371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e0c4b316-bccc-4402-a3bb-fcde3546c4d2 1073741824" returned: 0 in 0.607s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:18:21 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-21542013-30af-4e8b-9e5b-f6872819c679 tempest-VolumesListTestJSON-1428813371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e0c4b316-bccc-4402-a3bb-fcde3546c4d2 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:18:21 devstack sudo[90045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e0c4b316-bccc-4402-a3bb-fcde3546c4d2
Apr 10 13:18:21 devstack sudo[90045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:18:21 devstack sudo[90045]: pam_unix(sudo:session): session closed for user root
Apr 10 13:18:21 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-21542013-30af-4e8b-9e5b-f6872819c679 tempest-VolumesListTestJSON-1428813371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e0c4b316-bccc-4402-a3bb-fcde3546c4d2" returned: 0 in 0.451s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:18:21 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-21542013-30af-4e8b-9e5b-f6872819c679 tempest-VolumesListTestJSON-1428813371 None] <== create_volume: return (1088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'} {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 13:18:21 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-21542013-30af-4e8b-9e5b-f6872819c679 tempest-VolumesListTestJSON-1428813371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.090s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:18:21 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-21542013-30af-4e8b-9e5b-f6872819c679 tempest-VolumesListTestJSON-1428813371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cc1c0fc-c901-4352-b058-4acf9226aed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0c4b316-bccc-4402-a3bb-fcde3546c4d2', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:18:21 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-21542013-30af-4e8b-9e5b-f6872819c679 tempest-VolumesListTestJSON-1428813371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f0f7074-6988-485b-bfb8-effc9f979f93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:18:21 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-21542013-30af-4e8b-9e5b-f6872819c679 tempest-VolumesListTestJSON-1428813371 None] Volume volume-e0c4b316-bccc-4402-a3bb-fcde3546c4d2 (e0c4b316-bccc-4402-a3bb-fcde3546c4d2): created successfully
Apr 10 13:18:21 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-21542013-30af-4e8b-9e5b-f6872819c679 tempest-VolumesListTestJSON-1428813371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f0f7074-6988-485b-bfb8-effc9f979f93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:18:21 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-21542013-30af-4e8b-9e5b-f6872819c679 tempest-VolumesListTestJSON-1428813371 None] Flow 'volume_create_manager' (7b6b4a99-b701-4723-b789-218b5fd5a889) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:18:21 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-21542013-30af-4e8b-9e5b-f6872819c679 tempest-VolumesListTestJSON-1428813371 None] Created volume successfully.
Apr 10 13:18:23 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-c48bece2-9a84-4c53-89a9-cb0d71f144cc tempest-VolumesListTestJSON-1428813371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:18:23 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-c48bece2-9a84-4c53-89a9-cb0d71f144cc tempest-VolumesListTestJSON-1428813371 None] Flow 'volume_create_manager' (1ce26353-99fb-4f51-abe8-3ec68e278a2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:18:23 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-c48bece2-9a84-4c53-89a9-cb0d71f144cc tempest-VolumesListTestJSON-1428813371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec227d4d-887f-4124-b628-9c712a9e71ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:18:23 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-c48bece2-9a84-4c53-89a9-cb0d71f144cc tempest-VolumesListTestJSON-1428813371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec227d4d-887f-4124-b628-9c712a9e71ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:18:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2101038354',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0007e448-0349-43a6-857e-8472153f3c73,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='097dfee2b6eb4a8dbf0afb331499eeb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:18:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:18:23Z,use_quota=True,user_id='f5d164b82fcc4b94a5e9fd68b1b55ab2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:18:23 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-c48bece2-9a84-4c53-89a9-cb0d71f144cc tempest-VolumesListTestJSON-1428813371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa1c1ce8-fa88-4035-9ad8-153e372b2cda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:18:23 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-c48bece2-9a84-4c53-89a9-cb0d71f144cc tempest-VolumesListTestJSON-1428813371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa1c1ce8-fa88-4035-9ad8-153e372b2cda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:18:23 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-c48bece2-9a84-4c53-89a9-cb0d71f144cc tempest-VolumesListTestJSON-1428813371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcfda1d8-720f-4f3b-8940-9a1d06d73320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:18:23 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-c48bece2-9a84-4c53-89a9-cb0d71f144cc tempest-VolumesListTestJSON-1428813371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcfda1d8-720f-4f3b-8940-9a1d06d73320) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0007e448-0349-43a6-857e-8472153f3c73', 'volume_name': 'volume-0007e448-0349-43a6-857e-8472153f3c73', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:18:23 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-c48bece2-9a84-4c53-89a9-cb0d71f144cc tempest-VolumesListTestJSON-1428813371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dae42be-d2a1-4508-8266-5e270e6726a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:18:23 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-c48bece2-9a84-4c53-89a9-cb0d71f144cc tempest-VolumesListTestJSON-1428813371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dae42be-d2a1-4508-8266-5e270e6726a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:18:23 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-c48bece2-9a84-4c53-89a9-cb0d71f144cc tempest-VolumesListTestJSON-1428813371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4181de1-7307-4a3c-83d6-10025da50c72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:18:23 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-c48bece2-9a84-4c53-89a9-cb0d71f144cc tempest-VolumesListTestJSON-1428813371 None] Volume 0007e448-0349-43a6-857e-8472153f3c73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0007e448-0349-43a6-857e-8472153f3c73', 'volume_size': 1}
Apr 10 13:18:23 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-c48bece2-9a84-4c53-89a9-cb0d71f144cc tempest-VolumesListTestJSON-1428813371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:18:23 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-c48bece2-9a84-4c53-89a9-cb0d71f144cc tempest-VolumesListTestJSON-1428813371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:18:23 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-c48bece2-9a84-4c53-89a9-cb0d71f144cc tempest-VolumesListTestJSON-1428813371 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f252bf08b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:18:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2101038354',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0007e448-0349-43a6-857e-8472153f3c73,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='097dfee2b6eb4a8dbf0afb331499eeb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:18:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:18:23Z,use_quota=True,user_id='f5d164b82fcc4b94a5e9fd68b1b55ab2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)}" {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 13:18:23 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-c48bece2-9a84-4c53-89a9-cb0d71f144cc tempest-VolumesListTestJSON-1428813371 None] Creating volume 0007e448-0349-43a6-857e-8472153f3c73 {{(pid=83345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 13:18:23 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-c48bece2-9a84-4c53-89a9-cb0d71f144cc tempest-VolumesListTestJSON-1428813371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:18:23 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-c48bece2-9a84-4c53-89a9-cb0d71f144cc tempest-VolumesListTestJSON-1428813371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:18:23 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-c48bece2-9a84-4c53-89a9-cb0d71f144cc tempest-VolumesListTestJSON-1428813371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:18:23 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-c48bece2-9a84-4c53-89a9-cb0d71f144cc tempest-VolumesListTestJSON-1428813371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:18:23 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-c48bece2-9a84-4c53-89a9-cb0d71f144cc tempest-VolumesListTestJSON-1428813371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:18:23 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-c48bece2-9a84-4c53-89a9-cb0d71f144cc tempest-VolumesListTestJSON-1428813371 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:18:23 devstack cinder-volume[83345]: INFO cinder.volume.drivers.remotefs [None req-c48bece2-9a84-4c53-89a9-cb0d71f144cc tempest-VolumesListTestJSON-1428813371 None] casted to osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331
Apr 10 13:18:23 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-c48bece2-9a84-4c53-89a9-cb0d71f144cc tempest-VolumesListTestJSON-1428813371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-0007e448-0349-43a6-857e-8472153f3c73 1073741824 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:18:23 devstack sudo[90050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-0007e448-0349-43a6-857e-8472153f3c73 1073741824
Apr 10 13:18:23 devstack sudo[90050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:18:23 devstack sudo[90050]: pam_unix(sudo:session): session closed for user root
Apr 10 13:18:23 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-c48bece2-9a84-4c53-89a9-cb0d71f144cc tempest-VolumesListTestJSON-1428813371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-0007e448-0349-43a6-857e-8472153f3c73 1073741824" returned: 0 in 0.469s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:18:23 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-c48bece2-9a84-4c53-89a9-cb0d71f144cc tempest-VolumesListTestJSON-1428813371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-0007e448-0349-43a6-857e-8472153f3c73 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:18:23 devstack sudo[90055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-0007e448-0349-43a6-857e-8472153f3c73
Apr 10 13:18:23 devstack sudo[90055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:18:24 devstack sudo[90055]: pam_unix(sudo:session): session closed for user root
Apr 10 13:18:24 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-c48bece2-9a84-4c53-89a9-cb0d71f144cc tempest-VolumesListTestJSON-1428813371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-0007e448-0349-43a6-857e-8472153f3c73" returned: 0 in 0.415s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:18:24 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-c48bece2-9a84-4c53-89a9-cb0d71f144cc tempest-VolumesListTestJSON-1428813371 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'} {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 13:18:24 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-c48bece2-9a84-4c53-89a9-cb0d71f144cc tempest-VolumesListTestJSON-1428813371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.917s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:18:24 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-c48bece2-9a84-4c53-89a9-cb0d71f144cc tempest-VolumesListTestJSON-1428813371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4181de1-7307-4a3c-83d6-10025da50c72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0007e448-0349-43a6-857e-8472153f3c73', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:18:24 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-c48bece2-9a84-4c53-89a9-cb0d71f144cc tempest-VolumesListTestJSON-1428813371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd45e3b4-7bad-4972-98db-373fb3ebcb5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:18:24 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-c48bece2-9a84-4c53-89a9-cb0d71f144cc tempest-VolumesListTestJSON-1428813371 None] Volume volume-0007e448-0349-43a6-857e-8472153f3c73 (0007e448-0349-43a6-857e-8472153f3c73): created successfully
Apr 10 13:18:24 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-c48bece2-9a84-4c53-89a9-cb0d71f144cc tempest-VolumesListTestJSON-1428813371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd45e3b4-7bad-4972-98db-373fb3ebcb5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:18:24 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-c48bece2-9a84-4c53-89a9-cb0d71f144cc tempest-VolumesListTestJSON-1428813371 None] Flow 'volume_create_manager' (1ce26353-99fb-4f51-abe8-3ec68e278a2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:18:24 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-c48bece2-9a84-4c53-89a9-cb0d71f144cc tempest-VolumesListTestJSON-1428813371 None] Created volume successfully.
Apr 10 13:18:25 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bdf82e7-4a79-4811-81f0-7bbdae39ffa2 tempest-VolumesListTestJSON-1428813371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:18:25 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-2bdf82e7-4a79-4811-81f0-7bbdae39ffa2 tempest-VolumesListTestJSON-1428813371 None] Flow 'volume_create_manager' (0f5787e4-1743-4ffd-ad9e-d8c8ddfdaada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:18:25 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-2bdf82e7-4a79-4811-81f0-7bbdae39ffa2 tempest-VolumesListTestJSON-1428813371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94ad1d18-efcc-4170-802d-db5c2928de25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:18:25 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-2bdf82e7-4a79-4811-81f0-7bbdae39ffa2 tempest-VolumesListTestJSON-1428813371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94ad1d18-efcc-4170-802d-db5c2928de25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:18:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1622995186',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16379d35-407c-4ca4-b16d-e9d679ecbb65,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='097dfee2b6eb4a8dbf0afb331499eeb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:18:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:18:26Z,use_quota=True,user_id='f5d164b82fcc4b94a5e9fd68b1b55ab2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:18:25 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-2bdf82e7-4a79-4811-81f0-7bbdae39ffa2 tempest-VolumesListTestJSON-1428813371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c0f9cfe-3c16-401f-a35f-07ed6ef55df1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:18:25 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-2bdf82e7-4a79-4811-81f0-7bbdae39ffa2 tempest-VolumesListTestJSON-1428813371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c0f9cfe-3c16-401f-a35f-07ed6ef55df1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:18:25 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-2bdf82e7-4a79-4811-81f0-7bbdae39ffa2 tempest-VolumesListTestJSON-1428813371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d223c95b-15c2-4057-9dc2-aab2250ba5cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:18:25 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-2bdf82e7-4a79-4811-81f0-7bbdae39ffa2 tempest-VolumesListTestJSON-1428813371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d223c95b-15c2-4057-9dc2-aab2250ba5cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16379d35-407c-4ca4-b16d-e9d679ecbb65', 'volume_name': 'volume-16379d35-407c-4ca4-b16d-e9d679ecbb65', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:18:25 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-2bdf82e7-4a79-4811-81f0-7bbdae39ffa2 tempest-VolumesListTestJSON-1428813371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93670b18-77b2-4c7a-8815-4ae02276e2e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:18:25 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-2bdf82e7-4a79-4811-81f0-7bbdae39ffa2 tempest-VolumesListTestJSON-1428813371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93670b18-77b2-4c7a-8815-4ae02276e2e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:18:25 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-2bdf82e7-4a79-4811-81f0-7bbdae39ffa2 tempest-VolumesListTestJSON-1428813371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3084ecbd-7c51-4d81-be40-6e218d318cce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:18:25 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-2bdf82e7-4a79-4811-81f0-7bbdae39ffa2 tempest-VolumesListTestJSON-1428813371 None] Volume 16379d35-407c-4ca4-b16d-e9d679ecbb65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16379d35-407c-4ca4-b16d-e9d679ecbb65', 'volume_size': 1}
Apr 10 13:18:25 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-2bdf82e7-4a79-4811-81f0-7bbdae39ffa2 tempest-VolumesListTestJSON-1428813371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:18:25 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-2bdf82e7-4a79-4811-81f0-7bbdae39ffa2 tempest-VolumesListTestJSON-1428813371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:18:25 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-2bdf82e7-4a79-4811-81f0-7bbdae39ffa2 tempest-VolumesListTestJSON-1428813371 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f252bf08b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:18:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1622995186',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16379d35-407c-4ca4-b16d-e9d679ecbb65,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='097dfee2b6eb4a8dbf0afb331499eeb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:18:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:18:26Z,use_quota=True,user_id='f5d164b82fcc4b94a5e9fd68b1b55ab2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)}" {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 13:18:25 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-2bdf82e7-4a79-4811-81f0-7bbdae39ffa2 tempest-VolumesListTestJSON-1428813371 None] Creating volume 16379d35-407c-4ca4-b16d-e9d679ecbb65 {{(pid=83345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 13:18:25 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-2bdf82e7-4a79-4811-81f0-7bbdae39ffa2 tempest-VolumesListTestJSON-1428813371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:18:25 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-2bdf82e7-4a79-4811-81f0-7bbdae39ffa2 tempest-VolumesListTestJSON-1428813371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:18:25 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-2bdf82e7-4a79-4811-81f0-7bbdae39ffa2 tempest-VolumesListTestJSON-1428813371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:18:25 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-2bdf82e7-4a79-4811-81f0-7bbdae39ffa2 tempest-VolumesListTestJSON-1428813371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:18:25 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-2bdf82e7-4a79-4811-81f0-7bbdae39ffa2 tempest-VolumesListTestJSON-1428813371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:18:25 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-2bdf82e7-4a79-4811-81f0-7bbdae39ffa2 tempest-VolumesListTestJSON-1428813371 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:18:25 devstack cinder-volume[83345]: INFO cinder.volume.drivers.remotefs [None req-2bdf82e7-4a79-4811-81f0-7bbdae39ffa2 tempest-VolumesListTestJSON-1428813371 None] casted to osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331
Apr 10 13:18:25 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-2bdf82e7-4a79-4811-81f0-7bbdae39ffa2 tempest-VolumesListTestJSON-1428813371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-16379d35-407c-4ca4-b16d-e9d679ecbb65 1073741824 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:18:25 devstack sudo[90058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-16379d35-407c-4ca4-b16d-e9d679ecbb65 1073741824
Apr 10 13:18:25 devstack sudo[90058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:18:26 devstack sudo[90058]: pam_unix(sudo:session): session closed for user root
Apr 10 13:18:26 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-2bdf82e7-4a79-4811-81f0-7bbdae39ffa2 tempest-VolumesListTestJSON-1428813371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-16379d35-407c-4ca4-b16d-e9d679ecbb65 1073741824" returned: 0 in 0.530s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:18:26 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-2bdf82e7-4a79-4811-81f0-7bbdae39ffa2 tempest-VolumesListTestJSON-1428813371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-16379d35-407c-4ca4-b16d-e9d679ecbb65 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:18:26 devstack sudo[90063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-16379d35-407c-4ca4-b16d-e9d679ecbb65
Apr 10 13:18:26 devstack sudo[90063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:18:26 devstack sudo[90063]: pam_unix(sudo:session): session closed for user root
Apr 10 13:18:26 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-2bdf82e7-4a79-4811-81f0-7bbdae39ffa2 tempest-VolumesListTestJSON-1428813371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-16379d35-407c-4ca4-b16d-e9d679ecbb65" returned: 0 in 0.463s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:18:26 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-2bdf82e7-4a79-4811-81f0-7bbdae39ffa2 tempest-VolumesListTestJSON-1428813371 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'} {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 13:18:26 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-2bdf82e7-4a79-4811-81f0-7bbdae39ffa2 tempest-VolumesListTestJSON-1428813371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:18:26 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-2bdf82e7-4a79-4811-81f0-7bbdae39ffa2 tempest-VolumesListTestJSON-1428813371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3084ecbd-7c51-4d81-be40-6e218d318cce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16379d35-407c-4ca4-b16d-e9d679ecbb65', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:18:26 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-2bdf82e7-4a79-4811-81f0-7bbdae39ffa2 tempest-VolumesListTestJSON-1428813371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (889a7081-e139-43b1-bc51-30a4ceb27850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:18:26 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-2bdf82e7-4a79-4811-81f0-7bbdae39ffa2 tempest-VolumesListTestJSON-1428813371 None] Volume volume-16379d35-407c-4ca4-b16d-e9d679ecbb65 (16379d35-407c-4ca4-b16d-e9d679ecbb65): created successfully
Apr 10 13:18:26 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-2bdf82e7-4a79-4811-81f0-7bbdae39ffa2 tempest-VolumesListTestJSON-1428813371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (889a7081-e139-43b1-bc51-30a4ceb27850) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:18:26 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-2bdf82e7-4a79-4811-81f0-7bbdae39ffa2 tempest-VolumesListTestJSON-1428813371 None] Flow 'volume_create_manager' (0f5787e4-1743-4ffd-ad9e-d8c8ddfdaada) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:18:26 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-2bdf82e7-4a79-4811-81f0-7bbdae39ffa2 tempest-VolumesListTestJSON-1428813371 None] Created volume successfully.
Apr 10 13:18:28 devstack cinder-volume[83345]: DEBUG dbcounter [-] [83345] Writing DB stats cinder:UPDATE=232,cinder:INSERT=48,cinder:DELETE=22,cinder:SELECT=150 {{(pid=83345) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 10 13:18:28 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f1fa424-88d1-410d-b175-77945e0cb733 tempest-SnapshotDependencyTests-448443045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:18:28 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-3f1fa424-88d1-410d-b175-77945e0cb733 tempest-SnapshotDependencyTests-448443045 None] Flow 'volume_create_manager' (df1a93f7-efa8-4665-ba66-0ba987f88c22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:18:28 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-3f1fa424-88d1-410d-b175-77945e0cb733 tempest-SnapshotDependencyTests-448443045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bf0c4f2-a308-430c-9862-bbecab973899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:18:28 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-3f1fa424-88d1-410d-b175-77945e0cb733 tempest-SnapshotDependencyTests-448443045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bf0c4f2-a308-430c-9862-bbecab973899) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:18:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-795284671',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b240e5ee-0d93-42dc-904d-8b810ee9b44c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11c1bff9fa684a54853e1688ce416ca6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:18:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:18:28Z,use_quota=True,user_id='470d61a722824003ad069162d00532fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:18:28 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-3f1fa424-88d1-410d-b175-77945e0cb733 tempest-SnapshotDependencyTests-448443045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c31ae506-a7b7-4259-a0fb-2fa3920fb3db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:18:28 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-3f1fa424-88d1-410d-b175-77945e0cb733 tempest-SnapshotDependencyTests-448443045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c31ae506-a7b7-4259-a0fb-2fa3920fb3db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:18:28 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-3f1fa424-88d1-410d-b175-77945e0cb733 tempest-SnapshotDependencyTests-448443045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce599e94-0047-4dc9-932d-6b36abfdd95d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:18:28 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-3f1fa424-88d1-410d-b175-77945e0cb733 tempest-SnapshotDependencyTests-448443045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce599e94-0047-4dc9-932d-6b36abfdd95d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b240e5ee-0d93-42dc-904d-8b810ee9b44c', 'volume_name': 'volume-b240e5ee-0d93-42dc-904d-8b810ee9b44c', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:18:28 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-3f1fa424-88d1-410d-b175-77945e0cb733 tempest-SnapshotDependencyTests-448443045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ee7fead-ab0a-4fd7-b3d1-b7e2ccd8db8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:18:28 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-3f1fa424-88d1-410d-b175-77945e0cb733 tempest-SnapshotDependencyTests-448443045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ee7fead-ab0a-4fd7-b3d1-b7e2ccd8db8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:18:28 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-3f1fa424-88d1-410d-b175-77945e0cb733 tempest-SnapshotDependencyTests-448443045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56234f65-0e9e-4991-b030-fd67a76341d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:18:28 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-3f1fa424-88d1-410d-b175-77945e0cb733 tempest-SnapshotDependencyTests-448443045 None] Volume b240e5ee-0d93-42dc-904d-8b810ee9b44c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b240e5ee-0d93-42dc-904d-8b810ee9b44c', 'volume_size': 1}
Apr 10 13:18:28 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-3f1fa424-88d1-410d-b175-77945e0cb733 tempest-SnapshotDependencyTests-448443045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:18:28 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-3f1fa424-88d1-410d-b175-77945e0cb733 tempest-SnapshotDependencyTests-448443045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:18:28 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-3f1fa424-88d1-410d-b175-77945e0cb733 tempest-SnapshotDependencyTests-448443045 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f252bf08b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:18:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-795284671',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b240e5ee-0d93-42dc-904d-8b810ee9b44c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11c1bff9fa684a54853e1688ce416ca6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:18:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:18:28Z,use_quota=True,user_id='470d61a722824003ad069162d00532fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)}" {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 13:18:28 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-3f1fa424-88d1-410d-b175-77945e0cb733 tempest-SnapshotDependencyTests-448443045 None] Creating volume b240e5ee-0d93-42dc-904d-8b810ee9b44c {{(pid=83345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 13:18:28 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-3f1fa424-88d1-410d-b175-77945e0cb733 tempest-SnapshotDependencyTests-448443045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:18:28 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-3f1fa424-88d1-410d-b175-77945e0cb733 tempest-SnapshotDependencyTests-448443045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:18:28 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-3f1fa424-88d1-410d-b175-77945e0cb733 tempest-SnapshotDependencyTests-448443045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:18:28 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-3f1fa424-88d1-410d-b175-77945e0cb733 tempest-SnapshotDependencyTests-448443045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:18:28 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-3f1fa424-88d1-410d-b175-77945e0cb733 tempest-SnapshotDependencyTests-448443045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:18:28 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-3f1fa424-88d1-410d-b175-77945e0cb733 tempest-SnapshotDependencyTests-448443045 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:18:28 devstack cinder-volume[83345]: INFO cinder.volume.drivers.remotefs [None req-3f1fa424-88d1-410d-b175-77945e0cb733 tempest-SnapshotDependencyTests-448443045 None] casted to osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331
Apr 10 13:18:28 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-3f1fa424-88d1-410d-b175-77945e0cb733 tempest-SnapshotDependencyTests-448443045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b240e5ee-0d93-42dc-904d-8b810ee9b44c 1073741824 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:18:28 devstack sudo[90086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b240e5ee-0d93-42dc-904d-8b810ee9b44c 1073741824
Apr 10 13:18:28 devstack sudo[90086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:18:29 devstack sudo[90086]: pam_unix(sudo:session): session closed for user root
Apr 10 13:18:29 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-3f1fa424-88d1-410d-b175-77945e0cb733 tempest-SnapshotDependencyTests-448443045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b240e5ee-0d93-42dc-904d-8b810ee9b44c 1073741824" returned: 0 in 0.581s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:18:29 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-3f1fa424-88d1-410d-b175-77945e0cb733 tempest-SnapshotDependencyTests-448443045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b240e5ee-0d93-42dc-904d-8b810ee9b44c {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:18:29 devstack sudo[90105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b240e5ee-0d93-42dc-904d-8b810ee9b44c
Apr 10 13:18:29 devstack sudo[90105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:18:29 devstack sudo[90105]: pam_unix(sudo:session): session closed for user root
Apr 10 13:18:29 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-3f1fa424-88d1-410d-b175-77945e0cb733 tempest-SnapshotDependencyTests-448443045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b240e5ee-0d93-42dc-904d-8b810ee9b44c" returned: 0 in 0.449s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:18:29 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-3f1fa424-88d1-410d-b175-77945e0cb733 tempest-SnapshotDependencyTests-448443045 None] <== create_volume: return (1056ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'} {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 13:18:29 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-3f1fa424-88d1-410d-b175-77945e0cb733 tempest-SnapshotDependencyTests-448443045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.059s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:18:29 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-3f1fa424-88d1-410d-b175-77945e0cb733 tempest-SnapshotDependencyTests-448443045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56234f65-0e9e-4991-b030-fd67a76341d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b240e5ee-0d93-42dc-904d-8b810ee9b44c', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:18:29 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-3f1fa424-88d1-410d-b175-77945e0cb733 tempest-SnapshotDependencyTests-448443045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ec54eee-6709-4dd9-bea3-6bfb5cff7a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:18:29 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-3f1fa424-88d1-410d-b175-77945e0cb733 tempest-SnapshotDependencyTests-448443045 None] Volume volume-b240e5ee-0d93-42dc-904d-8b810ee9b44c (b240e5ee-0d93-42dc-904d-8b810ee9b44c): created successfully
Apr 10 13:18:29 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-3f1fa424-88d1-410d-b175-77945e0cb733 tempest-SnapshotDependencyTests-448443045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ec54eee-6709-4dd9-bea3-6bfb5cff7a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:18:29 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-3f1fa424-88d1-410d-b175-77945e0cb733 tempest-SnapshotDependencyTests-448443045 None] Flow 'volume_create_manager' (df1a93f7-efa8-4665-ba66-0ba987f88c22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:18:29 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-3f1fa424-88d1-410d-b175-77945e0cb733 tempest-SnapshotDependencyTests-448443045 None] Created volume successfully.
Apr 10 13:18:29 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-7a172958-9d23-4dbf-9ba7-9d704250ed1f tempest-VolumesListTestJSON-1428813371 None] Acquiring lock "cinder-16379d35-407c-4ca4-b16d-e9d679ecbb65-delete_volume" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:18:29 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-7a172958-9d23-4dbf-9ba7-9d704250ed1f tempest-VolumesListTestJSON-1428813371 None] Lock "cinder-16379d35-407c-4ca4-b16d-e9d679ecbb65-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:18:29 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-7a172958-9d23-4dbf-9ba7-9d704250ed1f tempest-VolumesListTestJSON-1428813371 None] Acquiring lock "cinder-quobyte-16379d35-407c-4ca4-b16d-e9d679ecbb65" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:18:29 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-7a172958-9d23-4dbf-9ba7-9d704250ed1f tempest-VolumesListTestJSON-1428813371 None] Lock "cinder-quobyte-16379d35-407c-4ca4-b16d-e9d679ecbb65" acquired by "delete_volume" :: waited 0.009s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:18:29 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a769a8f-8550-473d-9250-df0ef64e1a10]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:18:29 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-7a172958-9d23-4dbf-9ba7-9d704250ed1f tempest-VolumesListTestJSON-1428813371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-16379d35-407c-4ca4-b16d-e9d679ecbb65 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:18:30 devstack sudo[90108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-16379d35-407c-4ca4-b16d-e9d679ecbb65
Apr 10 13:18:30 devstack sudo[90108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:18:30 devstack sudo[90108]: pam_unix(sudo:session): session closed for user root
Apr 10 13:18:30 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-7a172958-9d23-4dbf-9ba7-9d704250ed1f tempest-VolumesListTestJSON-1428813371 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-16379d35-407c-4ca4-b16d-e9d679ecbb65" returned: 0 in 0.460s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:18:30 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-7a172958-9d23-4dbf-9ba7-9d704250ed1f tempest-VolumesListTestJSON-1428813371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-16379d35-407c-4ca4-b16d-e9d679ecbb65 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:18:30 devstack sudo[90113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-16379d35-407c-4ca4-b16d-e9d679ecbb65
Apr 10 13:18:30 devstack sudo[90113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:18:30 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-a886e09a-b966-4cdb-a024-da895523f43c tempest-SnapshotDependencyTests-448443045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:18:30 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-a886e09a-b966-4cdb-a024-da895523f43c tempest-SnapshotDependencyTests-448443045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:18:30 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-a886e09a-b966-4cdb-a024-da895523f43c tempest-SnapshotDependencyTests-448443045 None] Creating offline snapshot 0c5fe572-9e6f-4a46-9528-b24037cfa22b of volume b240e5ee-0d93-42dc-904d-8b810ee9b44c {{(pid=83345) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 10 13:18:30 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[27045c98-b464-46cc-824c-5061cfc81d8c]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:18:30 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-a886e09a-b966-4cdb-a024-da895523f43c tempest-SnapshotDependencyTests-448443045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b240e5ee-0d93-42dc-904d-8b810ee9b44c {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:18:30 devstack sudo[90115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b240e5ee-0d93-42dc-904d-8b810ee9b44c
Apr 10 13:18:30 devstack sudo[90115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:18:30 devstack sudo[90113]: pam_unix(sudo:session): session closed for user root
Apr 10 13:18:30 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-7a172958-9d23-4dbf-9ba7-9d704250ed1f tempest-VolumesListTestJSON-1428813371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-16379d35-407c-4ca4-b16d-e9d679ecbb65" returned: 0 in 0.426s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:18:30 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-7a172958-9d23-4dbf-9ba7-9d704250ed1f tempest-VolumesListTestJSON-1428813371 None] Lock "cinder-quobyte-16379d35-407c-4ca4-b16d-e9d679ecbb65" released by "delete_volume" :: held 0.910s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:18:30 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-7a172958-9d23-4dbf-9ba7-9d704250ed1f tempest-VolumesListTestJSON-1428813371 None] Created reservations ['394f7191-3182-46b6-a4f1-a5d77a32f3f6', '40482c58-f08b-4c85-9888-8e046dbba5e4', 'f291c264-cbee-489d-acb7-af28d7dd5b75', '31e7339a-6194-45c9-8f39-b04f00c8d613'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:18:30 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-7a172958-9d23-4dbf-9ba7-9d704250ed1f tempest-VolumesListTestJSON-1428813371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:18:30 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-7a172958-9d23-4dbf-9ba7-9d704250ed1f tempest-VolumesListTestJSON-1428813371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:18:30 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-7a172958-9d23-4dbf-9ba7-9d704250ed1f tempest-VolumesListTestJSON-1428813371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:18:30 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-7a172958-9d23-4dbf-9ba7-9d704250ed1f tempest-VolumesListTestJSON-1428813371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:18:30 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-7a172958-9d23-4dbf-9ba7-9d704250ed1f tempest-VolumesListTestJSON-1428813371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:18:30 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-7a172958-9d23-4dbf-9ba7-9d704250ed1f tempest-VolumesListTestJSON-1428813371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:18:30 devstack sudo[90118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:18:30 devstack sudo[90118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:18:31 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-ab981462-2fdb-40f9-a3c6-3bcef2333428 tempest-VolumesListTestJSON-1428813371 None] Acquiring lock "cinder-0007e448-0349-43a6-857e-8472153f3c73-delete_volume" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:18:31 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-ab981462-2fdb-40f9-a3c6-3bcef2333428 tempest-VolumesListTestJSON-1428813371 None] Lock "cinder-0007e448-0349-43a6-857e-8472153f3c73-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:18:31 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-ab981462-2fdb-40f9-a3c6-3bcef2333428 tempest-VolumesListTestJSON-1428813371 None] Acquiring lock "cinder-quobyte-0007e448-0349-43a6-857e-8472153f3c73" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:18:31 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-ab981462-2fdb-40f9-a3c6-3bcef2333428 tempest-VolumesListTestJSON-1428813371 None] Lock "cinder-quobyte-0007e448-0349-43a6-857e-8472153f3c73" acquired by "delete_volume" :: waited 0.008s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:18:31 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[2365f2d3-a429-4bdd-8aad-bc28eba21127]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:18:31 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ab981462-2fdb-40f9-a3c6-3bcef2333428 tempest-VolumesListTestJSON-1428813371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-0007e448-0349-43a6-857e-8472153f3c73 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:18:31 devstack sudo[90115]: pam_unix(sudo:session): session closed for user root
Apr 10 13:18:31 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-a886e09a-b966-4cdb-a024-da895523f43c tempest-SnapshotDependencyTests-448443045 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b240e5ee-0d93-42dc-904d-8b810ee9b44c" returned: 0 in 0.525s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:18:31 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-a886e09a-b966-4cdb-a024-da895523f43c tempest-SnapshotDependencyTests-448443045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b240e5ee-0d93-42dc-904d-8b810ee9b44c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b240e5ee-0d93-42dc-904d-8b810ee9b44c.0c5fe572-9e6f-4a46-9528-b24037cfa22b 1G {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:18:31 devstack sudo[90124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b240e5ee-0d93-42dc-904d-8b810ee9b44c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b240e5ee-0d93-42dc-904d-8b810ee9b44c.0c5fe572-9e6f-4a46-9528-b24037cfa22b 1G
Apr 10 13:18:31 devstack sudo[90124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:18:31 devstack sudo[90123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-0007e448-0349-43a6-857e-8472153f3c73
Apr 10 13:18:31 devstack sudo[90123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:18:31 devstack sudo[90118]: pam_unix(sudo:session): session closed for user root
Apr 10 13:18:31 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-7a172958-9d23-4dbf-9ba7-9d704250ed1f tempest-VolumesListTestJSON-1428813371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.436s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:18:31 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-7a172958-9d23-4dbf-9ba7-9d704250ed1f tempest-VolumesListTestJSON-1428813371 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:18:31 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-7a172958-9d23-4dbf-9ba7-9d704250ed1f tempest-VolumesListTestJSON-1428813371 None] Deleted volume successfully.
Apr 10 13:18:31 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-7a172958-9d23-4dbf-9ba7-9d704250ed1f tempest-VolumesListTestJSON-1428813371 None] Lock "cinder-16379d35-407c-4ca4-b16d-e9d679ecbb65-delete_volume" released by "delete_volume" :: held 1.472s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:18:31 devstack sudo[90124]: pam_unix(sudo:session): session closed for user root
Apr 10 13:18:31 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-a886e09a-b966-4cdb-a024-da895523f43c tempest-SnapshotDependencyTests-448443045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b240e5ee-0d93-42dc-904d-8b810ee9b44c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b240e5ee-0d93-42dc-904d-8b810ee9b44c.0c5fe572-9e6f-4a46-9528-b24037cfa22b 1G" returned: 0 in 0.506s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:18:31 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-a886e09a-b966-4cdb-a024-da895523f43c tempest-SnapshotDependencyTests-448443045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b240e5ee-0d93-42dc-904d-8b810ee9b44c -F qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b240e5ee-0d93-42dc-904d-8b810ee9b44c.0c5fe572-9e6f-4a46-9528-b24037cfa22b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:18:31 devstack sudo[90123]: pam_unix(sudo:session): session closed for user root
Apr 10 13:18:31 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ab981462-2fdb-40f9-a3c6-3bcef2333428 tempest-VolumesListTestJSON-1428813371 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-0007e448-0349-43a6-857e-8472153f3c73" returned: 0 in 0.530s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:18:31 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ab981462-2fdb-40f9-a3c6-3bcef2333428 tempest-VolumesListTestJSON-1428813371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-0007e448-0349-43a6-857e-8472153f3c73 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:18:31 devstack sudo[90135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b240e5ee-0d93-42dc-904d-8b810ee9b44c -F qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b240e5ee-0d93-42dc-904d-8b810ee9b44c.0c5fe572-9e6f-4a46-9528-b24037cfa22b
Apr 10 13:18:31 devstack sudo[90135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:18:31 devstack sudo[90136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-0007e448-0349-43a6-857e-8472153f3c73
Apr 10 13:18:31 devstack sudo[90136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:18:32 devstack sudo[90135]: pam_unix(sudo:session): session closed for user root
Apr 10 13:18:32 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-a886e09a-b966-4cdb-a024-da895523f43c tempest-SnapshotDependencyTests-448443045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b240e5ee-0d93-42dc-904d-8b810ee9b44c -F qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b240e5ee-0d93-42dc-904d-8b810ee9b44c.0c5fe572-9e6f-4a46-9528-b24037cfa22b" returned: 0 in 0.419s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:18:32 devstack cinder-volume[83345]: WARNING cinder.volume.drivers.remotefs [None req-a886e09a-b966-4cdb-a024-da895523f43c tempest-SnapshotDependencyTests-448443045 None] /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b240e5ee-0d93-42dc-904d-8b810ee9b44c.0c5fe572-9e6f-4a46-9528-b24037cfa22b is being set with open permissions: ugo+rw
Apr 10 13:18:32 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-a886e09a-b966-4cdb-a024-da895523f43c tempest-SnapshotDependencyTests-448443045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b240e5ee-0d93-42dc-904d-8b810ee9b44c.0c5fe572-9e6f-4a46-9528-b24037cfa22b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:18:32 devstack sudo[90143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b240e5ee-0d93-42dc-904d-8b810ee9b44c.0c5fe572-9e6f-4a46-9528-b24037cfa22b
Apr 10 13:18:32 devstack sudo[90143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:18:32 devstack sudo[90136]: pam_unix(sudo:session): session closed for user root
Apr 10 13:18:32 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ab981462-2fdb-40f9-a3c6-3bcef2333428 tempest-VolumesListTestJSON-1428813371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-0007e448-0349-43a6-857e-8472153f3c73" returned: 0 in 0.433s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:18:32 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-ab981462-2fdb-40f9-a3c6-3bcef2333428 tempest-VolumesListTestJSON-1428813371 None] Lock "cinder-quobyte-0007e448-0349-43a6-857e-8472153f3c73" released by "delete_volume" :: held 0.985s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:18:32 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-ab981462-2fdb-40f9-a3c6-3bcef2333428 tempest-VolumesListTestJSON-1428813371 None] Created reservations ['042018dd-ecb6-4a80-9189-e8dbb286ff46', '27e84b1a-41c7-4a7d-8610-df43f0efe385', '979980ea-4ebd-479f-87ef-c8bf2390f1f6', '449156cf-ea1a-4dec-9bdc-32efe55ea015'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:18:32 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-ab981462-2fdb-40f9-a3c6-3bcef2333428 tempest-VolumesListTestJSON-1428813371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:18:32 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-ab981462-2fdb-40f9-a3c6-3bcef2333428 tempest-VolumesListTestJSON-1428813371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:18:32 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-ab981462-2fdb-40f9-a3c6-3bcef2333428 tempest-VolumesListTestJSON-1428813371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:18:32 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-ab981462-2fdb-40f9-a3c6-3bcef2333428 tempest-VolumesListTestJSON-1428813371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:18:32 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-ab981462-2fdb-40f9-a3c6-3bcef2333428 tempest-VolumesListTestJSON-1428813371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:18:32 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ab981462-2fdb-40f9-a3c6-3bcef2333428 tempest-VolumesListTestJSON-1428813371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:18:32 devstack sudo[90145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:18:32 devstack sudo[90145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:18:32 devstack sudo[90143]: pam_unix(sudo:session): session closed for user root
Apr 10 13:18:32 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-a886e09a-b966-4cdb-a024-da895523f43c tempest-SnapshotDependencyTests-448443045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b240e5ee-0d93-42dc-904d-8b810ee9b44c.0c5fe572-9e6f-4a46-9528-b24037cfa22b" returned: 0 in 0.422s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:18:32 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-a886e09a-b966-4cdb-a024-da895523f43c tempest-SnapshotDependencyTests-448443045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b240e5ee-0d93-42dc-904d-8b810ee9b44c.info {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:18:32 devstack sudo[90149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b240e5ee-0d93-42dc-904d-8b810ee9b44c.info
Apr 10 13:18:32 devstack sudo[90149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:18:32 devstack sudo[90145]: pam_unix(sudo:session): session closed for user root
Apr 10 13:18:32 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ab981462-2fdb-40f9-a3c6-3bcef2333428 tempest-VolumesListTestJSON-1428813371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.403s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:18:32 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-ab981462-2fdb-40f9-a3c6-3bcef2333428 tempest-VolumesListTestJSON-1428813371 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:18:32 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-ab981462-2fdb-40f9-a3c6-3bcef2333428 tempest-VolumesListTestJSON-1428813371 None] Deleted volume successfully.
Apr 10 13:18:32 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-ab981462-2fdb-40f9-a3c6-3bcef2333428 tempest-VolumesListTestJSON-1428813371 None] Lock "cinder-0007e448-0349-43a6-857e-8472153f3c73-delete_volume" released by "delete_volume" :: held 1.523s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:18:32 devstack sudo[90149]: pam_unix(sudo:session): session closed for user root
Apr 10 13:18:32 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-a886e09a-b966-4cdb-a024-da895523f43c tempest-SnapshotDependencyTests-448443045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b240e5ee-0d93-42dc-904d-8b810ee9b44c.info" returned: 0 in 0.425s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:18:32 devstack cinder-volume[83345]: WARNING cinder.volume.drivers.remotefs [None req-a886e09a-b966-4cdb-a024-da895523f43c tempest-SnapshotDependencyTests-448443045 None] /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b240e5ee-0d93-42dc-904d-8b810ee9b44c.info is being set with open permissions: ugo+rw
Apr 10 13:18:32 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-a886e09a-b966-4cdb-a024-da895523f43c tempest-SnapshotDependencyTests-448443045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b240e5ee-0d93-42dc-904d-8b810ee9b44c.info {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:18:32 devstack sudo[90152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b240e5ee-0d93-42dc-904d-8b810ee9b44c.info
Apr 10 13:18:32 devstack sudo[90152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:18:33 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-3fb2475e-a405-4758-8929-218e8fdc8827 tempest-VolumesListTestJSON-1428813371 None] Acquiring lock "cinder-e0c4b316-bccc-4402-a3bb-fcde3546c4d2-delete_volume" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:18:33 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-3fb2475e-a405-4758-8929-218e8fdc8827 tempest-VolumesListTestJSON-1428813371 None] Lock "cinder-e0c4b316-bccc-4402-a3bb-fcde3546c4d2-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:18:33 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-3fb2475e-a405-4758-8929-218e8fdc8827 tempest-VolumesListTestJSON-1428813371 None] Acquiring lock "cinder-quobyte-e0c4b316-bccc-4402-a3bb-fcde3546c4d2" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:18:33 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-3fb2475e-a405-4758-8929-218e8fdc8827 tempest-VolumesListTestJSON-1428813371 None] Lock "cinder-quobyte-e0c4b316-bccc-4402-a3bb-fcde3546c4d2" acquired by "delete_volume" :: waited 0.007s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:18:33 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[b40cd605-053b-4014-85bb-c3adf32149e1]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:18:33 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-3fb2475e-a405-4758-8929-218e8fdc8827 tempest-VolumesListTestJSON-1428813371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e0c4b316-bccc-4402-a3bb-fcde3546c4d2 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:18:33 devstack sudo[90152]: pam_unix(sudo:session): session closed for user root
Apr 10 13:18:33 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-a886e09a-b966-4cdb-a024-da895523f43c tempest-SnapshotDependencyTests-448443045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b240e5ee-0d93-42dc-904d-8b810ee9b44c.info" returned: 0 in 0.449s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:18:33 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-a886e09a-b966-4cdb-a024-da895523f43c tempest-SnapshotDependencyTests-448443045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.804s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:18:33 devstack sudo[90155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e0c4b316-bccc-4402-a3bb-fcde3546c4d2
Apr 10 13:18:33 devstack sudo[90155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:18:33 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-a886e09a-b966-4cdb-a024-da895523f43c tempest-SnapshotDependencyTests-448443045 None] Create snapshot completed successfully
Apr 10 13:18:33 devstack sudo[90155]: pam_unix(sudo:session): session closed for user root
Apr 10 13:18:33 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-3fb2475e-a405-4758-8929-218e8fdc8827 tempest-VolumesListTestJSON-1428813371 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e0c4b316-bccc-4402-a3bb-fcde3546c4d2" returned: 0 in 0.507s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:18:33 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-3fb2475e-a405-4758-8929-218e8fdc8827 tempest-VolumesListTestJSON-1428813371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e0c4b316-bccc-4402-a3bb-fcde3546c4d2 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:18:33 devstack sudo[90160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e0c4b316-bccc-4402-a3bb-fcde3546c4d2
Apr 10 13:18:33 devstack sudo[90160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:18:34 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-63c1e3f0-5578-4cda-8de4-042f01ed2ae9 tempest-SnapshotDependencyTests-448443045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:18:34 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-63c1e3f0-5578-4cda-8de4-042f01ed2ae9 tempest-SnapshotDependencyTests-448443045 None] Flow 'volume_create_manager' (be022a8b-6617-4bca-a14d-9e0822488d58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:18:34 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-63c1e3f0-5578-4cda-8de4-042f01ed2ae9 tempest-SnapshotDependencyTests-448443045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b2b893d-2714-4c39-8526-ba7a01a394c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:18:34 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-63c1e3f0-5578-4cda-8de4-042f01ed2ae9 tempest-SnapshotDependencyTests-448443045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b2b893d-2714-4c39-8526-ba7a01a394c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:18:34Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39804dfd-e79a-457d-8f85-5bbcb2c35cfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11c1bff9fa684a54853e1688ce416ca6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:18:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0c5fe572-9e6f-4a46-9528-b24037cfa22b,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:18:34Z,use_quota=True,user_id='470d61a722824003ad069162d00532fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:18:34 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-63c1e3f0-5578-4cda-8de4-042f01ed2ae9 tempest-SnapshotDependencyTests-448443045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60ecef4e-c0a4-40f1-9a21-c330ad264582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:18:34 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-63c1e3f0-5578-4cda-8de4-042f01ed2ae9 tempest-SnapshotDependencyTests-448443045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60ecef4e-c0a4-40f1-9a21-c330ad264582) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:18:34 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-63c1e3f0-5578-4cda-8de4-042f01ed2ae9 tempest-SnapshotDependencyTests-448443045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7505d4f-7efc-4bcc-b0d5-3fb72c515686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:18:34 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-63c1e3f0-5578-4cda-8de4-042f01ed2ae9 tempest-SnapshotDependencyTests-448443045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7505d4f-7efc-4bcc-b0d5-3fb72c515686) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '39804dfd-e79a-457d-8f85-5bbcb2c35cfa', 'volume_name': 'volume-39804dfd-e79a-457d-8f85-5bbcb2c35cfa', 'volume_size': 1, 'snapshot_id': '0c5fe572-9e6f-4a46-9528-b24037cfa22b'}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:18:34 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-63c1e3f0-5578-4cda-8de4-042f01ed2ae9 tempest-SnapshotDependencyTests-448443045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa420253-0501-4a61-ae96-e2b77ac97309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:18:34 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-63c1e3f0-5578-4cda-8de4-042f01ed2ae9 tempest-SnapshotDependencyTests-448443045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa420253-0501-4a61-ae96-e2b77ac97309) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:18:34 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-63c1e3f0-5578-4cda-8de4-042f01ed2ae9 tempest-SnapshotDependencyTests-448443045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74c816cf-2583-42bc-9c43-e83574256f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:18:34 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-63c1e3f0-5578-4cda-8de4-042f01ed2ae9 tempest-SnapshotDependencyTests-448443045 None] Volume 39804dfd-e79a-457d-8f85-5bbcb2c35cfa: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-39804dfd-e79a-457d-8f85-5bbcb2c35cfa', 'volume_size': 1, 'snapshot_id': '0c5fe572-9e6f-4a46-9528-b24037cfa22b'}
Apr 10 13:18:34 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-63c1e3f0-5578-4cda-8de4-042f01ed2ae9 tempest-SnapshotDependencyTests-448443045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:18:34 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-63c1e3f0-5578-4cda-8de4-042f01ed2ae9 tempest-SnapshotDependencyTests-448443045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:18:34 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-63c1e3f0-5578-4cda-8de4-042f01ed2ae9 tempest-SnapshotDependencyTests-448443045 None] Acquiring lock "cinder-quobyte-0c5fe572-9e6f-4a46-9528-b24037cfa22b-39804dfd-e79a-457d-8f85-5bbcb2c35cfa" by "_create_volume_from_snapshot" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:18:34 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-63c1e3f0-5578-4cda-8de4-042f01ed2ae9 tempest-SnapshotDependencyTests-448443045 None] Lock "cinder-quobyte-0c5fe572-9e6f-4a46-9528-b24037cfa22b-39804dfd-e79a-457d-8f85-5bbcb2c35cfa" acquired by "_create_volume_from_snapshot" :: waited 0.005s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:18:34 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-63c1e3f0-5578-4cda-8de4-042f01ed2ae9 tempest-SnapshotDependencyTests-448443045 None] Creating volume 39804dfd-e79a-457d-8f85-5bbcb2c35cfa from snapshot 0c5fe572-9e6f-4a46-9528-b24037cfa22b {{(pid=83345) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 10 13:18:34 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-63c1e3f0-5578-4cda-8de4-042f01ed2ae9 tempest-SnapshotDependencyTests-448443045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:18:34 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-63c1e3f0-5578-4cda-8de4-042f01ed2ae9 tempest-SnapshotDependencyTests-448443045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:18:34 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-63c1e3f0-5578-4cda-8de4-042f01ed2ae9 tempest-SnapshotDependencyTests-448443045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:18:34 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-63c1e3f0-5578-4cda-8de4-042f01ed2ae9 tempest-SnapshotDependencyTests-448443045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:18:34 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-63c1e3f0-5578-4cda-8de4-042f01ed2ae9 tempest-SnapshotDependencyTests-448443045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:18:34 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-63c1e3f0-5578-4cda-8de4-042f01ed2ae9 tempest-SnapshotDependencyTests-448443045 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:18:34 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-63c1e3f0-5578-4cda-8de4-042f01ed2ae9 tempest-SnapshotDependencyTests-448443045 None] Acquiring lock "cinder-quobyte-39804dfd-e79a-457d-8f85-5bbcb2c35cfa" by "_copy_volume_from_snapshot" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:18:34 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-63c1e3f0-5578-4cda-8de4-042f01ed2ae9 tempest-SnapshotDependencyTests-448443045 None] Lock "cinder-quobyte-39804dfd-e79a-457d-8f85-5bbcb2c35cfa" acquired by "_copy_volume_from_snapshot" :: waited 0.006s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:18:34 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-63c1e3f0-5578-4cda-8de4-042f01ed2ae9 tempest-SnapshotDependencyTests-448443045 None] snapshot: 0c5fe572-9e6f-4a46-9528-b24037cfa22b, volume: 39804dfd-e79a-457d-8f85-5bbcb2c35cfa,  {{(pid=83345) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 10 13:18:34 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-63c1e3f0-5578-4cda-8de4-042f01ed2ae9 tempest-SnapshotDependencyTests-448443045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:18:34 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-63c1e3f0-5578-4cda-8de4-042f01ed2ae9 tempest-SnapshotDependencyTests-448443045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:18:34 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-63c1e3f0-5578-4cda-8de4-042f01ed2ae9 tempest-SnapshotDependencyTests-448443045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:18:34 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-63c1e3f0-5578-4cda-8de4-042f01ed2ae9 tempest-SnapshotDependencyTests-448443045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:18:34 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-63c1e3f0-5578-4cda-8de4-042f01ed2ae9 tempest-SnapshotDependencyTests-448443045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:18:34 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8814b69-5b7d-4b45-b820-0a599af2975a]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:18:34 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-63c1e3f0-5578-4cda-8de4-042f01ed2ae9 tempest-SnapshotDependencyTests-448443045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b240e5ee-0d93-42dc-904d-8b810ee9b44c.0c5fe572-9e6f-4a46-9528-b24037cfa22b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:18:34 devstack sudo[90162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b240e5ee-0d93-42dc-904d-8b810ee9b44c.0c5fe572-9e6f-4a46-9528-b24037cfa22b
Apr 10 13:18:34 devstack sudo[90162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:18:34 devstack sudo[90160]: pam_unix(sudo:session): session closed for user root
Apr 10 13:18:34 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-3fb2475e-a405-4758-8929-218e8fdc8827 tempest-VolumesListTestJSON-1428813371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e0c4b316-bccc-4402-a3bb-fcde3546c4d2" returned: 0 in 0.438s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:18:34 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-3fb2475e-a405-4758-8929-218e8fdc8827 tempest-VolumesListTestJSON-1428813371 None] Lock "cinder-quobyte-e0c4b316-bccc-4402-a3bb-fcde3546c4d2" released by "delete_volume" :: held 0.975s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:18:34 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-3fb2475e-a405-4758-8929-218e8fdc8827 tempest-VolumesListTestJSON-1428813371 None] Created reservations ['3b3fe7f7-eaed-431e-9fc9-325548efef69', 'ac46a512-afec-4779-9952-af6ad7be75a1', 'd5bbd8b7-887e-48af-8373-f299f16cacda', 'd9dbeee7-4b6d-42af-b920-d84e8ba60e99'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:18:34 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-3fb2475e-a405-4758-8929-218e8fdc8827 tempest-VolumesListTestJSON-1428813371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:18:34 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-3fb2475e-a405-4758-8929-218e8fdc8827 tempest-VolumesListTestJSON-1428813371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:18:34 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-3fb2475e-a405-4758-8929-218e8fdc8827 tempest-VolumesListTestJSON-1428813371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:18:34 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-3fb2475e-a405-4758-8929-218e8fdc8827 tempest-VolumesListTestJSON-1428813371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:18:34 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-3fb2475e-a405-4758-8929-218e8fdc8827 tempest-VolumesListTestJSON-1428813371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:18:34 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-3fb2475e-a405-4758-8929-218e8fdc8827 tempest-VolumesListTestJSON-1428813371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:18:34 devstack sudo[90165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:18:34 devstack sudo[90165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:18:34 devstack sudo[90162]: pam_unix(sudo:session): session closed for user root
Apr 10 13:18:34 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-63c1e3f0-5578-4cda-8de4-042f01ed2ae9 tempest-SnapshotDependencyTests-448443045 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b240e5ee-0d93-42dc-904d-8b810ee9b44c.0c5fe572-9e6f-4a46-9528-b24037cfa22b" returned: 0 in 0.517s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:18:34 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-63c1e3f0-5578-4cda-8de4-042f01ed2ae9 tempest-SnapshotDependencyTests-448443045 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b240e5ee-0d93-42dc-904d-8b810ee9b44c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 13:18:34 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-63c1e3f0-5578-4cda-8de4-042f01ed2ae9 tempest-SnapshotDependencyTests-448443045 None] will copy from snapshot at /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b240e5ee-0d93-42dc-904d-8b810ee9b44c {{(pid=83345) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 10 13:18:34 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-63c1e3f0-5578-4cda-8de4-042f01ed2ae9 tempest-SnapshotDependencyTests-448443045 None] Creating direct copy from snapshot {{(pid=83345) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 10 13:18:34 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6a708bb-77fb-4226-b663-4063047d1e77]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:18:34 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-63c1e3f0-5578-4cda-8de4-042f01ed2ae9 tempest-SnapshotDependencyTests-448443045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b240e5ee-0d93-42dc-904d-8b810ee9b44c {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:18:34 devstack sudo[90170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b240e5ee-0d93-42dc-904d-8b810ee9b44c
Apr 10 13:18:34 devstack sudo[90170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:18:34 devstack sudo[90165]: pam_unix(sudo:session): session closed for user root
Apr 10 13:18:34 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-3fb2475e-a405-4758-8929-218e8fdc8827 tempest-VolumesListTestJSON-1428813371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.452s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:18:34 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-3fb2475e-a405-4758-8929-218e8fdc8827 tempest-VolumesListTestJSON-1428813371 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:18:34 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-3fb2475e-a405-4758-8929-218e8fdc8827 tempest-VolumesListTestJSON-1428813371 None] Deleted volume successfully.
Apr 10 13:18:34 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-3fb2475e-a405-4758-8929-218e8fdc8827 tempest-VolumesListTestJSON-1428813371 None] Lock "cinder-e0c4b316-bccc-4402-a3bb-fcde3546c4d2-delete_volume" released by "delete_volume" :: held 1.566s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:18:35 devstack sudo[90170]: pam_unix(sudo:session): session closed for user root
Apr 10 13:18:35 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-63c1e3f0-5578-4cda-8de4-042f01ed2ae9 tempest-SnapshotDependencyTests-448443045 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b240e5ee-0d93-42dc-904d-8b810ee9b44c" returned: 0 in 0.546s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:18:35 devstack cinder-volume[83345]: DEBUG cinder.utils [None req-63c1e3f0-5578-4cda-8de4-042f01ed2ae9 tempest-SnapshotDependencyTests-448443045 None] Path /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-39804dfd-e79a-457d-8f85-5bbcb2c35cfa not found in is_blk_device check {{(pid=83345) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 10 13:18:35 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-63c1e3f0-5578-4cda-8de4-042f01ed2ae9 tempest-SnapshotDependencyTests-448443045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b240e5ee-0d93-42dc-904d-8b810ee9b44c /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-39804dfd-e79a-457d-8f85-5bbcb2c35cfa {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:18:35 devstack sudo[90176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b240e5ee-0d93-42dc-904d-8b810ee9b44c /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-39804dfd-e79a-457d-8f85-5bbcb2c35cfa
Apr 10 13:18:35 devstack sudo[90176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:18:37 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-63b93828-877d-4add-bed0-42b33aa4be91 tempest-VolumesSnapshotNegativeTestJSON-1762866315 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:18:37 devstack sudo[90176]: pam_unix(sudo:session): session closed for user root
Apr 10 13:18:37 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-63b93828-877d-4add-bed0-42b33aa4be91 tempest-VolumesSnapshotNegativeTestJSON-1762866315 None] Flow 'volume_create_manager' (ce72c730-5c1c-4a15-8319-bb077c8ea3b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:18:37 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-63b93828-877d-4add-bed0-42b33aa4be91 tempest-VolumesSnapshotNegativeTestJSON-1762866315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54256882-cd54-4a1c-8513-06987f2d7628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:18:37 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-63c1e3f0-5578-4cda-8de4-042f01ed2ae9 tempest-SnapshotDependencyTests-448443045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b240e5ee-0d93-42dc-904d-8b810ee9b44c /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-39804dfd-e79a-457d-8f85-5bbcb2c35cfa" returned: 0 in 2.026s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:18:37 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[e374442d-409f-4296-b158-f8c996fcf382]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:18:37 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-63c1e3f0-5578-4cda-8de4-042f01ed2ae9 tempest-SnapshotDependencyTests-448443045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b240e5ee-0d93-42dc-904d-8b810ee9b44c {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:18:37 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-63b93828-877d-4add-bed0-42b33aa4be91 tempest-VolumesSnapshotNegativeTestJSON-1762866315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54256882-cd54-4a1c-8513-06987f2d7628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:18:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-827710669',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afbaf255-53cb-4d06-9d1f-f5dbc2fb7831,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d320808d47bf475bb8e102f9eb328654',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:18:37Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:18:37Z,use_quota=True,user_id='3e356d97be0d41dabc82a76147088b38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:18:37 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-63b93828-877d-4add-bed0-42b33aa4be91 tempest-VolumesSnapshotNegativeTestJSON-1762866315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f1f3096-f773-4335-bf68-490c41debfa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:18:37 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-63b93828-877d-4add-bed0-42b33aa4be91 tempest-VolumesSnapshotNegativeTestJSON-1762866315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f1f3096-f773-4335-bf68-490c41debfa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:18:37 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-63b93828-877d-4add-bed0-42b33aa4be91 tempest-VolumesSnapshotNegativeTestJSON-1762866315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71cb53c2-a9b6-45e1-9e37-d2f5543d8f30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:18:37 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-63b93828-877d-4add-bed0-42b33aa4be91 tempest-VolumesSnapshotNegativeTestJSON-1762866315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71cb53c2-a9b6-45e1-9e37-d2f5543d8f30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afbaf255-53cb-4d06-9d1f-f5dbc2fb7831', 'volume_name': 'volume-afbaf255-53cb-4d06-9d1f-f5dbc2fb7831', 'volume_size': 2}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:18:37 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-63b93828-877d-4add-bed0-42b33aa4be91 tempest-VolumesSnapshotNegativeTestJSON-1762866315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ade530d6-22cb-4e04-9bc0-f33fc1c01a94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:18:37 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-63b93828-877d-4add-bed0-42b33aa4be91 tempest-VolumesSnapshotNegativeTestJSON-1762866315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ade530d6-22cb-4e04-9bc0-f33fc1c01a94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:18:37 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-63b93828-877d-4add-bed0-42b33aa4be91 tempest-VolumesSnapshotNegativeTestJSON-1762866315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffd61425-0e4e-4412-92b7-855d60c6298f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:18:37 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-63b93828-877d-4add-bed0-42b33aa4be91 tempest-VolumesSnapshotNegativeTestJSON-1762866315 None] Volume afbaf255-53cb-4d06-9d1f-f5dbc2fb7831: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afbaf255-53cb-4d06-9d1f-f5dbc2fb7831', 'volume_size': 2}
Apr 10 13:18:37 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-63b93828-877d-4add-bed0-42b33aa4be91 tempest-VolumesSnapshotNegativeTestJSON-1762866315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:18:37 devstack sudo[90188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b240e5ee-0d93-42dc-904d-8b810ee9b44c
Apr 10 13:18:37 devstack sudo[90188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:18:37 devstack sudo[90188]: pam_unix(sudo:session): session closed for user root
Apr 10 13:18:37 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-63c1e3f0-5578-4cda-8de4-042f01ed2ae9 tempest-SnapshotDependencyTests-448443045 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b240e5ee-0d93-42dc-904d-8b810ee9b44c" returned: 0 in 0.578s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:18:37 devstack cinder-volume[83345]: DEBUG cinder.image.image_utils [None req-63c1e3f0-5578-4cda-8de4-042f01ed2ae9 tempest-SnapshotDependencyTests-448443045 None] Image conversion details: src /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b240e5ee-0d93-42dc-904d-8b810ee9b44c, size 1024.00 MB, duration 2.03 sec, destination /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-39804dfd-e79a-457d-8f85-5bbcb2c35cfa {{(pid=83345) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 10 13:18:37 devstack cinder-volume[83345]: INFO cinder.image.image_utils [None req-63c1e3f0-5578-4cda-8de4-042f01ed2ae9 tempest-SnapshotDependencyTests-448443045 None] Converted 1024.00 MB image at 505.28 MB/s
Apr 10 13:18:37 devstack cinder-volume[83345]: WARNING cinder.volume.drivers.remotefs [None req-63c1e3f0-5578-4cda-8de4-042f01ed2ae9 tempest-SnapshotDependencyTests-448443045 None] /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-39804dfd-e79a-457d-8f85-5bbcb2c35cfa is being set with open permissions: ugo+rw
Apr 10 13:18:37 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-63c1e3f0-5578-4cda-8de4-042f01ed2ae9 tempest-SnapshotDependencyTests-448443045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-39804dfd-e79a-457d-8f85-5bbcb2c35cfa {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:18:37 devstack sudo[90193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-39804dfd-e79a-457d-8f85-5bbcb2c35cfa
Apr 10 13:18:37 devstack sudo[90193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:18:38 devstack sudo[90193]: pam_unix(sudo:session): session closed for user root
Apr 10 13:18:38 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-63c1e3f0-5578-4cda-8de4-042f01ed2ae9 tempest-SnapshotDependencyTests-448443045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-39804dfd-e79a-457d-8f85-5bbcb2c35cfa" returned: 0 in 0.415s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:18:38 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-63c1e3f0-5578-4cda-8de4-042f01ed2ae9 tempest-SnapshotDependencyTests-448443045 None] Lock "cinder-quobyte-39804dfd-e79a-457d-8f85-5bbcb2c35cfa" released by "_copy_volume_from_snapshot" :: held 4.135s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:18:38 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-63c1e3f0-5578-4cda-8de4-042f01ed2ae9 tempest-SnapshotDependencyTests-448443045 None] Lock "cinder-quobyte-0c5fe572-9e6f-4a46-9528-b24037cfa22b-39804dfd-e79a-457d-8f85-5bbcb2c35cfa" released by "_create_volume_from_snapshot" :: held 4.151s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:18:38 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-63c1e3f0-5578-4cda-8de4-042f01ed2ae9 tempest-SnapshotDependencyTests-448443045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.157s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:18:38 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-63b93828-877d-4add-bed0-42b33aa4be91 tempest-VolumesSnapshotNegativeTestJSON-1762866315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.969s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:18:38 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-63b93828-877d-4add-bed0-42b33aa4be91 tempest-VolumesSnapshotNegativeTestJSON-1762866315 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f252bf08b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:18:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-827710669',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afbaf255-53cb-4d06-9d1f-f5dbc2fb7831,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d320808d47bf475bb8e102f9eb328654',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:18:37Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:18:37Z,use_quota=True,user_id='3e356d97be0d41dabc82a76147088b38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)}" {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 13:18:38 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-63b93828-877d-4add-bed0-42b33aa4be91 tempest-VolumesSnapshotNegativeTestJSON-1762866315 None] Creating volume afbaf255-53cb-4d06-9d1f-f5dbc2fb7831 {{(pid=83345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 13:18:38 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-63b93828-877d-4add-bed0-42b33aa4be91 tempest-VolumesSnapshotNegativeTestJSON-1762866315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:18:38 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-63b93828-877d-4add-bed0-42b33aa4be91 tempest-VolumesSnapshotNegativeTestJSON-1762866315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:18:38 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-63b93828-877d-4add-bed0-42b33aa4be91 tempest-VolumesSnapshotNegativeTestJSON-1762866315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:18:38 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-63b93828-877d-4add-bed0-42b33aa4be91 tempest-VolumesSnapshotNegativeTestJSON-1762866315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:18:38 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-63b93828-877d-4add-bed0-42b33aa4be91 tempest-VolumesSnapshotNegativeTestJSON-1762866315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:18:38 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-63b93828-877d-4add-bed0-42b33aa4be91 tempest-VolumesSnapshotNegativeTestJSON-1762866315 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:18:38 devstack cinder-volume[83345]: INFO cinder.volume.drivers.remotefs [None req-63b93828-877d-4add-bed0-42b33aa4be91 tempest-VolumesSnapshotNegativeTestJSON-1762866315 None] casted to osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331
Apr 10 13:18:38 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-63b93828-877d-4add-bed0-42b33aa4be91 tempest-VolumesSnapshotNegativeTestJSON-1762866315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-afbaf255-53cb-4d06-9d1f-f5dbc2fb7831 2147483648 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:18:38 devstack sudo[90196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-afbaf255-53cb-4d06-9d1f-f5dbc2fb7831 2147483648
Apr 10 13:18:38 devstack sudo[90196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:18:38 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-63c1e3f0-5578-4cda-8de4-042f01ed2ae9 tempest-SnapshotDependencyTests-448443045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74c816cf-2583-42bc-9c43-e83574256f0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39804dfd-e79a-457d-8f85-5bbcb2c35cfa', 'volume_size': 1, 'snapshot_id': '0c5fe572-9e6f-4a46-9528-b24037cfa22b'}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:18:38 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-63c1e3f0-5578-4cda-8de4-042f01ed2ae9 tempest-SnapshotDependencyTests-448443045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a694ad8-e0a5-4dd8-903b-47d04f7db74c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:18:38 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-63c1e3f0-5578-4cda-8de4-042f01ed2ae9 tempest-SnapshotDependencyTests-448443045 None] Volume volume-39804dfd-e79a-457d-8f85-5bbcb2c35cfa (39804dfd-e79a-457d-8f85-5bbcb2c35cfa): created successfully
Apr 10 13:18:38 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-63c1e3f0-5578-4cda-8de4-042f01ed2ae9 tempest-SnapshotDependencyTests-448443045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a694ad8-e0a5-4dd8-903b-47d04f7db74c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:18:38 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-63c1e3f0-5578-4cda-8de4-042f01ed2ae9 tempest-SnapshotDependencyTests-448443045 None] Flow 'volume_create_manager' (be022a8b-6617-4bca-a14d-9e0822488d58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:18:38 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-63c1e3f0-5578-4cda-8de4-042f01ed2ae9 tempest-SnapshotDependencyTests-448443045 None] Created volume successfully.
Apr 10 13:18:38 devstack sudo[90196]: pam_unix(sudo:session): session closed for user root
Apr 10 13:18:38 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-63b93828-877d-4add-bed0-42b33aa4be91 tempest-VolumesSnapshotNegativeTestJSON-1762866315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-afbaf255-53cb-4d06-9d1f-f5dbc2fb7831 2147483648" returned: 0 in 0.496s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:18:38 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-63b93828-877d-4add-bed0-42b33aa4be91 tempest-VolumesSnapshotNegativeTestJSON-1762866315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-afbaf255-53cb-4d06-9d1f-f5dbc2fb7831 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:18:38 devstack sudo[90201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-afbaf255-53cb-4d06-9d1f-f5dbc2fb7831
Apr 10 13:18:38 devstack sudo[90201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:18:39 devstack sudo[90201]: pam_unix(sudo:session): session closed for user root
Apr 10 13:18:39 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-63b93828-877d-4add-bed0-42b33aa4be91 tempest-VolumesSnapshotNegativeTestJSON-1762866315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-afbaf255-53cb-4d06-9d1f-f5dbc2fb7831" returned: 0 in 0.395s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:18:39 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-63b93828-877d-4add-bed0-42b33aa4be91 tempest-VolumesSnapshotNegativeTestJSON-1762866315 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'} {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 13:18:39 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-63b93828-877d-4add-bed0-42b33aa4be91 tempest-VolumesSnapshotNegativeTestJSON-1762866315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:18:39 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-63b93828-877d-4add-bed0-42b33aa4be91 tempest-VolumesSnapshotNegativeTestJSON-1762866315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffd61425-0e4e-4412-92b7-855d60c6298f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afbaf255-53cb-4d06-9d1f-f5dbc2fb7831', 'volume_size': 2}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:18:39 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-63b93828-877d-4add-bed0-42b33aa4be91 tempest-VolumesSnapshotNegativeTestJSON-1762866315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (623e3ea8-f660-42cd-b999-28be37b0c401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:18:39 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-63b93828-877d-4add-bed0-42b33aa4be91 tempest-VolumesSnapshotNegativeTestJSON-1762866315 None] Volume volume-afbaf255-53cb-4d06-9d1f-f5dbc2fb7831 (afbaf255-53cb-4d06-9d1f-f5dbc2fb7831): created successfully
Apr 10 13:18:39 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-63b93828-877d-4add-bed0-42b33aa4be91 tempest-VolumesSnapshotNegativeTestJSON-1762866315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (623e3ea8-f660-42cd-b999-28be37b0c401) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:18:39 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-63b93828-877d-4add-bed0-42b33aa4be91 tempest-VolumesSnapshotNegativeTestJSON-1762866315 None] Flow 'volume_create_manager' (ce72c730-5c1c-4a15-8319-bb077c8ea3b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:18:39 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-63b93828-877d-4add-bed0-42b33aa4be91 tempest-VolumesSnapshotNegativeTestJSON-1762866315 None] Created volume successfully.
Apr 10 13:18:39 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-b6f1f8da-878f-4bf8-90da-2cd81cc7f63c tempest-SnapshotDependencyTests-448443045 None] Acquiring lock "cinder-0c5fe572-9e6f-4a46-9528-b24037cfa22b-delete_snapshot" by "delete_snapshot" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:18:39 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-b6f1f8da-878f-4bf8-90da-2cd81cc7f63c tempest-SnapshotDependencyTests-448443045 None] Lock "cinder-0c5fe572-9e6f-4a46-9528-b24037cfa22b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:18:39 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-b6f1f8da-878f-4bf8-90da-2cd81cc7f63c tempest-SnapshotDependencyTests-448443045 None] Acquiring lock "cinder-quobyte-b240e5ee-0d93-42dc-904d-8b810ee9b44c" by "delete_snapshot" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:18:39 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-b6f1f8da-878f-4bf8-90da-2cd81cc7f63c tempest-SnapshotDependencyTests-448443045 None] Lock "cinder-quobyte-b240e5ee-0d93-42dc-904d-8b810ee9b44c" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:18:39 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-b6f1f8da-878f-4bf8-90da-2cd81cc7f63c tempest-SnapshotDependencyTests-448443045 None] Acquiring lock "cinder-quobyte-0c5fe572-9e6f-4a46-9528-b24037cfa22b" by "_delete_snapshot" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:18:39 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-b6f1f8da-878f-4bf8-90da-2cd81cc7f63c tempest-SnapshotDependencyTests-448443045 None] Lock "cinder-quobyte-0c5fe572-9e6f-4a46-9528-b24037cfa22b" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:18:39 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-b6f1f8da-878f-4bf8-90da-2cd81cc7f63c tempest-SnapshotDependencyTests-448443045 None] Deleting offline snapshot 0c5fe572-9e6f-4a46-9528-b24037cfa22b of volume b240e5ee-0d93-42dc-904d-8b810ee9b44c {{(pid=83345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 10 13:18:39 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-b6f1f8da-878f-4bf8-90da-2cd81cc7f63c tempest-SnapshotDependencyTests-448443045 None] snapshot_file for this snap is: volume-b240e5ee-0d93-42dc-904d-8b810ee9b44c.0c5fe572-9e6f-4a46-9528-b24037cfa22b {{(pid=83345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 10 13:18:39 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3fc1123-c3fe-4ebd-bbd3-e4d3b0b97bfc]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:18:39 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-b6f1f8da-878f-4bf8-90da-2cd81cc7f63c tempest-SnapshotDependencyTests-448443045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b240e5ee-0d93-42dc-904d-8b810ee9b44c.0c5fe572-9e6f-4a46-9528-b24037cfa22b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:18:39 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-3d2a5343-67d4-41f2-8857-548d018c131e tempest-VolumesSnapshotNegativeTestJSON-1762866315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:18:39 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-3d2a5343-67d4-41f2-8857-548d018c131e tempest-VolumesSnapshotNegativeTestJSON-1762866315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:18:39 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-3d2a5343-67d4-41f2-8857-548d018c131e tempest-VolumesSnapshotNegativeTestJSON-1762866315 None] Creating offline snapshot 309de939-00b4-4db7-8907-73039fa36623 of volume afbaf255-53cb-4d06-9d1f-f5dbc2fb7831 {{(pid=83345) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 10 13:18:39 devstack sudo[90204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b240e5ee-0d93-42dc-904d-8b810ee9b44c.0c5fe572-9e6f-4a46-9528-b24037cfa22b
Apr 10 13:18:39 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[a244f06c-facf-4743-a0a5-f7a38c649c4a]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:18:39 devstack sudo[90204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:18:39 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-3d2a5343-67d4-41f2-8857-548d018c131e tempest-VolumesSnapshotNegativeTestJSON-1762866315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-afbaf255-53cb-4d06-9d1f-f5dbc2fb7831 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:18:39 devstack sudo[90206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-afbaf255-53cb-4d06-9d1f-f5dbc2fb7831
Apr 10 13:18:39 devstack sudo[90206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:18:39 devstack sudo[90204]: pam_unix(sudo:session): session closed for user root
Apr 10 13:18:39 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-b6f1f8da-878f-4bf8-90da-2cd81cc7f63c tempest-SnapshotDependencyTests-448443045 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b240e5ee-0d93-42dc-904d-8b810ee9b44c.0c5fe572-9e6f-4a46-9528-b24037cfa22b" returned: 0 in 0.499s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:18:39 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-b6f1f8da-878f-4bf8-90da-2cd81cc7f63c tempest-SnapshotDependencyTests-448443045 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b240e5ee-0d93-42dc-904d-8b810ee9b44c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 13:18:39 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddbce84a-4858-42ba-af3c-cbfa5ff60530]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:18:39 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-b6f1f8da-878f-4bf8-90da-2cd81cc7f63c tempest-SnapshotDependencyTests-448443045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b240e5ee-0d93-42dc-904d-8b810ee9b44c {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:18:39 devstack sudo[90206]: pam_unix(sudo:session): session closed for user root
Apr 10 13:18:39 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-3d2a5343-67d4-41f2-8857-548d018c131e tempest-VolumesSnapshotNegativeTestJSON-1762866315 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-afbaf255-53cb-4d06-9d1f-f5dbc2fb7831" returned: 0 in 0.466s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:18:39 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-3d2a5343-67d4-41f2-8857-548d018c131e tempest-VolumesSnapshotNegativeTestJSON-1762866315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-afbaf255-53cb-4d06-9d1f-f5dbc2fb7831,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-afbaf255-53cb-4d06-9d1f-f5dbc2fb7831.309de939-00b4-4db7-8907-73039fa36623 2G {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:18:39 devstack sudo[90215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-afbaf255-53cb-4d06-9d1f-f5dbc2fb7831,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-afbaf255-53cb-4d06-9d1f-f5dbc2fb7831.309de939-00b4-4db7-8907-73039fa36623 2G
Apr 10 13:18:39 devstack sudo[90215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:18:39 devstack sudo[90214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b240e5ee-0d93-42dc-904d-8b810ee9b44c
Apr 10 13:18:40 devstack sudo[90214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:18:40 devstack sudo[90215]: pam_unix(sudo:session): session closed for user root
Apr 10 13:18:40 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-3d2a5343-67d4-41f2-8857-548d018c131e tempest-VolumesSnapshotNegativeTestJSON-1762866315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-afbaf255-53cb-4d06-9d1f-f5dbc2fb7831,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-afbaf255-53cb-4d06-9d1f-f5dbc2fb7831.309de939-00b4-4db7-8907-73039fa36623 2G" returned: 0 in 0.447s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:18:40 devstack sudo[90214]: pam_unix(sudo:session): session closed for user root
Apr 10 13:18:40 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-3d2a5343-67d4-41f2-8857-548d018c131e tempest-VolumesSnapshotNegativeTestJSON-1762866315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-afbaf255-53cb-4d06-9d1f-f5dbc2fb7831 -F qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-afbaf255-53cb-4d06-9d1f-f5dbc2fb7831.309de939-00b4-4db7-8907-73039fa36623 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:18:40 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-b6f1f8da-878f-4bf8-90da-2cd81cc7f63c tempest-SnapshotDependencyTests-448443045 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b240e5ee-0d93-42dc-904d-8b810ee9b44c" returned: 0 in 0.494s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:18:40 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-b6f1f8da-878f-4bf8-90da-2cd81cc7f63c tempest-SnapshotDependencyTests-448443045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b240e5ee-0d93-42dc-904d-8b810ee9b44c.0c5fe572-9e6f-4a46-9528-b24037cfa22b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:18:40 devstack sudo[90224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-afbaf255-53cb-4d06-9d1f-f5dbc2fb7831 -F qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-afbaf255-53cb-4d06-9d1f-f5dbc2fb7831.309de939-00b4-4db7-8907-73039fa36623
Apr 10 13:18:40 devstack sudo[90224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:18:40 devstack sudo[90225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b240e5ee-0d93-42dc-904d-8b810ee9b44c.0c5fe572-9e6f-4a46-9528-b24037cfa22b
Apr 10 13:18:40 devstack sudo[90225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:18:40 devstack sudo[90224]: pam_unix(sudo:session): session closed for user root
Apr 10 13:18:40 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-3d2a5343-67d4-41f2-8857-548d018c131e tempest-VolumesSnapshotNegativeTestJSON-1762866315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-afbaf255-53cb-4d06-9d1f-f5dbc2fb7831 -F qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-afbaf255-53cb-4d06-9d1f-f5dbc2fb7831.309de939-00b4-4db7-8907-73039fa36623" returned: 0 in 0.427s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:18:40 devstack cinder-volume[83345]: WARNING cinder.volume.drivers.remotefs [None req-3d2a5343-67d4-41f2-8857-548d018c131e tempest-VolumesSnapshotNegativeTestJSON-1762866315 None] /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-afbaf255-53cb-4d06-9d1f-f5dbc2fb7831.309de939-00b4-4db7-8907-73039fa36623 is being set with open permissions: ugo+rw
Apr 10 13:18:40 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-3d2a5343-67d4-41f2-8857-548d018c131e tempest-VolumesSnapshotNegativeTestJSON-1762866315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-afbaf255-53cb-4d06-9d1f-f5dbc2fb7831.309de939-00b4-4db7-8907-73039fa36623 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:18:40 devstack sudo[90234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-afbaf255-53cb-4d06-9d1f-f5dbc2fb7831.309de939-00b4-4db7-8907-73039fa36623
Apr 10 13:18:40 devstack sudo[90234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:18:40 devstack sudo[90225]: pam_unix(sudo:session): session closed for user root
Apr 10 13:18:40 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-b6f1f8da-878f-4bf8-90da-2cd81cc7f63c tempest-SnapshotDependencyTests-448443045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b240e5ee-0d93-42dc-904d-8b810ee9b44c.0c5fe572-9e6f-4a46-9528-b24037cfa22b" returned: 0 in 0.464s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:18:40 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-b6f1f8da-878f-4bf8-90da-2cd81cc7f63c tempest-SnapshotDependencyTests-448443045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b240e5ee-0d93-42dc-904d-8b810ee9b44c.0c5fe572-9e6f-4a46-9528-b24037cfa22b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:18:40 devstack sudo[90236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b240e5ee-0d93-42dc-904d-8b810ee9b44c.0c5fe572-9e6f-4a46-9528-b24037cfa22b
Apr 10 13:18:40 devstack sudo[90236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:18:41 devstack sudo[90234]: pam_unix(sudo:session): session closed for user root
Apr 10 13:18:41 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-3d2a5343-67d4-41f2-8857-548d018c131e tempest-VolumesSnapshotNegativeTestJSON-1762866315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-afbaf255-53cb-4d06-9d1f-f5dbc2fb7831.309de939-00b4-4db7-8907-73039fa36623" returned: 0 in 0.415s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:18:41 devstack sudo[90236]: pam_unix(sudo:session): session closed for user root
Apr 10 13:18:41 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-b6f1f8da-878f-4bf8-90da-2cd81cc7f63c tempest-SnapshotDependencyTests-448443045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b240e5ee-0d93-42dc-904d-8b810ee9b44c.0c5fe572-9e6f-4a46-9528-b24037cfa22b" returned: 0 in 0.388s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:18:41 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-3d2a5343-67d4-41f2-8857-548d018c131e tempest-VolumesSnapshotNegativeTestJSON-1762866315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-afbaf255-53cb-4d06-9d1f-f5dbc2fb7831.info {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:18:41 devstack sudo[90240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-afbaf255-53cb-4d06-9d1f-f5dbc2fb7831.info
Apr 10 13:18:41 devstack sudo[90240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:18:41 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-b6f1f8da-878f-4bf8-90da-2cd81cc7f63c tempest-SnapshotDependencyTests-448443045 None] Lock "cinder-quobyte-0c5fe572-9e6f-4a46-9528-b24037cfa22b" released by "_delete_snapshot" :: held 1.912s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:18:41 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-b6f1f8da-878f-4bf8-90da-2cd81cc7f63c tempest-SnapshotDependencyTests-448443045 None] Lock "cinder-quobyte-b240e5ee-0d93-42dc-904d-8b810ee9b44c" released by "delete_snapshot" :: held 1.925s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:18:41 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-b6f1f8da-878f-4bf8-90da-2cd81cc7f63c tempest-SnapshotDependencyTests-448443045 None] Created reservations ['e3e9dcb8-9ce8-4143-b230-750e4951d58f', '0df55fe8-bb79-4d9b-abaf-72cf7ef80b2a', 'c298d05f-e960-4db7-815c-e963472e7317', '0206459a-62b0-41f3-92ce-a3df2691fd60'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:18:41 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-b6f1f8da-878f-4bf8-90da-2cd81cc7f63c tempest-SnapshotDependencyTests-448443045 None] Delete snapshot completed successfully.
Apr 10 13:18:41 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-b6f1f8da-878f-4bf8-90da-2cd81cc7f63c tempest-SnapshotDependencyTests-448443045 None] Lock "cinder-0c5fe572-9e6f-4a46-9528-b24037cfa22b-delete_snapshot" released by "delete_snapshot" :: held 2.008s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:18:41 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-7792c7bc-5a02-4b1c-af0b-63cdf173bae0 tempest-SnapshotDependencyTests-448443045 None] Acquiring lock "cinder-b240e5ee-0d93-42dc-904d-8b810ee9b44c-delete_volume" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:18:41 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-7792c7bc-5a02-4b1c-af0b-63cdf173bae0 tempest-SnapshotDependencyTests-448443045 None] Lock "cinder-b240e5ee-0d93-42dc-904d-8b810ee9b44c-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:18:41 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-7792c7bc-5a02-4b1c-af0b-63cdf173bae0 tempest-SnapshotDependencyTests-448443045 None] Acquiring lock "cinder-quobyte-b240e5ee-0d93-42dc-904d-8b810ee9b44c" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:18:41 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-7792c7bc-5a02-4b1c-af0b-63cdf173bae0 tempest-SnapshotDependencyTests-448443045 None] Lock "cinder-quobyte-b240e5ee-0d93-42dc-904d-8b810ee9b44c" acquired by "delete_volume" :: waited 0.009s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:18:41 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[7353576a-e30f-4038-add6-cddcfdf52f8d]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:18:41 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-7792c7bc-5a02-4b1c-af0b-63cdf173bae0 tempest-SnapshotDependencyTests-448443045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b240e5ee-0d93-42dc-904d-8b810ee9b44c {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:18:41 devstack sudo[90243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b240e5ee-0d93-42dc-904d-8b810ee9b44c
Apr 10 13:18:41 devstack sudo[90243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:18:41 devstack sudo[90240]: pam_unix(sudo:session): session closed for user root
Apr 10 13:18:41 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-3d2a5343-67d4-41f2-8857-548d018c131e tempest-VolumesSnapshotNegativeTestJSON-1762866315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-afbaf255-53cb-4d06-9d1f-f5dbc2fb7831.info" returned: 0 in 0.438s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:18:41 devstack cinder-volume[83345]: WARNING cinder.volume.drivers.remotefs [None req-3d2a5343-67d4-41f2-8857-548d018c131e tempest-VolumesSnapshotNegativeTestJSON-1762866315 None] /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-afbaf255-53cb-4d06-9d1f-f5dbc2fb7831.info is being set with open permissions: ugo+rw
Apr 10 13:18:41 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-3d2a5343-67d4-41f2-8857-548d018c131e tempest-VolumesSnapshotNegativeTestJSON-1762866315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-afbaf255-53cb-4d06-9d1f-f5dbc2fb7831.info {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:18:41 devstack sudo[90246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-afbaf255-53cb-4d06-9d1f-f5dbc2fb7831.info
Apr 10 13:18:41 devstack sudo[90246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:18:42 devstack sudo[90243]: pam_unix(sudo:session): session closed for user root
Apr 10 13:18:42 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-7792c7bc-5a02-4b1c-af0b-63cdf173bae0 tempest-SnapshotDependencyTests-448443045 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b240e5ee-0d93-42dc-904d-8b810ee9b44c" returned: 0 in 0.474s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:18:42 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-7792c7bc-5a02-4b1c-af0b-63cdf173bae0 tempest-SnapshotDependencyTests-448443045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b240e5ee-0d93-42dc-904d-8b810ee9b44c {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:18:42 devstack sudo[90252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b240e5ee-0d93-42dc-904d-8b810ee9b44c
Apr 10 13:18:42 devstack sudo[90252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:18:42 devstack sudo[90246]: pam_unix(sudo:session): session closed for user root
Apr 10 13:18:42 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-3d2a5343-67d4-41f2-8857-548d018c131e tempest-VolumesSnapshotNegativeTestJSON-1762866315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-afbaf255-53cb-4d06-9d1f-f5dbc2fb7831.info" returned: 0 in 0.391s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:18:42 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-3d2a5343-67d4-41f2-8857-548d018c131e tempest-VolumesSnapshotNegativeTestJSON-1762866315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.640s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:18:42 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-3d2a5343-67d4-41f2-8857-548d018c131e tempest-VolumesSnapshotNegativeTestJSON-1762866315 None] Create snapshot completed successfully
Apr 10 13:18:42 devstack sudo[90252]: pam_unix(sudo:session): session closed for user root
Apr 10 13:18:42 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-7792c7bc-5a02-4b1c-af0b-63cdf173bae0 tempest-SnapshotDependencyTests-448443045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-b240e5ee-0d93-42dc-904d-8b810ee9b44c" returned: 0 in 0.422s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:18:42 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-7792c7bc-5a02-4b1c-af0b-63cdf173bae0 tempest-SnapshotDependencyTests-448443045 None] Lock "cinder-quobyte-b240e5ee-0d93-42dc-904d-8b810ee9b44c" released by "delete_volume" :: held 0.932s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:18:42 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-7792c7bc-5a02-4b1c-af0b-63cdf173bae0 tempest-SnapshotDependencyTests-448443045 None] Created reservations ['45d310b3-6757-441e-a246-179151ef6b36', 'a02dad44-dcd7-44a4-bea1-ba7852dc9e18', 'f5ad98d1-7681-4579-9a59-04ad7d28121b', 'dcf941d8-7973-4a01-9963-00f9e34eed21'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:18:42 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-7792c7bc-5a02-4b1c-af0b-63cdf173bae0 tempest-SnapshotDependencyTests-448443045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:18:42 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-7792c7bc-5a02-4b1c-af0b-63cdf173bae0 tempest-SnapshotDependencyTests-448443045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:18:42 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-7792c7bc-5a02-4b1c-af0b-63cdf173bae0 tempest-SnapshotDependencyTests-448443045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:18:42 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-7792c7bc-5a02-4b1c-af0b-63cdf173bae0 tempest-SnapshotDependencyTests-448443045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:18:42 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-7792c7bc-5a02-4b1c-af0b-63cdf173bae0 tempest-SnapshotDependencyTests-448443045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:18:42 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-7792c7bc-5a02-4b1c-af0b-63cdf173bae0 tempest-SnapshotDependencyTests-448443045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:18:42 devstack sudo[90255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:18:42 devstack sudo[90255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:18:42 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-58f3697f-1299-47ec-b626-e33d17abd82c tempest-SnapshotDependencyTests-448443045 None] Acquiring lock "cinder-39804dfd-e79a-457d-8f85-5bbcb2c35cfa-delete_volume" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:18:42 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-58f3697f-1299-47ec-b626-e33d17abd82c tempest-SnapshotDependencyTests-448443045 None] Lock "cinder-39804dfd-e79a-457d-8f85-5bbcb2c35cfa-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:18:42 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-58f3697f-1299-47ec-b626-e33d17abd82c tempest-SnapshotDependencyTests-448443045 None] Acquiring lock "cinder-quobyte-39804dfd-e79a-457d-8f85-5bbcb2c35cfa" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:18:42 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-4368e8cc-8b67-4d46-8039-0dcbf47b417f tempest-VolumesSnapshotNegativeTestJSON-1762866315 None] Acquiring lock "cinder-309de939-00b4-4db7-8907-73039fa36623-delete_snapshot" by "delete_snapshot" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:18:42 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-58f3697f-1299-47ec-b626-e33d17abd82c tempest-SnapshotDependencyTests-448443045 None] Lock "cinder-quobyte-39804dfd-e79a-457d-8f85-5bbcb2c35cfa" acquired by "delete_volume" :: waited 0.013s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:18:42 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-4368e8cc-8b67-4d46-8039-0dcbf47b417f tempest-VolumesSnapshotNegativeTestJSON-1762866315 None] Lock "cinder-309de939-00b4-4db7-8907-73039fa36623-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:18:42 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-4368e8cc-8b67-4d46-8039-0dcbf47b417f tempest-VolumesSnapshotNegativeTestJSON-1762866315 None] Acquiring lock "cinder-quobyte-afbaf255-53cb-4d06-9d1f-f5dbc2fb7831" by "delete_snapshot" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:18:42 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[aadce672-8c07-496c-9504-2d76253b4370]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:18:42 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-58f3697f-1299-47ec-b626-e33d17abd82c tempest-SnapshotDependencyTests-448443045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-39804dfd-e79a-457d-8f85-5bbcb2c35cfa {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:18:42 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-4368e8cc-8b67-4d46-8039-0dcbf47b417f tempest-VolumesSnapshotNegativeTestJSON-1762866315 None] Lock "cinder-quobyte-afbaf255-53cb-4d06-9d1f-f5dbc2fb7831" acquired by "delete_snapshot" :: waited 0.018s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:18:42 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-4368e8cc-8b67-4d46-8039-0dcbf47b417f tempest-VolumesSnapshotNegativeTestJSON-1762866315 None] Acquiring lock "cinder-quobyte-309de939-00b4-4db7-8907-73039fa36623" by "_delete_snapshot" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:18:42 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-4368e8cc-8b67-4d46-8039-0dcbf47b417f tempest-VolumesSnapshotNegativeTestJSON-1762866315 None] Lock "cinder-quobyte-309de939-00b4-4db7-8907-73039fa36623" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:18:42 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-4368e8cc-8b67-4d46-8039-0dcbf47b417f tempest-VolumesSnapshotNegativeTestJSON-1762866315 None] Deleting offline snapshot 309de939-00b4-4db7-8907-73039fa36623 of volume afbaf255-53cb-4d06-9d1f-f5dbc2fb7831 {{(pid=83345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 10 13:18:42 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-4368e8cc-8b67-4d46-8039-0dcbf47b417f tempest-VolumesSnapshotNegativeTestJSON-1762866315 None] snapshot_file for this snap is: volume-afbaf255-53cb-4d06-9d1f-f5dbc2fb7831.309de939-00b4-4db7-8907-73039fa36623 {{(pid=83345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 10 13:18:42 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd180d65-4507-48e0-a98c-1182b57719cc]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:18:42 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-4368e8cc-8b67-4d46-8039-0dcbf47b417f tempest-VolumesSnapshotNegativeTestJSON-1762866315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-afbaf255-53cb-4d06-9d1f-f5dbc2fb7831.309de939-00b4-4db7-8907-73039fa36623 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:18:42 devstack sudo[90257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-39804dfd-e79a-457d-8f85-5bbcb2c35cfa
Apr 10 13:18:42 devstack sudo[90257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:18:42 devstack sudo[90258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-afbaf255-53cb-4d06-9d1f-f5dbc2fb7831.309de939-00b4-4db7-8907-73039fa36623
Apr 10 13:18:42 devstack sudo[90258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:18:42 devstack sudo[90255]: pam_unix(sudo:session): session closed for user root
Apr 10 13:18:42 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-7792c7bc-5a02-4b1c-af0b-63cdf173bae0 tempest-SnapshotDependencyTests-448443045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.425s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:18:42 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-7792c7bc-5a02-4b1c-af0b-63cdf173bae0 tempest-SnapshotDependencyTests-448443045 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:18:42 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-7792c7bc-5a02-4b1c-af0b-63cdf173bae0 tempest-SnapshotDependencyTests-448443045 None] Deleted volume successfully.
Apr 10 13:18:43 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-7792c7bc-5a02-4b1c-af0b-63cdf173bae0 tempest-SnapshotDependencyTests-448443045 None] Lock "cinder-b240e5ee-0d93-42dc-904d-8b810ee9b44c-delete_volume" released by "delete_volume" :: held 1.492s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:18:43 devstack sudo[90257]: pam_unix(sudo:session): session closed for user root
Apr 10 13:18:43 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-58f3697f-1299-47ec-b626-e33d17abd82c tempest-SnapshotDependencyTests-448443045 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-39804dfd-e79a-457d-8f85-5bbcb2c35cfa" returned: 0 in 0.489s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:18:43 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-58f3697f-1299-47ec-b626-e33d17abd82c tempest-SnapshotDependencyTests-448443045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-39804dfd-e79a-457d-8f85-5bbcb2c35cfa {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:18:43 devstack sudo[90258]: pam_unix(sudo:session): session closed for user root
Apr 10 13:18:43 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-4368e8cc-8b67-4d46-8039-0dcbf47b417f tempest-VolumesSnapshotNegativeTestJSON-1762866315 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-afbaf255-53cb-4d06-9d1f-f5dbc2fb7831.309de939-00b4-4db7-8907-73039fa36623" returned: 0 in 0.464s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:18:43 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-4368e8cc-8b67-4d46-8039-0dcbf47b417f tempest-VolumesSnapshotNegativeTestJSON-1762866315 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-afbaf255-53cb-4d06-9d1f-f5dbc2fb7831(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 13:18:43 devstack sudo[90268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-39804dfd-e79a-457d-8f85-5bbcb2c35cfa
Apr 10 13:18:43 devstack sudo[90268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:18:43 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[af2c28f4-5ec5-49dc-84df-e0bd0f24d553]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:18:43 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-4368e8cc-8b67-4d46-8039-0dcbf47b417f tempest-VolumesSnapshotNegativeTestJSON-1762866315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-afbaf255-53cb-4d06-9d1f-f5dbc2fb7831 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:18:43 devstack sudo[90270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-afbaf255-53cb-4d06-9d1f-f5dbc2fb7831
Apr 10 13:18:43 devstack sudo[90270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:18:43 devstack sudo[90268]: pam_unix(sudo:session): session closed for user root
Apr 10 13:18:43 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-58f3697f-1299-47ec-b626-e33d17abd82c tempest-SnapshotDependencyTests-448443045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-39804dfd-e79a-457d-8f85-5bbcb2c35cfa" returned: 0 in 0.391s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:18:43 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-58f3697f-1299-47ec-b626-e33d17abd82c tempest-SnapshotDependencyTests-448443045 None] Lock "cinder-quobyte-39804dfd-e79a-457d-8f85-5bbcb2c35cfa" released by "delete_volume" :: held 0.901s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:18:43 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-58f3697f-1299-47ec-b626-e33d17abd82c tempest-SnapshotDependencyTests-448443045 None] Created reservations ['e947613c-e6c4-455b-b9b5-880599356972', '93e130b5-b755-4436-b593-7d6ec65b176b', 'b03a699d-5136-4ab1-a18e-f0c2d4d41a0f', '4003227c-17d0-4b19-8434-34f45b3471f8'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:18:43 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-58f3697f-1299-47ec-b626-e33d17abd82c tempest-SnapshotDependencyTests-448443045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:18:43 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-58f3697f-1299-47ec-b626-e33d17abd82c tempest-SnapshotDependencyTests-448443045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:18:43 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-58f3697f-1299-47ec-b626-e33d17abd82c tempest-SnapshotDependencyTests-448443045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:18:43 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-58f3697f-1299-47ec-b626-e33d17abd82c tempest-SnapshotDependencyTests-448443045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:18:43 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-58f3697f-1299-47ec-b626-e33d17abd82c tempest-SnapshotDependencyTests-448443045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:18:43 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-58f3697f-1299-47ec-b626-e33d17abd82c tempest-SnapshotDependencyTests-448443045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:18:43 devstack sudo[90270]: pam_unix(sudo:session): session closed for user root
Apr 10 13:18:43 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-4368e8cc-8b67-4d46-8039-0dcbf47b417f tempest-VolumesSnapshotNegativeTestJSON-1762866315 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-afbaf255-53cb-4d06-9d1f-f5dbc2fb7831" returned: 0 in 0.471s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:18:43 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-4368e8cc-8b67-4d46-8039-0dcbf47b417f tempest-VolumesSnapshotNegativeTestJSON-1762866315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-afbaf255-53cb-4d06-9d1f-f5dbc2fb7831.309de939-00b4-4db7-8907-73039fa36623 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:18:43 devstack sudo[90276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:18:43 devstack sudo[90276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:18:43 devstack sudo[90277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-afbaf255-53cb-4d06-9d1f-f5dbc2fb7831.309de939-00b4-4db7-8907-73039fa36623
Apr 10 13:18:43 devstack sudo[90277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:18:44 devstack sudo[90276]: pam_unix(sudo:session): session closed for user root
Apr 10 13:18:44 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-58f3697f-1299-47ec-b626-e33d17abd82c tempest-SnapshotDependencyTests-448443045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.471s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:18:44 devstack sudo[90277]: pam_unix(sudo:session): session closed for user root
Apr 10 13:18:44 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-58f3697f-1299-47ec-b626-e33d17abd82c tempest-SnapshotDependencyTests-448443045 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:18:44 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-4368e8cc-8b67-4d46-8039-0dcbf47b417f tempest-VolumesSnapshotNegativeTestJSON-1762866315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-afbaf255-53cb-4d06-9d1f-f5dbc2fb7831.309de939-00b4-4db7-8907-73039fa36623" returned: 0 in 0.459s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:18:44 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-4368e8cc-8b67-4d46-8039-0dcbf47b417f tempest-VolumesSnapshotNegativeTestJSON-1762866315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-afbaf255-53cb-4d06-9d1f-f5dbc2fb7831.309de939-00b4-4db7-8907-73039fa36623 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:18:44 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-58f3697f-1299-47ec-b626-e33d17abd82c tempest-SnapshotDependencyTests-448443045 None] Deleted volume successfully.
Apr 10 13:18:44 devstack sudo[90284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-afbaf255-53cb-4d06-9d1f-f5dbc2fb7831.309de939-00b4-4db7-8907-73039fa36623
Apr 10 13:18:44 devstack sudo[90284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:18:44 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-58f3697f-1299-47ec-b626-e33d17abd82c tempest-SnapshotDependencyTests-448443045 None] Lock "cinder-39804dfd-e79a-457d-8f85-5bbcb2c35cfa-delete_volume" released by "delete_volume" :: held 1.537s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:18:44 devstack sudo[90284]: pam_unix(sudo:session): session closed for user root
Apr 10 13:18:44 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-4368e8cc-8b67-4d46-8039-0dcbf47b417f tempest-VolumesSnapshotNegativeTestJSON-1762866315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-afbaf255-53cb-4d06-9d1f-f5dbc2fb7831.309de939-00b4-4db7-8907-73039fa36623" returned: 0 in 0.420s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:18:44 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-4368e8cc-8b67-4d46-8039-0dcbf47b417f tempest-VolumesSnapshotNegativeTestJSON-1762866315 None] Lock "cinder-quobyte-309de939-00b4-4db7-8907-73039fa36623" released by "_delete_snapshot" :: held 1.865s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:18:44 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-4368e8cc-8b67-4d46-8039-0dcbf47b417f tempest-VolumesSnapshotNegativeTestJSON-1762866315 None] Lock "cinder-quobyte-afbaf255-53cb-4d06-9d1f-f5dbc2fb7831" released by "delete_snapshot" :: held 1.878s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:18:44 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-4368e8cc-8b67-4d46-8039-0dcbf47b417f tempest-VolumesSnapshotNegativeTestJSON-1762866315 None] Created reservations ['3592864f-c323-4ff8-9c77-9dfc662e8cd8', '18a2a88c-c926-48db-83e6-5277dfc72499', '2b1fdb0a-c6d0-4899-a262-bfbe122f1f87', '9daefa0a-c5b8-4df8-81a9-c6ddb60ef2ba'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:18:44 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-4368e8cc-8b67-4d46-8039-0dcbf47b417f tempest-VolumesSnapshotNegativeTestJSON-1762866315 None] Delete snapshot completed successfully.
Apr 10 13:18:44 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-4368e8cc-8b67-4d46-8039-0dcbf47b417f tempest-VolumesSnapshotNegativeTestJSON-1762866315 None] Lock "cinder-309de939-00b4-4db7-8907-73039fa36623-delete_snapshot" released by "delete_snapshot" :: held 1.989s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:18:44 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-da2ce7a9-28d8-46d0-a8e8-1d98325368a4 tempest-VolumesSnapshotNegativeTestJSON-1762866315 None] Acquiring lock "cinder-afbaf255-53cb-4d06-9d1f-f5dbc2fb7831-delete_volume" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:18:44 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-da2ce7a9-28d8-46d0-a8e8-1d98325368a4 tempest-VolumesSnapshotNegativeTestJSON-1762866315 None] Lock "cinder-afbaf255-53cb-4d06-9d1f-f5dbc2fb7831-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:18:44 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-da2ce7a9-28d8-46d0-a8e8-1d98325368a4 tempest-VolumesSnapshotNegativeTestJSON-1762866315 None] Acquiring lock "cinder-quobyte-afbaf255-53cb-4d06-9d1f-f5dbc2fb7831" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:18:44 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-da2ce7a9-28d8-46d0-a8e8-1d98325368a4 tempest-VolumesSnapshotNegativeTestJSON-1762866315 None] Lock "cinder-quobyte-afbaf255-53cb-4d06-9d1f-f5dbc2fb7831" acquired by "delete_volume" :: waited 0.012s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:18:44 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[11f6d5ab-5b07-4fd3-8330-f8ff91b6252e]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:18:44 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-da2ce7a9-28d8-46d0-a8e8-1d98325368a4 tempest-VolumesSnapshotNegativeTestJSON-1762866315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-afbaf255-53cb-4d06-9d1f-f5dbc2fb7831 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:18:44 devstack sudo[90287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-afbaf255-53cb-4d06-9d1f-f5dbc2fb7831
Apr 10 13:18:44 devstack sudo[90287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:18:45 devstack sudo[90287]: pam_unix(sudo:session): session closed for user root
Apr 10 13:18:45 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-da2ce7a9-28d8-46d0-a8e8-1d98325368a4 tempest-VolumesSnapshotNegativeTestJSON-1762866315 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-afbaf255-53cb-4d06-9d1f-f5dbc2fb7831" returned: 0 in 0.509s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:18:45 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-da2ce7a9-28d8-46d0-a8e8-1d98325368a4 tempest-VolumesSnapshotNegativeTestJSON-1762866315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-afbaf255-53cb-4d06-9d1f-f5dbc2fb7831 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:18:45 devstack sudo[90293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-afbaf255-53cb-4d06-9d1f-f5dbc2fb7831
Apr 10 13:18:45 devstack sudo[90293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:18:45 devstack sudo[90293]: pam_unix(sudo:session): session closed for user root
Apr 10 13:18:45 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-da2ce7a9-28d8-46d0-a8e8-1d98325368a4 tempest-VolumesSnapshotNegativeTestJSON-1762866315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-afbaf255-53cb-4d06-9d1f-f5dbc2fb7831" returned: 0 in 0.433s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:18:45 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-da2ce7a9-28d8-46d0-a8e8-1d98325368a4 tempest-VolumesSnapshotNegativeTestJSON-1762866315 None] Lock "cinder-quobyte-afbaf255-53cb-4d06-9d1f-f5dbc2fb7831" released by "delete_volume" :: held 0.989s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:18:45 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-da2ce7a9-28d8-46d0-a8e8-1d98325368a4 tempest-VolumesSnapshotNegativeTestJSON-1762866315 None] Created reservations ['33ca20f9-5913-423a-a34f-2432bce0979f', '9391ca49-fc54-4275-8883-8acaa7913501', '0741024a-89d9-4428-a133-4ca372c8c011', 'e03d4f66-d5d4-4a2c-aff5-8f8dba3c5abb'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:18:45 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-da2ce7a9-28d8-46d0-a8e8-1d98325368a4 tempest-VolumesSnapshotNegativeTestJSON-1762866315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:18:45 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-da2ce7a9-28d8-46d0-a8e8-1d98325368a4 tempest-VolumesSnapshotNegativeTestJSON-1762866315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:18:45 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-da2ce7a9-28d8-46d0-a8e8-1d98325368a4 tempest-VolumesSnapshotNegativeTestJSON-1762866315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:18:45 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-da2ce7a9-28d8-46d0-a8e8-1d98325368a4 tempest-VolumesSnapshotNegativeTestJSON-1762866315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:18:45 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-da2ce7a9-28d8-46d0-a8e8-1d98325368a4 tempest-VolumesSnapshotNegativeTestJSON-1762866315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:18:45 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-da2ce7a9-28d8-46d0-a8e8-1d98325368a4 tempest-VolumesSnapshotNegativeTestJSON-1762866315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:18:45 devstack sudo[90296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:18:45 devstack sudo[90296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:18:46 devstack sudo[90296]: pam_unix(sudo:session): session closed for user root
Apr 10 13:18:46 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-da2ce7a9-28d8-46d0-a8e8-1d98325368a4 tempest-VolumesSnapshotNegativeTestJSON-1762866315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.453s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:18:46 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-da2ce7a9-28d8-46d0-a8e8-1d98325368a4 tempest-VolumesSnapshotNegativeTestJSON-1762866315 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:18:46 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-da2ce7a9-28d8-46d0-a8e8-1d98325368a4 tempest-VolumesSnapshotNegativeTestJSON-1762866315 None] Deleted volume successfully.
Apr 10 13:18:46 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-da2ce7a9-28d8-46d0-a8e8-1d98325368a4 tempest-VolumesSnapshotNegativeTestJSON-1762866315 None] Lock "cinder-afbaf255-53cb-4d06-9d1f-f5dbc2fb7831-delete_volume" released by "delete_volume" :: held 1.571s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:18:47 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-5245c2ff-5c80-4df8-850b-c57b8541c681 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:18:47 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-5245c2ff-5c80-4df8-850b-c57b8541c681 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Flow 'volume_create_manager' (5e38d0d4-8fab-448d-8d19-0c2339c47588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:18:47 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-5245c2ff-5c80-4df8-850b-c57b8541c681 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fecf2fd-ea14-4168-bd78-aca2063e0f17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:18:47 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-5245c2ff-5c80-4df8-850b-c57b8541c681 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fecf2fd-ea14-4168-bd78-aca2063e0f17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:18:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-700439642',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e5a92de-c6c0-4eea-8d57-1b249056f2ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2aaaa6e874494fa691635dbf04956148',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:18:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:18:48Z,use_quota=True,user_id='8d4d099d4b644b568b1c13155cc0d6d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:18:47 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-5245c2ff-5c80-4df8-850b-c57b8541c681 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (993bde87-dcfd-4151-813a-ac99c2e35953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:18:47 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-5245c2ff-5c80-4df8-850b-c57b8541c681 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (993bde87-dcfd-4151-813a-ac99c2e35953) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:18:47 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-5245c2ff-5c80-4df8-850b-c57b8541c681 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b31296c-9505-462c-b91f-5be7d8079e50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:18:47 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-5245c2ff-5c80-4df8-850b-c57b8541c681 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b31296c-9505-462c-b91f-5be7d8079e50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e5a92de-c6c0-4eea-8d57-1b249056f2ef', 'volume_name': 'volume-4e5a92de-c6c0-4eea-8d57-1b249056f2ef', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:18:47 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-5245c2ff-5c80-4df8-850b-c57b8541c681 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8507fa51-e066-4b45-b222-00e684dab412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:18:47 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-5245c2ff-5c80-4df8-850b-c57b8541c681 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8507fa51-e066-4b45-b222-00e684dab412) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:18:47 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-5245c2ff-5c80-4df8-850b-c57b8541c681 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e17e035-5410-4f71-80a0-c97309781bfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:18:47 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-5245c2ff-5c80-4df8-850b-c57b8541c681 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Volume 4e5a92de-c6c0-4eea-8d57-1b249056f2ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e5a92de-c6c0-4eea-8d57-1b249056f2ef', 'volume_size': 1}
Apr 10 13:18:47 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-5245c2ff-5c80-4df8-850b-c57b8541c681 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:18:47 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-5245c2ff-5c80-4df8-850b-c57b8541c681 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:18:47 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-5245c2ff-5c80-4df8-850b-c57b8541c681 tempest-CreateVolumesFromSnapshotTest-1194706465 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f252bf08b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:18:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-700439642',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e5a92de-c6c0-4eea-8d57-1b249056f2ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2aaaa6e874494fa691635dbf04956148',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:18:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:18:48Z,use_quota=True,user_id='8d4d099d4b644b568b1c13155cc0d6d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)}" {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 13:18:47 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-5245c2ff-5c80-4df8-850b-c57b8541c681 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Creating volume 4e5a92de-c6c0-4eea-8d57-1b249056f2ef {{(pid=83345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 13:18:47 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-5245c2ff-5c80-4df8-850b-c57b8541c681 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:18:47 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-5245c2ff-5c80-4df8-850b-c57b8541c681 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:18:47 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-5245c2ff-5c80-4df8-850b-c57b8541c681 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:18:47 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-5245c2ff-5c80-4df8-850b-c57b8541c681 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:18:47 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-5245c2ff-5c80-4df8-850b-c57b8541c681 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:18:47 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-5245c2ff-5c80-4df8-850b-c57b8541c681 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:18:47 devstack cinder-volume[83345]: INFO cinder.volume.drivers.remotefs [None req-5245c2ff-5c80-4df8-850b-c57b8541c681 tempest-CreateVolumesFromSnapshotTest-1194706465 None] casted to osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331
Apr 10 13:18:47 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-5245c2ff-5c80-4df8-850b-c57b8541c681 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4e5a92de-c6c0-4eea-8d57-1b249056f2ef 1073741824 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:18:47 devstack sudo[90302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4e5a92de-c6c0-4eea-8d57-1b249056f2ef 1073741824
Apr 10 13:18:47 devstack sudo[90302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:18:48 devstack sudo[90302]: pam_unix(sudo:session): session closed for user root
Apr 10 13:18:48 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-5245c2ff-5c80-4df8-850b-c57b8541c681 tempest-CreateVolumesFromSnapshotTest-1194706465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4e5a92de-c6c0-4eea-8d57-1b249056f2ef 1073741824" returned: 0 in 0.494s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:18:48 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-5245c2ff-5c80-4df8-850b-c57b8541c681 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4e5a92de-c6c0-4eea-8d57-1b249056f2ef {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:18:48 devstack sudo[90308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4e5a92de-c6c0-4eea-8d57-1b249056f2ef
Apr 10 13:18:48 devstack sudo[90308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:18:48 devstack sudo[90308]: pam_unix(sudo:session): session closed for user root
Apr 10 13:18:48 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-5245c2ff-5c80-4df8-850b-c57b8541c681 tempest-CreateVolumesFromSnapshotTest-1194706465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4e5a92de-c6c0-4eea-8d57-1b249056f2ef" returned: 0 in 0.425s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:18:48 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-5245c2ff-5c80-4df8-850b-c57b8541c681 tempest-CreateVolumesFromSnapshotTest-1194706465 None] <== create_volume: return (947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'} {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 13:18:48 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-5245c2ff-5c80-4df8-850b-c57b8541c681 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.951s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:18:48 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-5245c2ff-5c80-4df8-850b-c57b8541c681 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e17e035-5410-4f71-80a0-c97309781bfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e5a92de-c6c0-4eea-8d57-1b249056f2ef', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:18:48 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-5245c2ff-5c80-4df8-850b-c57b8541c681 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eed99c64-08e4-4c1b-bf32-805130214c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:18:48 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-5245c2ff-5c80-4df8-850b-c57b8541c681 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Volume volume-4e5a92de-c6c0-4eea-8d57-1b249056f2ef (4e5a92de-c6c0-4eea-8d57-1b249056f2ef): created successfully
Apr 10 13:18:48 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-5245c2ff-5c80-4df8-850b-c57b8541c681 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eed99c64-08e4-4c1b-bf32-805130214c94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:18:48 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-5245c2ff-5c80-4df8-850b-c57b8541c681 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Flow 'volume_create_manager' (5e38d0d4-8fab-448d-8d19-0c2339c47588) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:18:48 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-5245c2ff-5c80-4df8-850b-c57b8541c681 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Created volume successfully.
Apr 10 13:18:50 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-02717e70-bc57-4c16-9be8-1725351f6bf8 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:18:50 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-02717e70-bc57-4c16-9be8-1725351f6bf8 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:18:50 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-02717e70-bc57-4c16-9be8-1725351f6bf8 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Creating offline snapshot bc6a2d0e-50e0-4614-9bd2-2ce1c32cb6d2 of volume 4e5a92de-c6c0-4eea-8d57-1b249056f2ef {{(pid=83345) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 10 13:18:50 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[e162a465-8fca-4780-b7af-46bf364f91d8]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:18:50 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-02717e70-bc57-4c16-9be8-1725351f6bf8 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4e5a92de-c6c0-4eea-8d57-1b249056f2ef {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:18:50 devstack sudo[90312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4e5a92de-c6c0-4eea-8d57-1b249056f2ef
Apr 10 13:18:50 devstack sudo[90312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:18:50 devstack sudo[90312]: pam_unix(sudo:session): session closed for user root
Apr 10 13:18:50 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-02717e70-bc57-4c16-9be8-1725351f6bf8 tempest-CreateVolumesFromSnapshotTest-1194706465 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4e5a92de-c6c0-4eea-8d57-1b249056f2ef" returned: 0 in 0.518s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:18:50 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-02717e70-bc57-4c16-9be8-1725351f6bf8 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4e5a92de-c6c0-4eea-8d57-1b249056f2ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4e5a92de-c6c0-4eea-8d57-1b249056f2ef.bc6a2d0e-50e0-4614-9bd2-2ce1c32cb6d2 1G {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:18:50 devstack sudo[90317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4e5a92de-c6c0-4eea-8d57-1b249056f2ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4e5a92de-c6c0-4eea-8d57-1b249056f2ef.bc6a2d0e-50e0-4614-9bd2-2ce1c32cb6d2 1G
Apr 10 13:18:50 devstack sudo[90317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:18:51 devstack sudo[90317]: pam_unix(sudo:session): session closed for user root
Apr 10 13:18:51 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-02717e70-bc57-4c16-9be8-1725351f6bf8 tempest-CreateVolumesFromSnapshotTest-1194706465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4e5a92de-c6c0-4eea-8d57-1b249056f2ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4e5a92de-c6c0-4eea-8d57-1b249056f2ef.bc6a2d0e-50e0-4614-9bd2-2ce1c32cb6d2 1G" returned: 0 in 0.457s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:18:51 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-02717e70-bc57-4c16-9be8-1725351f6bf8 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e5a92de-c6c0-4eea-8d57-1b249056f2ef -F qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4e5a92de-c6c0-4eea-8d57-1b249056f2ef.bc6a2d0e-50e0-4614-9bd2-2ce1c32cb6d2 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:18:51 devstack sudo[90322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e5a92de-c6c0-4eea-8d57-1b249056f2ef -F qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4e5a92de-c6c0-4eea-8d57-1b249056f2ef.bc6a2d0e-50e0-4614-9bd2-2ce1c32cb6d2
Apr 10 13:18:51 devstack sudo[90322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:18:51 devstack sudo[90322]: pam_unix(sudo:session): session closed for user root
Apr 10 13:18:51 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-02717e70-bc57-4c16-9be8-1725351f6bf8 tempest-CreateVolumesFromSnapshotTest-1194706465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e5a92de-c6c0-4eea-8d57-1b249056f2ef -F qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4e5a92de-c6c0-4eea-8d57-1b249056f2ef.bc6a2d0e-50e0-4614-9bd2-2ce1c32cb6d2" returned: 0 in 0.411s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:18:51 devstack cinder-volume[83345]: WARNING cinder.volume.drivers.remotefs [None req-02717e70-bc57-4c16-9be8-1725351f6bf8 tempest-CreateVolumesFromSnapshotTest-1194706465 None] /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4e5a92de-c6c0-4eea-8d57-1b249056f2ef.bc6a2d0e-50e0-4614-9bd2-2ce1c32cb6d2 is being set with open permissions: ugo+rw
Apr 10 13:18:51 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-02717e70-bc57-4c16-9be8-1725351f6bf8 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4e5a92de-c6c0-4eea-8d57-1b249056f2ef.bc6a2d0e-50e0-4614-9bd2-2ce1c32cb6d2 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:18:51 devstack sudo[90327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4e5a92de-c6c0-4eea-8d57-1b249056f2ef.bc6a2d0e-50e0-4614-9bd2-2ce1c32cb6d2
Apr 10 13:18:51 devstack sudo[90327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:18:51 devstack sudo[90327]: pam_unix(sudo:session): session closed for user root
Apr 10 13:18:51 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-02717e70-bc57-4c16-9be8-1725351f6bf8 tempest-CreateVolumesFromSnapshotTest-1194706465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4e5a92de-c6c0-4eea-8d57-1b249056f2ef.bc6a2d0e-50e0-4614-9bd2-2ce1c32cb6d2" returned: 0 in 0.396s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:18:51 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-02717e70-bc57-4c16-9be8-1725351f6bf8 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4e5a92de-c6c0-4eea-8d57-1b249056f2ef.info {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:18:51 devstack sudo[90331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4e5a92de-c6c0-4eea-8d57-1b249056f2ef.info
Apr 10 13:18:51 devstack sudo[90331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:18:52 devstack sudo[90331]: pam_unix(sudo:session): session closed for user root
Apr 10 13:18:52 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-02717e70-bc57-4c16-9be8-1725351f6bf8 tempest-CreateVolumesFromSnapshotTest-1194706465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4e5a92de-c6c0-4eea-8d57-1b249056f2ef.info" returned: 0 in 0.400s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:18:52 devstack cinder-volume[83345]: WARNING cinder.volume.drivers.remotefs [None req-02717e70-bc57-4c16-9be8-1725351f6bf8 tempest-CreateVolumesFromSnapshotTest-1194706465 None] /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4e5a92de-c6c0-4eea-8d57-1b249056f2ef.info is being set with open permissions: ugo+rw
Apr 10 13:18:52 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-02717e70-bc57-4c16-9be8-1725351f6bf8 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4e5a92de-c6c0-4eea-8d57-1b249056f2ef.info {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:18:52 devstack sudo[90334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4e5a92de-c6c0-4eea-8d57-1b249056f2ef.info
Apr 10 13:18:52 devstack sudo[90334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:18:52 devstack sudo[90334]: pam_unix(sudo:session): session closed for user root
Apr 10 13:18:52 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-02717e70-bc57-4c16-9be8-1725351f6bf8 tempest-CreateVolumesFromSnapshotTest-1194706465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4e5a92de-c6c0-4eea-8d57-1b249056f2ef.info" returned: 0 in 0.391s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:18:52 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-02717e70-bc57-4c16-9be8-1725351f6bf8 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.627s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:18:52 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-02717e70-bc57-4c16-9be8-1725351f6bf8 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Create snapshot completed successfully
Apr 10 13:18:53 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfce8914-70f0-468a-a61d-b6bbca6aa647 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:18:53 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-cfce8914-70f0-468a-a61d-b6bbca6aa647 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Flow 'volume_create_manager' (03fac0dc-0d0b-4872-baa8-e7d8ef6d6803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:18:53 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-cfce8914-70f0-468a-a61d-b6bbca6aa647 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f64f0067-22da-490e-a297-4cdaf2828bce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:18:53 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-cfce8914-70f0-468a-a61d-b6bbca6aa647 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f64f0067-22da-490e-a297-4cdaf2828bce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:18:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-692746457',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01ff1a7a-36c8-4855-9a67-40b773cf2449,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2aaaa6e874494fa691635dbf04956148',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:18:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:18:53Z,use_quota=True,user_id='8d4d099d4b644b568b1c13155cc0d6d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:18:53 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-cfce8914-70f0-468a-a61d-b6bbca6aa647 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55dccf8d-0dcd-433e-a53f-cfd68922b7a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:18:53 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-cfce8914-70f0-468a-a61d-b6bbca6aa647 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55dccf8d-0dcd-433e-a53f-cfd68922b7a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:18:53 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-cfce8914-70f0-468a-a61d-b6bbca6aa647 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd312d9c-06ee-4b21-8690-a29677748854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:18:53 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-cfce8914-70f0-468a-a61d-b6bbca6aa647 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd312d9c-06ee-4b21-8690-a29677748854) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01ff1a7a-36c8-4855-9a67-40b773cf2449', 'volume_name': 'volume-01ff1a7a-36c8-4855-9a67-40b773cf2449', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:18:53 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-cfce8914-70f0-468a-a61d-b6bbca6aa647 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fca6f77-9bfc-48cf-9102-fd45ca64a9e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:18:53 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-cfce8914-70f0-468a-a61d-b6bbca6aa647 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fca6f77-9bfc-48cf-9102-fd45ca64a9e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:18:53 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-cfce8914-70f0-468a-a61d-b6bbca6aa647 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31b986a9-f170-4757-9625-6538a4db8afc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:18:53 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-cfce8914-70f0-468a-a61d-b6bbca6aa647 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Volume 01ff1a7a-36c8-4855-9a67-40b773cf2449: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01ff1a7a-36c8-4855-9a67-40b773cf2449', 'volume_size': 1}
Apr 10 13:18:53 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-cfce8914-70f0-468a-a61d-b6bbca6aa647 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:18:53 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-cfce8914-70f0-468a-a61d-b6bbca6aa647 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:18:53 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-cfce8914-70f0-468a-a61d-b6bbca6aa647 tempest-CreateVolumesFromSnapshotTest-1194706465 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f252bf08b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:18:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-692746457',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01ff1a7a-36c8-4855-9a67-40b773cf2449,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2aaaa6e874494fa691635dbf04956148',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:18:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:18:53Z,use_quota=True,user_id='8d4d099d4b644b568b1c13155cc0d6d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)}" {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 13:18:53 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-cfce8914-70f0-468a-a61d-b6bbca6aa647 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Creating volume 01ff1a7a-36c8-4855-9a67-40b773cf2449 {{(pid=83345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 13:18:53 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-cfce8914-70f0-468a-a61d-b6bbca6aa647 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:18:53 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-cfce8914-70f0-468a-a61d-b6bbca6aa647 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:18:53 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-cfce8914-70f0-468a-a61d-b6bbca6aa647 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:18:53 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-cfce8914-70f0-468a-a61d-b6bbca6aa647 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:18:53 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-cfce8914-70f0-468a-a61d-b6bbca6aa647 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:18:53 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-cfce8914-70f0-468a-a61d-b6bbca6aa647 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:18:53 devstack cinder-volume[83345]: INFO cinder.volume.drivers.remotefs [None req-cfce8914-70f0-468a-a61d-b6bbca6aa647 tempest-CreateVolumesFromSnapshotTest-1194706465 None] casted to osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331
Apr 10 13:18:53 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-cfce8914-70f0-468a-a61d-b6bbca6aa647 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-01ff1a7a-36c8-4855-9a67-40b773cf2449 1073741824 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:18:53 devstack sudo[90337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-01ff1a7a-36c8-4855-9a67-40b773cf2449 1073741824
Apr 10 13:18:53 devstack sudo[90337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:18:53 devstack cinder-volume[83345]: DEBUG oslo_service.periodic_task [None req-c3f44832-ad7f-424b-a850-32c7352a19c5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83345) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 10 13:18:53 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-c3f44832-ad7f-424b-a850-32c7352a19c5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:18:53 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-c3f44832-ad7f-424b-a850-32c7352a19c5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:18:53 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-c3f44832-ad7f-424b-a850-32c7352a19c5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:18:53 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-c3f44832-ad7f-424b-a850-32c7352a19c5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:18:53 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-c3f44832-ad7f-424b-a850-32c7352a19c5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:18:53 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-c3f44832-ad7f-424b-a850-32c7352a19c5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:18:53 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecfad39d-988d-46a1-9016-87d5e05dc5c7 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:18:53 devstack sudo[90339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:18:53 devstack sudo[90339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:18:53 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ecfad39d-988d-46a1-9016-87d5e05dc5c7 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Flow 'volume_create_manager' (209c2b3c-f135-4749-9c5f-ed988d84a603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:18:53 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ecfad39d-988d-46a1-9016-87d5e05dc5c7 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b8ae9b2-1c8a-4e81-aa3d-33f059189c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:18:53 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ecfad39d-988d-46a1-9016-87d5e05dc5c7 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b8ae9b2-1c8a-4e81-aa3d-33f059189c2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:18:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-700533635',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70bb3a73-6b2f-466b-aedc-2834af00c15f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2aaaa6e874494fa691635dbf04956148',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:18:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:18:54Z,use_quota=True,user_id='8d4d099d4b644b568b1c13155cc0d6d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:18:53 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ecfad39d-988d-46a1-9016-87d5e05dc5c7 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42942453-6cc8-431f-b6a1-9aec48b968cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:18:53 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ecfad39d-988d-46a1-9016-87d5e05dc5c7 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42942453-6cc8-431f-b6a1-9aec48b968cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:18:53 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ecfad39d-988d-46a1-9016-87d5e05dc5c7 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7f51ca0-8148-4f54-b1d1-30d78b86a6db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:18:53 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ecfad39d-988d-46a1-9016-87d5e05dc5c7 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7f51ca0-8148-4f54-b1d1-30d78b86a6db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70bb3a73-6b2f-466b-aedc-2834af00c15f', 'volume_name': 'volume-70bb3a73-6b2f-466b-aedc-2834af00c15f', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:18:53 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ecfad39d-988d-46a1-9016-87d5e05dc5c7 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47cbdb4f-5188-474b-8f33-4a2b07a67551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:18:53 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ecfad39d-988d-46a1-9016-87d5e05dc5c7 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47cbdb4f-5188-474b-8f33-4a2b07a67551) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:18:53 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ecfad39d-988d-46a1-9016-87d5e05dc5c7 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66ed5d8a-ea6d-4674-8796-90fd96a5198e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:18:53 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-ecfad39d-988d-46a1-9016-87d5e05dc5c7 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Volume 70bb3a73-6b2f-466b-aedc-2834af00c15f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70bb3a73-6b2f-466b-aedc-2834af00c15f', 'volume_size': 1}
Apr 10 13:18:53 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-ecfad39d-988d-46a1-9016-87d5e05dc5c7 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:18:53 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-c99b4b97-be63-45a8-985e-e09cad1bafd4 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:18:53 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-c99b4b97-be63-45a8-985e-e09cad1bafd4 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Flow 'volume_create_manager' (74054cfa-7227-4dae-86d1-6d1e8ffb4716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:18:53 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-c99b4b97-be63-45a8-985e-e09cad1bafd4 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e5d0a41-b4e4-4f67-a48e-1bfc4e28afe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:18:53 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-c99b4b97-be63-45a8-985e-e09cad1bafd4 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e5d0a41-b4e4-4f67-a48e-1bfc4e28afe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:18:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-590870857',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d073ec6b-71f8-44dc-b022-723348b2d5ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2aaaa6e874494fa691635dbf04956148',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:18:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:18:54Z,use_quota=True,user_id='8d4d099d4b644b568b1c13155cc0d6d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:18:53 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-c99b4b97-be63-45a8-985e-e09cad1bafd4 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (899de020-e5ee-43ef-b034-409ae050e811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:18:53 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-c99b4b97-be63-45a8-985e-e09cad1bafd4 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (899de020-e5ee-43ef-b034-409ae050e811) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:18:53 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-c99b4b97-be63-45a8-985e-e09cad1bafd4 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90ddaabe-bd6c-4519-ad05-fed6263349b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:18:53 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-c99b4b97-be63-45a8-985e-e09cad1bafd4 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90ddaabe-bd6c-4519-ad05-fed6263349b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd073ec6b-71f8-44dc-b022-723348b2d5ef', 'volume_name': 'volume-d073ec6b-71f8-44dc-b022-723348b2d5ef', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:18:53 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-c99b4b97-be63-45a8-985e-e09cad1bafd4 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53cc0710-c9ef-4745-9165-2983942a8f18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:18:53 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-c99b4b97-be63-45a8-985e-e09cad1bafd4 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53cc0710-c9ef-4745-9165-2983942a8f18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:18:53 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-c99b4b97-be63-45a8-985e-e09cad1bafd4 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0999a05-c57f-4b64-8594-75e16ec4de0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:18:53 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-c99b4b97-be63-45a8-985e-e09cad1bafd4 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Volume d073ec6b-71f8-44dc-b022-723348b2d5ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d073ec6b-71f8-44dc-b022-723348b2d5ef', 'volume_size': 1}
Apr 10 13:18:53 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-c99b4b97-be63-45a8-985e-e09cad1bafd4 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:18:53 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6b9f0a3-19bf-48a7-9f28-40f73bb39763 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:18:53 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-d6b9f0a3-19bf-48a7-9f28-40f73bb39763 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Flow 'volume_create_manager' (973f29dc-cd26-46cd-86f9-cf5dffbbd821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:18:53 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-d6b9f0a3-19bf-48a7-9f28-40f73bb39763 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5aa997bd-4ee9-4889-b4b4-c3a07f5ed5c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:18:53 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-d6b9f0a3-19bf-48a7-9f28-40f73bb39763 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5aa997bd-4ee9-4889-b4b4-c3a07f5ed5c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:18:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-412867812',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8ff331c-c5ba-4c01-9083-6f41acbff05c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2aaaa6e874494fa691635dbf04956148',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:18:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:18:54Z,use_quota=True,user_id='8d4d099d4b644b568b1c13155cc0d6d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:18:53 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-d6b9f0a3-19bf-48a7-9f28-40f73bb39763 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6f5abae-0adf-4533-b42a-bc6e155b2bd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:18:54 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-d6b9f0a3-19bf-48a7-9f28-40f73bb39763 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6f5abae-0adf-4533-b42a-bc6e155b2bd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:18:54 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-d6b9f0a3-19bf-48a7-9f28-40f73bb39763 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20c005e6-a245-4904-8582-5070ef39b202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:18:54 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-d6b9f0a3-19bf-48a7-9f28-40f73bb39763 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20c005e6-a245-4904-8582-5070ef39b202) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8ff331c-c5ba-4c01-9083-6f41acbff05c', 'volume_name': 'volume-a8ff331c-c5ba-4c01-9083-6f41acbff05c', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:18:54 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-d6b9f0a3-19bf-48a7-9f28-40f73bb39763 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08a0061e-9f64-43d5-ae49-b7c00b98dc94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:18:54 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-d6b9f0a3-19bf-48a7-9f28-40f73bb39763 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08a0061e-9f64-43d5-ae49-b7c00b98dc94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:18:54 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-d6b9f0a3-19bf-48a7-9f28-40f73bb39763 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (512b058b-552b-4fdd-82ba-538402191059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:18:54 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-d6b9f0a3-19bf-48a7-9f28-40f73bb39763 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Volume a8ff331c-c5ba-4c01-9083-6f41acbff05c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8ff331c-c5ba-4c01-9083-6f41acbff05c', 'volume_size': 1}
Apr 10 13:18:54 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-d6b9f0a3-19bf-48a7-9f28-40f73bb39763 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:18:54 devstack sudo[90337]: pam_unix(sudo:session): session closed for user root
Apr 10 13:18:54 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-cfce8914-70f0-468a-a61d-b6bbca6aa647 tempest-CreateVolumesFromSnapshotTest-1194706465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-01ff1a7a-36c8-4855-9a67-40b773cf2449 1073741824" returned: 0 in 0.581s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:18:54 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-cfce8914-70f0-468a-a61d-b6bbca6aa647 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-01ff1a7a-36c8-4855-9a67-40b773cf2449 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:18:54 devstack sudo[90339]: pam_unix(sudo:session): session closed for user root
Apr 10 13:18:54 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-c3f44832-ad7f-424b-a850-32c7352a19c5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.513s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:18:54 devstack sudo[90345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-01ff1a7a-36c8-4855-9a67-40b773cf2449
Apr 10 13:18:54 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-c3f44832-ad7f-424b-a850-32c7352a19c5 None None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:18:54 devstack sudo[90345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:18:54 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-b97d3aec-0170-417b-8e23-35a399ed44f1 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:18:54 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-b97d3aec-0170-417b-8e23-35a399ed44f1 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Flow 'volume_create_manager' (d8b23bfa-b442-4315-8a91-34ecc584c197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:18:54 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-b97d3aec-0170-417b-8e23-35a399ed44f1 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6387beec-0ed7-4ae9-9fd7-ba367618c1f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:18:54 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-b97d3aec-0170-417b-8e23-35a399ed44f1 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6387beec-0ed7-4ae9-9fd7-ba367618c1f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:18:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1370914756',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=065a7acd-48a9-4f83-a7e4-d0b03c775f04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2aaaa6e874494fa691635dbf04956148',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:18:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:18:54Z,use_quota=True,user_id='8d4d099d4b644b568b1c13155cc0d6d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:18:54 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-b97d3aec-0170-417b-8e23-35a399ed44f1 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b4b0ffd-3831-42d1-a086-a9d39ef440fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:18:54 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-b97d3aec-0170-417b-8e23-35a399ed44f1 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b4b0ffd-3831-42d1-a086-a9d39ef440fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:18:54 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-b97d3aec-0170-417b-8e23-35a399ed44f1 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac01410c-15c8-4175-ac6f-fb121b39015d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:18:54 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-b97d3aec-0170-417b-8e23-35a399ed44f1 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac01410c-15c8-4175-ac6f-fb121b39015d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '065a7acd-48a9-4f83-a7e4-d0b03c775f04', 'volume_name': 'volume-065a7acd-48a9-4f83-a7e4-d0b03c775f04', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:18:54 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-b97d3aec-0170-417b-8e23-35a399ed44f1 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e44f454f-fe1b-42a8-b28e-46c34621f1f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:18:54 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-b97d3aec-0170-417b-8e23-35a399ed44f1 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e44f454f-fe1b-42a8-b28e-46c34621f1f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:18:54 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-b97d3aec-0170-417b-8e23-35a399ed44f1 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d7484a1-3e8d-4a06-b45e-09c2454dab9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:18:54 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-b97d3aec-0170-417b-8e23-35a399ed44f1 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Volume 065a7acd-48a9-4f83-a7e4-d0b03c775f04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-065a7acd-48a9-4f83-a7e4-d0b03c775f04', 'volume_size': 1}
Apr 10 13:18:54 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-b97d3aec-0170-417b-8e23-35a399ed44f1 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:18:54 devstack sudo[90345]: pam_unix(sudo:session): session closed for user root
Apr 10 13:18:54 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-cfce8914-70f0-468a-a61d-b6bbca6aa647 tempest-CreateVolumesFromSnapshotTest-1194706465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-01ff1a7a-36c8-4855-9a67-40b773cf2449" returned: 0 in 0.431s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:18:54 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-cfce8914-70f0-468a-a61d-b6bbca6aa647 tempest-CreateVolumesFromSnapshotTest-1194706465 None] <== create_volume: return (1037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'} {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 13:18:54 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-cfce8914-70f0-468a-a61d-b6bbca6aa647 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.040s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:18:54 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-ecfad39d-988d-46a1-9016-87d5e05dc5c7 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.837s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:18:54 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-ecfad39d-988d-46a1-9016-87d5e05dc5c7 tempest-CreateVolumesFromSnapshotTest-1194706465 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f252bf08b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:18:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-700533635',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70bb3a73-6b2f-466b-aedc-2834af00c15f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2aaaa6e874494fa691635dbf04956148',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:18:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:18:54Z,use_quota=True,user_id='8d4d099d4b644b568b1c13155cc0d6d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)}" {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 13:18:54 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-ecfad39d-988d-46a1-9016-87d5e05dc5c7 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Creating volume 70bb3a73-6b2f-466b-aedc-2834af00c15f {{(pid=83345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 13:18:54 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-ecfad39d-988d-46a1-9016-87d5e05dc5c7 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:18:54 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-ecfad39d-988d-46a1-9016-87d5e05dc5c7 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:18:54 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-ecfad39d-988d-46a1-9016-87d5e05dc5c7 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:18:54 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-ecfad39d-988d-46a1-9016-87d5e05dc5c7 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:18:54 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-ecfad39d-988d-46a1-9016-87d5e05dc5c7 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:18:54 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-ecfad39d-988d-46a1-9016-87d5e05dc5c7 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:18:54 devstack cinder-volume[83345]: INFO cinder.volume.drivers.remotefs [None req-ecfad39d-988d-46a1-9016-87d5e05dc5c7 tempest-CreateVolumesFromSnapshotTest-1194706465 None] casted to osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331
Apr 10 13:18:54 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ecfad39d-988d-46a1-9016-87d5e05dc5c7 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-70bb3a73-6b2f-466b-aedc-2834af00c15f 1073741824 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:18:54 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-cfce8914-70f0-468a-a61d-b6bbca6aa647 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31b986a9-f170-4757-9625-6538a4db8afc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01ff1a7a-36c8-4855-9a67-40b773cf2449', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:18:54 devstack sudo[90348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-70bb3a73-6b2f-466b-aedc-2834af00c15f 1073741824
Apr 10 13:18:54 devstack sudo[90348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:18:54 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-cfce8914-70f0-468a-a61d-b6bbca6aa647 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96173123-aef6-41c2-a518-992ad6e86178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:18:54 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-cfce8914-70f0-468a-a61d-b6bbca6aa647 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Volume volume-01ff1a7a-36c8-4855-9a67-40b773cf2449 (01ff1a7a-36c8-4855-9a67-40b773cf2449): created successfully
Apr 10 13:18:54 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-cfce8914-70f0-468a-a61d-b6bbca6aa647 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96173123-aef6-41c2-a518-992ad6e86178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:18:54 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-cfce8914-70f0-468a-a61d-b6bbca6aa647 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Flow 'volume_create_manager' (03fac0dc-0d0b-4872-baa8-e7d8ef6d6803) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:18:54 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-cfce8914-70f0-468a-a61d-b6bbca6aa647 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Created volume successfully.
Apr 10 13:18:54 devstack sudo[90348]: pam_unix(sudo:session): session closed for user root
Apr 10 13:18:54 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ecfad39d-988d-46a1-9016-87d5e05dc5c7 tempest-CreateVolumesFromSnapshotTest-1194706465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-70bb3a73-6b2f-466b-aedc-2834af00c15f 1073741824" returned: 0 in 0.462s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:18:54 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ecfad39d-988d-46a1-9016-87d5e05dc5c7 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-70bb3a73-6b2f-466b-aedc-2834af00c15f {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:18:54 devstack sudo[90353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-70bb3a73-6b2f-466b-aedc-2834af00c15f
Apr 10 13:18:54 devstack sudo[90353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:18:55 devstack sudo[90353]: pam_unix(sudo:session): session closed for user root
Apr 10 13:18:55 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ecfad39d-988d-46a1-9016-87d5e05dc5c7 tempest-CreateVolumesFromSnapshotTest-1194706465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-70bb3a73-6b2f-466b-aedc-2834af00c15f" returned: 0 in 0.408s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:18:55 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-ecfad39d-988d-46a1-9016-87d5e05dc5c7 tempest-CreateVolumesFromSnapshotTest-1194706465 None] <== create_volume: return (891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'} {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 13:18:55 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-ecfad39d-988d-46a1-9016-87d5e05dc5c7 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:18:55 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-c99b4b97-be63-45a8-985e-e09cad1bafd4 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.491s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:18:55 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-c99b4b97-be63-45a8-985e-e09cad1bafd4 tempest-CreateVolumesFromSnapshotTest-1194706465 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f252bf08b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:18:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-590870857',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d073ec6b-71f8-44dc-b022-723348b2d5ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2aaaa6e874494fa691635dbf04956148',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:18:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:18:54Z,use_quota=True,user_id='8d4d099d4b644b568b1c13155cc0d6d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)}" {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 13:18:55 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-c99b4b97-be63-45a8-985e-e09cad1bafd4 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Creating volume d073ec6b-71f8-44dc-b022-723348b2d5ef {{(pid=83345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 13:18:55 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-c99b4b97-be63-45a8-985e-e09cad1bafd4 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:18:55 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-c99b4b97-be63-45a8-985e-e09cad1bafd4 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:18:55 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-c99b4b97-be63-45a8-985e-e09cad1bafd4 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:18:55 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-c99b4b97-be63-45a8-985e-e09cad1bafd4 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:18:55 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-c99b4b97-be63-45a8-985e-e09cad1bafd4 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:18:55 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-c99b4b97-be63-45a8-985e-e09cad1bafd4 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:18:55 devstack cinder-volume[83345]: INFO cinder.volume.drivers.remotefs [None req-c99b4b97-be63-45a8-985e-e09cad1bafd4 tempest-CreateVolumesFromSnapshotTest-1194706465 None] casted to osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331
Apr 10 13:18:55 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-c99b4b97-be63-45a8-985e-e09cad1bafd4 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-d073ec6b-71f8-44dc-b022-723348b2d5ef 1073741824 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:18:55 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ecfad39d-988d-46a1-9016-87d5e05dc5c7 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66ed5d8a-ea6d-4674-8796-90fd96a5198e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70bb3a73-6b2f-466b-aedc-2834af00c15f', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:18:55 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ecfad39d-988d-46a1-9016-87d5e05dc5c7 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39755a80-9956-4913-a883-7ed7c582f295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:18:55 devstack sudo[90356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-d073ec6b-71f8-44dc-b022-723348b2d5ef 1073741824
Apr 10 13:18:55 devstack sudo[90356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:18:55 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-ecfad39d-988d-46a1-9016-87d5e05dc5c7 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Volume volume-70bb3a73-6b2f-466b-aedc-2834af00c15f (70bb3a73-6b2f-466b-aedc-2834af00c15f): created successfully
Apr 10 13:18:55 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ecfad39d-988d-46a1-9016-87d5e05dc5c7 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39755a80-9956-4913-a883-7ed7c582f295) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:18:55 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ecfad39d-988d-46a1-9016-87d5e05dc5c7 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Flow 'volume_create_manager' (209c2b3c-f135-4749-9c5f-ed988d84a603) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:18:55 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-ecfad39d-988d-46a1-9016-87d5e05dc5c7 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Created volume successfully.
Apr 10 13:18:55 devstack sudo[90356]: pam_unix(sudo:session): session closed for user root
Apr 10 13:18:55 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-c99b4b97-be63-45a8-985e-e09cad1bafd4 tempest-CreateVolumesFromSnapshotTest-1194706465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-d073ec6b-71f8-44dc-b022-723348b2d5ef 1073741824" returned: 0 in 0.459s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:18:55 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-c99b4b97-be63-45a8-985e-e09cad1bafd4 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-d073ec6b-71f8-44dc-b022-723348b2d5ef {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:18:55 devstack sudo[90361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-d073ec6b-71f8-44dc-b022-723348b2d5ef
Apr 10 13:18:55 devstack sudo[90361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:18:56 devstack sudo[90361]: pam_unix(sudo:session): session closed for user root
Apr 10 13:18:56 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-c99b4b97-be63-45a8-985e-e09cad1bafd4 tempest-CreateVolumesFromSnapshotTest-1194706465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-d073ec6b-71f8-44dc-b022-723348b2d5ef" returned: 0 in 0.392s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:18:56 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-c99b4b97-be63-45a8-985e-e09cad1bafd4 tempest-CreateVolumesFromSnapshotTest-1194706465 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'} {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 13:18:56 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-c99b4b97-be63-45a8-985e-e09cad1bafd4 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.875s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:18:56 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-d6b9f0a3-19bf-48a7-9f28-40f73bb39763 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.240s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:18:56 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-d6b9f0a3-19bf-48a7-9f28-40f73bb39763 tempest-CreateVolumesFromSnapshotTest-1194706465 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f252bf08b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:18:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-412867812',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8ff331c-c5ba-4c01-9083-6f41acbff05c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2aaaa6e874494fa691635dbf04956148',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:18:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:18:54Z,use_quota=True,user_id='8d4d099d4b644b568b1c13155cc0d6d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)}" {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 13:18:56 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-d6b9f0a3-19bf-48a7-9f28-40f73bb39763 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Creating volume a8ff331c-c5ba-4c01-9083-6f41acbff05c {{(pid=83345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 13:18:56 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-d6b9f0a3-19bf-48a7-9f28-40f73bb39763 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:18:56 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-d6b9f0a3-19bf-48a7-9f28-40f73bb39763 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:18:56 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-d6b9f0a3-19bf-48a7-9f28-40f73bb39763 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:18:56 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-d6b9f0a3-19bf-48a7-9f28-40f73bb39763 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:18:56 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-d6b9f0a3-19bf-48a7-9f28-40f73bb39763 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:18:56 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-d6b9f0a3-19bf-48a7-9f28-40f73bb39763 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:18:56 devstack cinder-volume[83345]: INFO cinder.volume.drivers.remotefs [None req-d6b9f0a3-19bf-48a7-9f28-40f73bb39763 tempest-CreateVolumesFromSnapshotTest-1194706465 None] casted to osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331
Apr 10 13:18:56 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-d6b9f0a3-19bf-48a7-9f28-40f73bb39763 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-a8ff331c-c5ba-4c01-9083-6f41acbff05c 1073741824 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:18:56 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-c99b4b97-be63-45a8-985e-e09cad1bafd4 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0999a05-c57f-4b64-8594-75e16ec4de0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d073ec6b-71f8-44dc-b022-723348b2d5ef', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:18:56 devstack sudo[90364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-a8ff331c-c5ba-4c01-9083-6f41acbff05c 1073741824
Apr 10 13:18:56 devstack sudo[90364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:18:56 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-c99b4b97-be63-45a8-985e-e09cad1bafd4 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dc43a7a-4a25-4ff5-8ea6-cf92656d0569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:18:56 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-c99b4b97-be63-45a8-985e-e09cad1bafd4 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Volume volume-d073ec6b-71f8-44dc-b022-723348b2d5ef (d073ec6b-71f8-44dc-b022-723348b2d5ef): created successfully
Apr 10 13:18:56 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-c99b4b97-be63-45a8-985e-e09cad1bafd4 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dc43a7a-4a25-4ff5-8ea6-cf92656d0569) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:18:56 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-c99b4b97-be63-45a8-985e-e09cad1bafd4 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Flow 'volume_create_manager' (74054cfa-7227-4dae-86d1-6d1e8ffb4716) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:18:56 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-c99b4b97-be63-45a8-985e-e09cad1bafd4 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Created volume successfully.
Apr 10 13:18:56 devstack sudo[90364]: pam_unix(sudo:session): session closed for user root
Apr 10 13:18:56 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-d6b9f0a3-19bf-48a7-9f28-40f73bb39763 tempest-CreateVolumesFromSnapshotTest-1194706465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-a8ff331c-c5ba-4c01-9083-6f41acbff05c 1073741824" returned: 0 in 0.447s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:18:56 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-d6b9f0a3-19bf-48a7-9f28-40f73bb39763 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-a8ff331c-c5ba-4c01-9083-6f41acbff05c {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:18:56 devstack sudo[90369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-a8ff331c-c5ba-4c01-9083-6f41acbff05c
Apr 10 13:18:56 devstack sudo[90369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:18:57 devstack sudo[90369]: pam_unix(sudo:session): session closed for user root
Apr 10 13:18:57 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-d6b9f0a3-19bf-48a7-9f28-40f73bb39763 tempest-CreateVolumesFromSnapshotTest-1194706465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-a8ff331c-c5ba-4c01-9083-6f41acbff05c" returned: 0 in 0.383s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:18:57 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-d6b9f0a3-19bf-48a7-9f28-40f73bb39763 tempest-CreateVolumesFromSnapshotTest-1194706465 None] <== create_volume: return (852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'} {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 13:18:57 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-d6b9f0a3-19bf-48a7-9f28-40f73bb39763 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.855s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:18:57 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-b97d3aec-0170-417b-8e23-35a399ed44f1 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.900s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:18:57 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-b97d3aec-0170-417b-8e23-35a399ed44f1 tempest-CreateVolumesFromSnapshotTest-1194706465 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f252bf08b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:18:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1370914756',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=065a7acd-48a9-4f83-a7e4-d0b03c775f04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2aaaa6e874494fa691635dbf04956148',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:18:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:18:54Z,use_quota=True,user_id='8d4d099d4b644b568b1c13155cc0d6d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)}" {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 13:18:57 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-b97d3aec-0170-417b-8e23-35a399ed44f1 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Creating volume 065a7acd-48a9-4f83-a7e4-d0b03c775f04 {{(pid=83345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 13:18:57 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-b97d3aec-0170-417b-8e23-35a399ed44f1 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:18:57 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-b97d3aec-0170-417b-8e23-35a399ed44f1 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:18:57 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-b97d3aec-0170-417b-8e23-35a399ed44f1 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:18:57 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-b97d3aec-0170-417b-8e23-35a399ed44f1 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:18:57 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-b97d3aec-0170-417b-8e23-35a399ed44f1 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:18:57 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-b97d3aec-0170-417b-8e23-35a399ed44f1 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:18:57 devstack cinder-volume[83345]: INFO cinder.volume.drivers.remotefs [None req-b97d3aec-0170-417b-8e23-35a399ed44f1 tempest-CreateVolumesFromSnapshotTest-1194706465 None] casted to osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331
Apr 10 13:18:57 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-b97d3aec-0170-417b-8e23-35a399ed44f1 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-065a7acd-48a9-4f83-a7e4-d0b03c775f04 1073741824 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:18:57 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-d6b9f0a3-19bf-48a7-9f28-40f73bb39763 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (512b058b-552b-4fdd-82ba-538402191059) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8ff331c-c5ba-4c01-9083-6f41acbff05c', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:18:57 devstack sudo[90372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-065a7acd-48a9-4f83-a7e4-d0b03c775f04 1073741824
Apr 10 13:18:57 devstack sudo[90372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:18:57 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-d6b9f0a3-19bf-48a7-9f28-40f73bb39763 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (257df313-daac-460d-9614-571476017a36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:18:57 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-d6b9f0a3-19bf-48a7-9f28-40f73bb39763 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Volume volume-a8ff331c-c5ba-4c01-9083-6f41acbff05c (a8ff331c-c5ba-4c01-9083-6f41acbff05c): created successfully
Apr 10 13:18:57 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-d6b9f0a3-19bf-48a7-9f28-40f73bb39763 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (257df313-daac-460d-9614-571476017a36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:18:57 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-d6b9f0a3-19bf-48a7-9f28-40f73bb39763 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Flow 'volume_create_manager' (973f29dc-cd26-46cd-86f9-cf5dffbbd821) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:18:57 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-d6b9f0a3-19bf-48a7-9f28-40f73bb39763 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Created volume successfully.
Apr 10 13:18:57 devstack sudo[90372]: pam_unix(sudo:session): session closed for user root
Apr 10 13:18:57 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-b97d3aec-0170-417b-8e23-35a399ed44f1 tempest-CreateVolumesFromSnapshotTest-1194706465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-065a7acd-48a9-4f83-a7e4-d0b03c775f04 1073741824" returned: 0 in 0.470s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:18:57 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-b97d3aec-0170-417b-8e23-35a399ed44f1 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-065a7acd-48a9-4f83-a7e4-d0b03c775f04 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:18:57 devstack sudo[90377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-065a7acd-48a9-4f83-a7e4-d0b03c775f04
Apr 10 13:18:57 devstack sudo[90377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:18:58 devstack sudo[90377]: pam_unix(sudo:session): session closed for user root
Apr 10 13:18:58 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-b97d3aec-0170-417b-8e23-35a399ed44f1 tempest-CreateVolumesFromSnapshotTest-1194706465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-065a7acd-48a9-4f83-a7e4-d0b03c775f04" returned: 0 in 0.389s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:18:58 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-b97d3aec-0170-417b-8e23-35a399ed44f1 tempest-CreateVolumesFromSnapshotTest-1194706465 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'} {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 13:18:58 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-b97d3aec-0170-417b-8e23-35a399ed44f1 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:18:58 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-b97d3aec-0170-417b-8e23-35a399ed44f1 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d7484a1-3e8d-4a06-b45e-09c2454dab9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-065a7acd-48a9-4f83-a7e4-d0b03c775f04', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:18:58 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-b97d3aec-0170-417b-8e23-35a399ed44f1 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5dbdf1c-67ce-4249-afbe-0bf4f4d08c80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:18:58 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-b97d3aec-0170-417b-8e23-35a399ed44f1 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Volume volume-065a7acd-48a9-4f83-a7e4-d0b03c775f04 (065a7acd-48a9-4f83-a7e4-d0b03c775f04): created successfully
Apr 10 13:18:58 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-b97d3aec-0170-417b-8e23-35a399ed44f1 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5dbdf1c-67ce-4249-afbe-0bf4f4d08c80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:18:58 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-b97d3aec-0170-417b-8e23-35a399ed44f1 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Flow 'volume_create_manager' (d8b23bfa-b442-4315-8a91-34ecc584c197) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:18:58 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-b97d3aec-0170-417b-8e23-35a399ed44f1 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Created volume successfully.
Apr 10 13:18:58 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-36b6e8a1-6575-4ef7-bf6f-6329a1651e53 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Acquiring lock "cinder-065a7acd-48a9-4f83-a7e4-d0b03c775f04-delete_volume" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:18:58 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-36b6e8a1-6575-4ef7-bf6f-6329a1651e53 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Lock "cinder-065a7acd-48a9-4f83-a7e4-d0b03c775f04-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:18:58 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-36b6e8a1-6575-4ef7-bf6f-6329a1651e53 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Acquiring lock "cinder-quobyte-065a7acd-48a9-4f83-a7e4-d0b03c775f04" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:18:58 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-36b6e8a1-6575-4ef7-bf6f-6329a1651e53 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Lock "cinder-quobyte-065a7acd-48a9-4f83-a7e4-d0b03c775f04" acquired by "delete_volume" :: waited 0.008s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:18:58 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd1e34db-f46f-4e7d-85e3-c0127d95b33f]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:18:58 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-36b6e8a1-6575-4ef7-bf6f-6329a1651e53 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-065a7acd-48a9-4f83-a7e4-d0b03c775f04 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:18:58 devstack sudo[90380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-065a7acd-48a9-4f83-a7e4-d0b03c775f04
Apr 10 13:18:58 devstack sudo[90380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:18:59 devstack sudo[90380]: pam_unix(sudo:session): session closed for user root
Apr 10 13:18:59 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-36b6e8a1-6575-4ef7-bf6f-6329a1651e53 tempest-CreateVolumesFromSnapshotTest-1194706465 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-065a7acd-48a9-4f83-a7e4-d0b03c775f04" returned: 0 in 0.451s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:18:59 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-36b6e8a1-6575-4ef7-bf6f-6329a1651e53 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-065a7acd-48a9-4f83-a7e4-d0b03c775f04 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:18:59 devstack sudo[90385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-065a7acd-48a9-4f83-a7e4-d0b03c775f04
Apr 10 13:18:59 devstack sudo[90385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:18:59 devstack sudo[90385]: pam_unix(sudo:session): session closed for user root
Apr 10 13:18:59 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-36b6e8a1-6575-4ef7-bf6f-6329a1651e53 tempest-CreateVolumesFromSnapshotTest-1194706465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-065a7acd-48a9-4f83-a7e4-d0b03c775f04" returned: 0 in 0.402s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:18:59 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-36b6e8a1-6575-4ef7-bf6f-6329a1651e53 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Lock "cinder-quobyte-065a7acd-48a9-4f83-a7e4-d0b03c775f04" released by "delete_volume" :: held 0.880s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:18:59 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-36b6e8a1-6575-4ef7-bf6f-6329a1651e53 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Created reservations ['7aa01398-34bc-4511-b5d9-eb1b56f5c18d', '72ea4342-afdf-4413-bac2-43a66b7fa61b', '0262e91e-c5d7-4001-94a4-97a3afab0096', '3104e138-f4d1-4437-8b45-eb71b77abd96'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:18:59 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-36b6e8a1-6575-4ef7-bf6f-6329a1651e53 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:18:59 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-36b6e8a1-6575-4ef7-bf6f-6329a1651e53 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:18:59 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-36b6e8a1-6575-4ef7-bf6f-6329a1651e53 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:18:59 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-36b6e8a1-6575-4ef7-bf6f-6329a1651e53 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:18:59 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-36b6e8a1-6575-4ef7-bf6f-6329a1651e53 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:18:59 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-36b6e8a1-6575-4ef7-bf6f-6329a1651e53 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:18:59 devstack sudo[90388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:18:59 devstack sudo[90388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:18:59 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-0349e382-46a4-4d20-9078-c57069633b43 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Acquiring lock "cinder-a8ff331c-c5ba-4c01-9083-6f41acbff05c-delete_volume" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:18:59 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-0349e382-46a4-4d20-9078-c57069633b43 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Lock "cinder-a8ff331c-c5ba-4c01-9083-6f41acbff05c-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:18:59 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-0349e382-46a4-4d20-9078-c57069633b43 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Acquiring lock "cinder-quobyte-a8ff331c-c5ba-4c01-9083-6f41acbff05c" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:18:59 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-0349e382-46a4-4d20-9078-c57069633b43 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Lock "cinder-quobyte-a8ff331c-c5ba-4c01-9083-6f41acbff05c" acquired by "delete_volume" :: waited 0.007s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:18:59 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[df257801-049e-4bbe-a105-5b79023fbc20]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:18:59 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-0349e382-46a4-4d20-9078-c57069633b43 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-a8ff331c-c5ba-4c01-9083-6f41acbff05c {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:18:59 devstack sudo[90390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-a8ff331c-c5ba-4c01-9083-6f41acbff05c
Apr 10 13:18:59 devstack sudo[90390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:18:59 devstack sudo[90388]: pam_unix(sudo:session): session closed for user root
Apr 10 13:18:59 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-36b6e8a1-6575-4ef7-bf6f-6329a1651e53 tempest-CreateVolumesFromSnapshotTest-1194706465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.435s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:18:59 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-36b6e8a1-6575-4ef7-bf6f-6329a1651e53 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:18:59 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-36b6e8a1-6575-4ef7-bf6f-6329a1651e53 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Deleted volume successfully.
Apr 10 13:19:00 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-36b6e8a1-6575-4ef7-bf6f-6329a1651e53 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Lock "cinder-065a7acd-48a9-4f83-a7e4-d0b03c775f04-delete_volume" released by "delete_volume" :: held 1.442s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:19:00 devstack sudo[90390]: pam_unix(sudo:session): session closed for user root
Apr 10 13:19:00 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-0349e382-46a4-4d20-9078-c57069633b43 tempest-CreateVolumesFromSnapshotTest-1194706465 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-a8ff331c-c5ba-4c01-9083-6f41acbff05c" returned: 0 in 0.457s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:19:00 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-0349e382-46a4-4d20-9078-c57069633b43 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-a8ff331c-c5ba-4c01-9083-6f41acbff05c {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:19:00 devstack sudo[90396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-a8ff331c-c5ba-4c01-9083-6f41acbff05c
Apr 10 13:19:00 devstack sudo[90396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:19:00 devstack sudo[90396]: pam_unix(sudo:session): session closed for user root
Apr 10 13:19:00 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-0349e382-46a4-4d20-9078-c57069633b43 tempest-CreateVolumesFromSnapshotTest-1194706465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-a8ff331c-c5ba-4c01-9083-6f41acbff05c" returned: 0 in 0.431s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:19:00 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-0349e382-46a4-4d20-9078-c57069633b43 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Lock "cinder-quobyte-a8ff331c-c5ba-4c01-9083-6f41acbff05c" released by "delete_volume" :: held 0.918s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:19:00 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-0349e382-46a4-4d20-9078-c57069633b43 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Created reservations ['c8089bd1-d60a-4e98-94ee-98b0f9d4d55b', 'a4f88e70-f708-4252-adee-2874f66c96cb', '040cfac6-9856-4ef2-ab30-1424cf637d37', 'ab5c3ce2-ffdf-4767-98ec-b6d76708e344'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:19:00 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-0349e382-46a4-4d20-9078-c57069633b43 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:19:00 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-0349e382-46a4-4d20-9078-c57069633b43 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:19:00 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-0349e382-46a4-4d20-9078-c57069633b43 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:19:00 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-0349e382-46a4-4d20-9078-c57069633b43 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:19:00 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-0349e382-46a4-4d20-9078-c57069633b43 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:19:00 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-0349e382-46a4-4d20-9078-c57069633b43 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:19:00 devstack sudo[90399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:19:00 devstack sudo[90399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:19:00 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-f0f5b263-ea67-4eaa-86cc-402a115d84ee tempest-CreateVolumesFromSnapshotTest-1194706465 None] Acquiring lock "cinder-d073ec6b-71f8-44dc-b022-723348b2d5ef-delete_volume" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:19:00 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-f0f5b263-ea67-4eaa-86cc-402a115d84ee tempest-CreateVolumesFromSnapshotTest-1194706465 None] Lock "cinder-d073ec6b-71f8-44dc-b022-723348b2d5ef-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:19:00 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-f0f5b263-ea67-4eaa-86cc-402a115d84ee tempest-CreateVolumesFromSnapshotTest-1194706465 None] Acquiring lock "cinder-quobyte-d073ec6b-71f8-44dc-b022-723348b2d5ef" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:19:00 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-f0f5b263-ea67-4eaa-86cc-402a115d84ee tempest-CreateVolumesFromSnapshotTest-1194706465 None] Lock "cinder-quobyte-d073ec6b-71f8-44dc-b022-723348b2d5ef" acquired by "delete_volume" :: waited 0.012s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:19:00 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d3982cb-df99-49a4-9028-8a69d7632e4f]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:19:00 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-f0f5b263-ea67-4eaa-86cc-402a115d84ee tempest-CreateVolumesFromSnapshotTest-1194706465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-d073ec6b-71f8-44dc-b022-723348b2d5ef {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:19:00 devstack sudo[90401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-d073ec6b-71f8-44dc-b022-723348b2d5ef
Apr 10 13:19:00 devstack sudo[90401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:19:01 devstack sudo[90399]: pam_unix(sudo:session): session closed for user root
Apr 10 13:19:01 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-0349e382-46a4-4d20-9078-c57069633b43 tempest-CreateVolumesFromSnapshotTest-1194706465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.438s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:19:01 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-0349e382-46a4-4d20-9078-c57069633b43 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:19:01 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-0349e382-46a4-4d20-9078-c57069633b43 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Deleted volume successfully.
Apr 10 13:19:01 devstack cinder-volume[83345]: DEBUG dbcounter [-] [83345] Writing DB stats cinder:DELETE=16,cinder:SELECT=147,cinder:UPDATE=188,cinder:INSERT=39 {{(pid=83345) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 10 13:19:01 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-0349e382-46a4-4d20-9078-c57069633b43 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Lock "cinder-a8ff331c-c5ba-4c01-9083-6f41acbff05c-delete_volume" released by "delete_volume" :: held 1.487s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:19:01 devstack sudo[90401]: pam_unix(sudo:session): session closed for user root
Apr 10 13:19:01 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-f0f5b263-ea67-4eaa-86cc-402a115d84ee tempest-CreateVolumesFromSnapshotTest-1194706465 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-d073ec6b-71f8-44dc-b022-723348b2d5ef" returned: 0 in 0.487s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:19:01 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-f0f5b263-ea67-4eaa-86cc-402a115d84ee tempest-CreateVolumesFromSnapshotTest-1194706465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-d073ec6b-71f8-44dc-b022-723348b2d5ef {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:19:01 devstack sudo[90407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-d073ec6b-71f8-44dc-b022-723348b2d5ef
Apr 10 13:19:01 devstack sudo[90407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:19:01 devstack sudo[90407]: pam_unix(sudo:session): session closed for user root
Apr 10 13:19:01 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-f0f5b263-ea67-4eaa-86cc-402a115d84ee tempest-CreateVolumesFromSnapshotTest-1194706465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-d073ec6b-71f8-44dc-b022-723348b2d5ef" returned: 0 in 0.428s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:19:01 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-f0f5b263-ea67-4eaa-86cc-402a115d84ee tempest-CreateVolumesFromSnapshotTest-1194706465 None] Lock "cinder-quobyte-d073ec6b-71f8-44dc-b022-723348b2d5ef" released by "delete_volume" :: held 0.937s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:19:01 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-f0f5b263-ea67-4eaa-86cc-402a115d84ee tempest-CreateVolumesFromSnapshotTest-1194706465 None] Created reservations ['8403a061-2f9d-4a7d-9535-c8e8b5a64f33', '31f6f1d3-8ad5-4148-a855-b45e0a394719', '95e4a0d7-1019-47cb-9d6d-dfe6ac322211', '9b14889e-4b8f-4cf6-b06c-4ad786bef304'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:19:01 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-f0f5b263-ea67-4eaa-86cc-402a115d84ee tempest-CreateVolumesFromSnapshotTest-1194706465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:19:01 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-f0f5b263-ea67-4eaa-86cc-402a115d84ee tempest-CreateVolumesFromSnapshotTest-1194706465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:19:01 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-f0f5b263-ea67-4eaa-86cc-402a115d84ee tempest-CreateVolumesFromSnapshotTest-1194706465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:19:01 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-f0f5b263-ea67-4eaa-86cc-402a115d84ee tempest-CreateVolumesFromSnapshotTest-1194706465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:19:01 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-f0f5b263-ea67-4eaa-86cc-402a115d84ee tempest-CreateVolumesFromSnapshotTest-1194706465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:19:01 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-f0f5b263-ea67-4eaa-86cc-402a115d84ee tempest-CreateVolumesFromSnapshotTest-1194706465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:19:01 devstack sudo[90411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:19:01 devstack sudo[90411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:19:01 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-de116a06-20bb-46e8-a5be-fa3e3ced8da6 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Acquiring lock "cinder-70bb3a73-6b2f-466b-aedc-2834af00c15f-delete_volume" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:19:01 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-de116a06-20bb-46e8-a5be-fa3e3ced8da6 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Lock "cinder-70bb3a73-6b2f-466b-aedc-2834af00c15f-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:19:01 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-de116a06-20bb-46e8-a5be-fa3e3ced8da6 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Acquiring lock "cinder-quobyte-70bb3a73-6b2f-466b-aedc-2834af00c15f" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:19:01 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-de116a06-20bb-46e8-a5be-fa3e3ced8da6 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Lock "cinder-quobyte-70bb3a73-6b2f-466b-aedc-2834af00c15f" acquired by "delete_volume" :: waited 0.009s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:19:01 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[d83c5c44-ab77-45ad-ad05-2f0515709800]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:19:01 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-de116a06-20bb-46e8-a5be-fa3e3ced8da6 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-70bb3a73-6b2f-466b-aedc-2834af00c15f {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:19:02 devstack sudo[90413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-70bb3a73-6b2f-466b-aedc-2834af00c15f
Apr 10 13:19:02 devstack sudo[90413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:19:02 devstack sudo[90411]: pam_unix(sudo:session): session closed for user root
Apr 10 13:19:02 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-f0f5b263-ea67-4eaa-86cc-402a115d84ee tempest-CreateVolumesFromSnapshotTest-1194706465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.441s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:19:02 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-f0f5b263-ea67-4eaa-86cc-402a115d84ee tempest-CreateVolumesFromSnapshotTest-1194706465 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:19:02 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-f0f5b263-ea67-4eaa-86cc-402a115d84ee tempest-CreateVolumesFromSnapshotTest-1194706465 None] Deleted volume successfully.
Apr 10 13:19:02 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-f0f5b263-ea67-4eaa-86cc-402a115d84ee tempest-CreateVolumesFromSnapshotTest-1194706465 None] Lock "cinder-d073ec6b-71f8-44dc-b022-723348b2d5ef-delete_volume" released by "delete_volume" :: held 1.517s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:19:02 devstack sudo[90413]: pam_unix(sudo:session): session closed for user root
Apr 10 13:19:02 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-de116a06-20bb-46e8-a5be-fa3e3ced8da6 tempest-CreateVolumesFromSnapshotTest-1194706465 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-70bb3a73-6b2f-466b-aedc-2834af00c15f" returned: 0 in 0.462s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:19:02 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-de116a06-20bb-46e8-a5be-fa3e3ced8da6 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-70bb3a73-6b2f-466b-aedc-2834af00c15f {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:19:02 devstack sudo[90419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-70bb3a73-6b2f-466b-aedc-2834af00c15f
Apr 10 13:19:02 devstack sudo[90419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:19:02 devstack sudo[90419]: pam_unix(sudo:session): session closed for user root
Apr 10 13:19:02 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-de116a06-20bb-46e8-a5be-fa3e3ced8da6 tempest-CreateVolumesFromSnapshotTest-1194706465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-70bb3a73-6b2f-466b-aedc-2834af00c15f" returned: 0 in 0.428s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:19:02 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-de116a06-20bb-46e8-a5be-fa3e3ced8da6 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Lock "cinder-quobyte-70bb3a73-6b2f-466b-aedc-2834af00c15f" released by "delete_volume" :: held 0.922s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:19:02 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-de116a06-20bb-46e8-a5be-fa3e3ced8da6 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Created reservations ['bd41dc07-2182-4942-8559-d0fbca92db99', 'f706d5c5-63c6-48ab-8880-750477c3d7d9', '40753b44-2bac-466d-a770-ac63aa3bc4b6', '535be1d8-aa08-40b0-a962-fc806e73a815'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:19:02 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-de116a06-20bb-46e8-a5be-fa3e3ced8da6 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:19:02 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-de116a06-20bb-46e8-a5be-fa3e3ced8da6 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:19:02 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-de116a06-20bb-46e8-a5be-fa3e3ced8da6 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:19:02 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-de116a06-20bb-46e8-a5be-fa3e3ced8da6 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:19:02 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-de116a06-20bb-46e8-a5be-fa3e3ced8da6 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:19:02 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-de116a06-20bb-46e8-a5be-fa3e3ced8da6 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:19:02 devstack sudo[90422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:19:02 devstack sudo[90422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:19:03 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-f747bda1-e9a5-49e7-89b1-151fdee07f89 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Acquiring lock "cinder-01ff1a7a-36c8-4855-9a67-40b773cf2449-delete_volume" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:19:03 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-f747bda1-e9a5-49e7-89b1-151fdee07f89 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Lock "cinder-01ff1a7a-36c8-4855-9a67-40b773cf2449-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:19:03 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-f747bda1-e9a5-49e7-89b1-151fdee07f89 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Acquiring lock "cinder-quobyte-01ff1a7a-36c8-4855-9a67-40b773cf2449" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:19:03 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-f747bda1-e9a5-49e7-89b1-151fdee07f89 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Lock "cinder-quobyte-01ff1a7a-36c8-4855-9a67-40b773cf2449" acquired by "delete_volume" :: waited 0.007s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:19:03 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9844a7a-a748-461b-8f13-838abc195192]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:19:03 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-f747bda1-e9a5-49e7-89b1-151fdee07f89 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-01ff1a7a-36c8-4855-9a67-40b773cf2449 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:19:03 devstack sudo[90424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-01ff1a7a-36c8-4855-9a67-40b773cf2449
Apr 10 13:19:03 devstack sudo[90424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:19:03 devstack sudo[90422]: pam_unix(sudo:session): session closed for user root
Apr 10 13:19:03 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-de116a06-20bb-46e8-a5be-fa3e3ced8da6 tempest-CreateVolumesFromSnapshotTest-1194706465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.437s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:19:03 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-de116a06-20bb-46e8-a5be-fa3e3ced8da6 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:19:03 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-de116a06-20bb-46e8-a5be-fa3e3ced8da6 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Deleted volume successfully.
Apr 10 13:19:03 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-de116a06-20bb-46e8-a5be-fa3e3ced8da6 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Lock "cinder-70bb3a73-6b2f-466b-aedc-2834af00c15f-delete_volume" released by "delete_volume" :: held 1.482s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:19:03 devstack sudo[90424]: pam_unix(sudo:session): session closed for user root
Apr 10 13:19:03 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-f747bda1-e9a5-49e7-89b1-151fdee07f89 tempest-CreateVolumesFromSnapshotTest-1194706465 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-01ff1a7a-36c8-4855-9a67-40b773cf2449" returned: 0 in 0.464s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:19:03 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-f747bda1-e9a5-49e7-89b1-151fdee07f89 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-01ff1a7a-36c8-4855-9a67-40b773cf2449 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:19:03 devstack sudo[90430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-01ff1a7a-36c8-4855-9a67-40b773cf2449
Apr 10 13:19:03 devstack sudo[90430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:19:03 devstack sudo[90430]: pam_unix(sudo:session): session closed for user root
Apr 10 13:19:03 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-f747bda1-e9a5-49e7-89b1-151fdee07f89 tempest-CreateVolumesFromSnapshotTest-1194706465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-01ff1a7a-36c8-4855-9a67-40b773cf2449" returned: 0 in 0.403s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:19:03 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-f747bda1-e9a5-49e7-89b1-151fdee07f89 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Lock "cinder-quobyte-01ff1a7a-36c8-4855-9a67-40b773cf2449" released by "delete_volume" :: held 0.888s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:19:03 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-f747bda1-e9a5-49e7-89b1-151fdee07f89 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Created reservations ['1accc57a-d953-4851-8c7d-a6987dcb6078', '057605f8-15a3-4246-9245-033f03ba05b2', 'af820121-004d-4c78-98a2-92e376a102f0', '17d3c208-1646-4d8f-8733-e04c7e73c037'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:19:04 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-f747bda1-e9a5-49e7-89b1-151fdee07f89 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:19:04 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-f747bda1-e9a5-49e7-89b1-151fdee07f89 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:19:04 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-f747bda1-e9a5-49e7-89b1-151fdee07f89 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:19:04 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-f747bda1-e9a5-49e7-89b1-151fdee07f89 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:19:04 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-f747bda1-e9a5-49e7-89b1-151fdee07f89 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:19:04 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-f747bda1-e9a5-49e7-89b1-151fdee07f89 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:19:04 devstack sudo[90433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:19:04 devstack sudo[90433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:19:04 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-e2470a2f-c88a-4c53-a1c9-79f207e8d40f tempest-CreateVolumesFromSnapshotTest-1194706465 None] Acquiring lock "cinder-bc6a2d0e-50e0-4614-9bd2-2ce1c32cb6d2-delete_snapshot" by "delete_snapshot" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:19:04 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-e2470a2f-c88a-4c53-a1c9-79f207e8d40f tempest-CreateVolumesFromSnapshotTest-1194706465 None] Lock "cinder-bc6a2d0e-50e0-4614-9bd2-2ce1c32cb6d2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:19:04 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-e2470a2f-c88a-4c53-a1c9-79f207e8d40f tempest-CreateVolumesFromSnapshotTest-1194706465 None] Acquiring lock "cinder-quobyte-4e5a92de-c6c0-4eea-8d57-1b249056f2ef" by "delete_snapshot" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:19:04 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-e2470a2f-c88a-4c53-a1c9-79f207e8d40f tempest-CreateVolumesFromSnapshotTest-1194706465 None] Lock "cinder-quobyte-4e5a92de-c6c0-4eea-8d57-1b249056f2ef" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:19:04 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-e2470a2f-c88a-4c53-a1c9-79f207e8d40f tempest-CreateVolumesFromSnapshotTest-1194706465 None] Acquiring lock "cinder-quobyte-bc6a2d0e-50e0-4614-9bd2-2ce1c32cb6d2" by "_delete_snapshot" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:19:04 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-e2470a2f-c88a-4c53-a1c9-79f207e8d40f tempest-CreateVolumesFromSnapshotTest-1194706465 None] Lock "cinder-quobyte-bc6a2d0e-50e0-4614-9bd2-2ce1c32cb6d2" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:19:04 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-e2470a2f-c88a-4c53-a1c9-79f207e8d40f tempest-CreateVolumesFromSnapshotTest-1194706465 None] Deleting offline snapshot bc6a2d0e-50e0-4614-9bd2-2ce1c32cb6d2 of volume 4e5a92de-c6c0-4eea-8d57-1b249056f2ef {{(pid=83345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 10 13:19:04 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-e2470a2f-c88a-4c53-a1c9-79f207e8d40f tempest-CreateVolumesFromSnapshotTest-1194706465 None] snapshot_file for this snap is: volume-4e5a92de-c6c0-4eea-8d57-1b249056f2ef.bc6a2d0e-50e0-4614-9bd2-2ce1c32cb6d2 {{(pid=83345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 10 13:19:04 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b7d6b9d-b79e-430d-adc1-7dcb14702c24]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:19:04 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-e2470a2f-c88a-4c53-a1c9-79f207e8d40f tempest-CreateVolumesFromSnapshotTest-1194706465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4e5a92de-c6c0-4eea-8d57-1b249056f2ef.bc6a2d0e-50e0-4614-9bd2-2ce1c32cb6d2 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:19:04 devstack sudo[90435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4e5a92de-c6c0-4eea-8d57-1b249056f2ef.bc6a2d0e-50e0-4614-9bd2-2ce1c32cb6d2
Apr 10 13:19:04 devstack sudo[90435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:19:04 devstack sudo[90433]: pam_unix(sudo:session): session closed for user root
Apr 10 13:19:04 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-f747bda1-e9a5-49e7-89b1-151fdee07f89 tempest-CreateVolumesFromSnapshotTest-1194706465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.418s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:19:04 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-f747bda1-e9a5-49e7-89b1-151fdee07f89 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:19:04 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-f747bda1-e9a5-49e7-89b1-151fdee07f89 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Deleted volume successfully.
Apr 10 13:19:04 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-f747bda1-e9a5-49e7-89b1-151fdee07f89 tempest-CreateVolumesFromSnapshotTest-1194706465 None] Lock "cinder-01ff1a7a-36c8-4855-9a67-40b773cf2449-delete_volume" released by "delete_volume" :: held 1.424s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:19:04 devstack sudo[90435]: pam_unix(sudo:session): session closed for user root
Apr 10 13:19:04 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-e2470a2f-c88a-4c53-a1c9-79f207e8d40f tempest-CreateVolumesFromSnapshotTest-1194706465 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4e5a92de-c6c0-4eea-8d57-1b249056f2ef.bc6a2d0e-50e0-4614-9bd2-2ce1c32cb6d2" returned: 0 in 0.480s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:19:04 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-e2470a2f-c88a-4c53-a1c9-79f207e8d40f tempest-CreateVolumesFromSnapshotTest-1194706465 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4e5a92de-c6c0-4eea-8d57-1b249056f2ef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 13:19:04 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a992ef6-30d6-409e-8089-13af2bb19772]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:19:04 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-e2470a2f-c88a-4c53-a1c9-79f207e8d40f tempest-CreateVolumesFromSnapshotTest-1194706465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4e5a92de-c6c0-4eea-8d57-1b249056f2ef {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:19:04 devstack sudo[90441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4e5a92de-c6c0-4eea-8d57-1b249056f2ef
Apr 10 13:19:04 devstack sudo[90441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:19:05 devstack sudo[90441]: pam_unix(sudo:session): session closed for user root
Apr 10 13:19:05 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-e2470a2f-c88a-4c53-a1c9-79f207e8d40f tempest-CreateVolumesFromSnapshotTest-1194706465 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4e5a92de-c6c0-4eea-8d57-1b249056f2ef" returned: 0 in 0.450s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:19:05 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-e2470a2f-c88a-4c53-a1c9-79f207e8d40f tempest-CreateVolumesFromSnapshotTest-1194706465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4e5a92de-c6c0-4eea-8d57-1b249056f2ef.bc6a2d0e-50e0-4614-9bd2-2ce1c32cb6d2 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:19:05 devstack sudo[90446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4e5a92de-c6c0-4eea-8d57-1b249056f2ef.bc6a2d0e-50e0-4614-9bd2-2ce1c32cb6d2
Apr 10 13:19:05 devstack sudo[90446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:19:05 devstack sudo[90446]: pam_unix(sudo:session): session closed for user root
Apr 10 13:19:05 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-e2470a2f-c88a-4c53-a1c9-79f207e8d40f tempest-CreateVolumesFromSnapshotTest-1194706465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4e5a92de-c6c0-4eea-8d57-1b249056f2ef.bc6a2d0e-50e0-4614-9bd2-2ce1c32cb6d2" returned: 0 in 0.441s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:19:05 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-e2470a2f-c88a-4c53-a1c9-79f207e8d40f tempest-CreateVolumesFromSnapshotTest-1194706465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4e5a92de-c6c0-4eea-8d57-1b249056f2ef.bc6a2d0e-50e0-4614-9bd2-2ce1c32cb6d2 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:19:05 devstack sudo[90451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4e5a92de-c6c0-4eea-8d57-1b249056f2ef.bc6a2d0e-50e0-4614-9bd2-2ce1c32cb6d2
Apr 10 13:19:05 devstack sudo[90451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:19:05 devstack sudo[90451]: pam_unix(sudo:session): session closed for user root
Apr 10 13:19:05 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-e2470a2f-c88a-4c53-a1c9-79f207e8d40f tempest-CreateVolumesFromSnapshotTest-1194706465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4e5a92de-c6c0-4eea-8d57-1b249056f2ef.bc6a2d0e-50e0-4614-9bd2-2ce1c32cb6d2" returned: 0 in 0.407s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:19:06 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-e2470a2f-c88a-4c53-a1c9-79f207e8d40f tempest-CreateVolumesFromSnapshotTest-1194706465 None] Lock "cinder-quobyte-bc6a2d0e-50e0-4614-9bd2-2ce1c32cb6d2" released by "_delete_snapshot" :: held 1.829s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:19:06 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-e2470a2f-c88a-4c53-a1c9-79f207e8d40f tempest-CreateVolumesFromSnapshotTest-1194706465 None] Lock "cinder-quobyte-4e5a92de-c6c0-4eea-8d57-1b249056f2ef" released by "delete_snapshot" :: held 1.845s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:19:06 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-e2470a2f-c88a-4c53-a1c9-79f207e8d40f tempest-CreateVolumesFromSnapshotTest-1194706465 None] Created reservations ['4fec8beb-f34a-4b50-b14b-4812a6ed7921', '1781e874-4c52-44ff-aedd-bb0dba16fe52', '11d8cc9f-f380-46e4-b5a7-8f6a83d52717', '67ceda69-d935-454d-9815-a35aced5cf4c'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:19:06 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-e2470a2f-c88a-4c53-a1c9-79f207e8d40f tempest-CreateVolumesFromSnapshotTest-1194706465 None] Delete snapshot completed successfully.
Apr 10 13:19:06 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-e2470a2f-c88a-4c53-a1c9-79f207e8d40f tempest-CreateVolumesFromSnapshotTest-1194706465 None] Lock "cinder-bc6a2d0e-50e0-4614-9bd2-2ce1c32cb6d2-delete_snapshot" released by "delete_snapshot" :: held 1.924s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:19:06 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-224dfd72-ef59-41a8-b785-60d82055cd5d tempest-CreateVolumesFromSnapshotTest-1194706465 None] Acquiring lock "cinder-4e5a92de-c6c0-4eea-8d57-1b249056f2ef-delete_volume" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:19:06 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-224dfd72-ef59-41a8-b785-60d82055cd5d tempest-CreateVolumesFromSnapshotTest-1194706465 None] Lock "cinder-4e5a92de-c6c0-4eea-8d57-1b249056f2ef-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:19:06 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-224dfd72-ef59-41a8-b785-60d82055cd5d tempest-CreateVolumesFromSnapshotTest-1194706465 None] Acquiring lock "cinder-quobyte-4e5a92de-c6c0-4eea-8d57-1b249056f2ef" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:19:06 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-224dfd72-ef59-41a8-b785-60d82055cd5d tempest-CreateVolumesFromSnapshotTest-1194706465 None] Lock "cinder-quobyte-4e5a92de-c6c0-4eea-8d57-1b249056f2ef" acquired by "delete_volume" :: waited 0.007s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:19:06 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef9fd4ab-ae7d-43b5-af24-23e22aa3e207]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:19:06 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-224dfd72-ef59-41a8-b785-60d82055cd5d tempest-CreateVolumesFromSnapshotTest-1194706465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4e5a92de-c6c0-4eea-8d57-1b249056f2ef {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:19:06 devstack sudo[90454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4e5a92de-c6c0-4eea-8d57-1b249056f2ef
Apr 10 13:19:06 devstack sudo[90454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:19:06 devstack sudo[90454]: pam_unix(sudo:session): session closed for user root
Apr 10 13:19:06 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-224dfd72-ef59-41a8-b785-60d82055cd5d tempest-CreateVolumesFromSnapshotTest-1194706465 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4e5a92de-c6c0-4eea-8d57-1b249056f2ef" returned: 0 in 0.465s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:19:06 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-224dfd72-ef59-41a8-b785-60d82055cd5d tempest-CreateVolumesFromSnapshotTest-1194706465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4e5a92de-c6c0-4eea-8d57-1b249056f2ef {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:19:06 devstack sudo[90459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4e5a92de-c6c0-4eea-8d57-1b249056f2ef
Apr 10 13:19:06 devstack sudo[90459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:19:07 devstack sudo[90459]: pam_unix(sudo:session): session closed for user root
Apr 10 13:19:07 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-224dfd72-ef59-41a8-b785-60d82055cd5d tempest-CreateVolumesFromSnapshotTest-1194706465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4e5a92de-c6c0-4eea-8d57-1b249056f2ef" returned: 0 in 0.414s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:19:07 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-224dfd72-ef59-41a8-b785-60d82055cd5d tempest-CreateVolumesFromSnapshotTest-1194706465 None] Lock "cinder-quobyte-4e5a92de-c6c0-4eea-8d57-1b249056f2ef" released by "delete_volume" :: held 0.916s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:19:07 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-224dfd72-ef59-41a8-b785-60d82055cd5d tempest-CreateVolumesFromSnapshotTest-1194706465 None] Created reservations ['669ffdee-0444-4ba6-b86d-9b9aa298062f', 'd460e356-38b9-41ae-bbeb-305f4a324fa6', 'abe648a8-81d3-4f95-bde5-3120b90b91e6', '63753bdc-ccea-4e44-b543-abcd262fe711'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:19:07 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-224dfd72-ef59-41a8-b785-60d82055cd5d tempest-CreateVolumesFromSnapshotTest-1194706465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:19:07 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-224dfd72-ef59-41a8-b785-60d82055cd5d tempest-CreateVolumesFromSnapshotTest-1194706465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:19:07 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-224dfd72-ef59-41a8-b785-60d82055cd5d tempest-CreateVolumesFromSnapshotTest-1194706465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:19:07 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-224dfd72-ef59-41a8-b785-60d82055cd5d tempest-CreateVolumesFromSnapshotTest-1194706465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:19:07 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-224dfd72-ef59-41a8-b785-60d82055cd5d tempest-CreateVolumesFromSnapshotTest-1194706465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:19:07 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-224dfd72-ef59-41a8-b785-60d82055cd5d tempest-CreateVolumesFromSnapshotTest-1194706465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:19:07 devstack sudo[90462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:19:07 devstack sudo[90462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:19:07 devstack sudo[90462]: pam_unix(sudo:session): session closed for user root
Apr 10 13:19:07 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-224dfd72-ef59-41a8-b785-60d82055cd5d tempest-CreateVolumesFromSnapshotTest-1194706465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.446s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:19:07 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-224dfd72-ef59-41a8-b785-60d82055cd5d tempest-CreateVolumesFromSnapshotTest-1194706465 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:19:07 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-224dfd72-ef59-41a8-b785-60d82055cd5d tempest-CreateVolumesFromSnapshotTest-1194706465 None] Deleted volume successfully.
Apr 10 13:19:07 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-224dfd72-ef59-41a8-b785-60d82055cd5d tempest-CreateVolumesFromSnapshotTest-1194706465 None] Lock "cinder-4e5a92de-c6c0-4eea-8d57-1b249056f2ef-delete_volume" released by "delete_volume" :: held 1.486s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:19:08 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-cca57a88-ea10-445e-96d1-bf24a513fd72 tempest-VolumeDependencyTests-784302238 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:19:08 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-cca57a88-ea10-445e-96d1-bf24a513fd72 tempest-VolumeDependencyTests-784302238 None] Flow 'volume_create_manager' (e787aa47-fb6a-4c51-867a-3349b08d7c51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:19:08 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-cca57a88-ea10-445e-96d1-bf24a513fd72 tempest-VolumeDependencyTests-784302238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef6d99b4-9fa0-4878-8b20-b8c1e6b25277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:19:09 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-cca57a88-ea10-445e-96d1-bf24a513fd72 tempest-VolumeDependencyTests-784302238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef6d99b4-9fa0-4878-8b20-b8c1e6b25277) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:19:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2058927607',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7130a304-8b22-4ed6-978e-138f8949ef91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e66e2b1a9624b009e0657c059985482',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:19:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:19:09Z,use_quota=True,user_id='b4f60d7d21c0405f8ab4a1ae4e2e4389',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:19:09 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-cca57a88-ea10-445e-96d1-bf24a513fd72 tempest-VolumeDependencyTests-784302238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb5363fb-3da7-4bb6-b37f-e8245f96038d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:19:09 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-cca57a88-ea10-445e-96d1-bf24a513fd72 tempest-VolumeDependencyTests-784302238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb5363fb-3da7-4bb6-b37f-e8245f96038d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:19:09 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-cca57a88-ea10-445e-96d1-bf24a513fd72 tempest-VolumeDependencyTests-784302238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee0680ed-9431-4985-9ee3-3179bcfdde7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:19:09 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-cca57a88-ea10-445e-96d1-bf24a513fd72 tempest-VolumeDependencyTests-784302238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee0680ed-9431-4985-9ee3-3179bcfdde7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7130a304-8b22-4ed6-978e-138f8949ef91', 'volume_name': 'volume-7130a304-8b22-4ed6-978e-138f8949ef91', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:19:09 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-cca57a88-ea10-445e-96d1-bf24a513fd72 tempest-VolumeDependencyTests-784302238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99a15d74-e0d0-4d19-9281-6556d7535a21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:19:09 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-cca57a88-ea10-445e-96d1-bf24a513fd72 tempest-VolumeDependencyTests-784302238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99a15d74-e0d0-4d19-9281-6556d7535a21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:19:09 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-cca57a88-ea10-445e-96d1-bf24a513fd72 tempest-VolumeDependencyTests-784302238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87b7f725-b708-4f2e-9714-2d62313fd8af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:19:09 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-cca57a88-ea10-445e-96d1-bf24a513fd72 tempest-VolumeDependencyTests-784302238 None] Volume 7130a304-8b22-4ed6-978e-138f8949ef91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7130a304-8b22-4ed6-978e-138f8949ef91', 'volume_size': 1}
Apr 10 13:19:09 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-cca57a88-ea10-445e-96d1-bf24a513fd72 tempest-VolumeDependencyTests-784302238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:19:09 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-cca57a88-ea10-445e-96d1-bf24a513fd72 tempest-VolumeDependencyTests-784302238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:19:09 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-cca57a88-ea10-445e-96d1-bf24a513fd72 tempest-VolumeDependencyTests-784302238 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f252bf08b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:19:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2058927607',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7130a304-8b22-4ed6-978e-138f8949ef91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e66e2b1a9624b009e0657c059985482',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:19:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:19:09Z,use_quota=True,user_id='b4f60d7d21c0405f8ab4a1ae4e2e4389',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)}" {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 13:19:09 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-cca57a88-ea10-445e-96d1-bf24a513fd72 tempest-VolumeDependencyTests-784302238 None] Creating volume 7130a304-8b22-4ed6-978e-138f8949ef91 {{(pid=83345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 13:19:09 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-cca57a88-ea10-445e-96d1-bf24a513fd72 tempest-VolumeDependencyTests-784302238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:19:09 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-cca57a88-ea10-445e-96d1-bf24a513fd72 tempest-VolumeDependencyTests-784302238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:19:09 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-cca57a88-ea10-445e-96d1-bf24a513fd72 tempest-VolumeDependencyTests-784302238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:19:09 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-cca57a88-ea10-445e-96d1-bf24a513fd72 tempest-VolumeDependencyTests-784302238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:19:09 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-cca57a88-ea10-445e-96d1-bf24a513fd72 tempest-VolumeDependencyTests-784302238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:19:09 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-cca57a88-ea10-445e-96d1-bf24a513fd72 tempest-VolumeDependencyTests-784302238 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:19:09 devstack cinder-volume[83345]: INFO cinder.volume.drivers.remotefs [None req-cca57a88-ea10-445e-96d1-bf24a513fd72 tempest-VolumeDependencyTests-784302238 None] casted to osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331
Apr 10 13:19:09 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-cca57a88-ea10-445e-96d1-bf24a513fd72 tempest-VolumeDependencyTests-784302238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7130a304-8b22-4ed6-978e-138f8949ef91 1073741824 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:19:09 devstack sudo[90466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7130a304-8b22-4ed6-978e-138f8949ef91 1073741824
Apr 10 13:19:09 devstack sudo[90466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:19:09 devstack sudo[90466]: pam_unix(sudo:session): session closed for user root
Apr 10 13:19:09 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-cca57a88-ea10-445e-96d1-bf24a513fd72 tempest-VolumeDependencyTests-784302238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7130a304-8b22-4ed6-978e-138f8949ef91 1073741824" returned: 0 in 0.463s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:19:09 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-cca57a88-ea10-445e-96d1-bf24a513fd72 tempest-VolumeDependencyTests-784302238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7130a304-8b22-4ed6-978e-138f8949ef91 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:19:09 devstack sudo[90471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7130a304-8b22-4ed6-978e-138f8949ef91
Apr 10 13:19:09 devstack sudo[90471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:19:09 devstack sudo[90471]: pam_unix(sudo:session): session closed for user root
Apr 10 13:19:09 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-cca57a88-ea10-445e-96d1-bf24a513fd72 tempest-VolumeDependencyTests-784302238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7130a304-8b22-4ed6-978e-138f8949ef91" returned: 0 in 0.394s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:19:09 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-cca57a88-ea10-445e-96d1-bf24a513fd72 tempest-VolumeDependencyTests-784302238 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'} {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 13:19:09 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-cca57a88-ea10-445e-96d1-bf24a513fd72 tempest-VolumeDependencyTests-784302238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:19:09 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-cca57a88-ea10-445e-96d1-bf24a513fd72 tempest-VolumeDependencyTests-784302238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87b7f725-b708-4f2e-9714-2d62313fd8af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7130a304-8b22-4ed6-978e-138f8949ef91', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:19:09 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-cca57a88-ea10-445e-96d1-bf24a513fd72 tempest-VolumeDependencyTests-784302238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (802e31cc-cd0a-4281-b1ae-c86bb8e3961f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:19:09 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-cca57a88-ea10-445e-96d1-bf24a513fd72 tempest-VolumeDependencyTests-784302238 None] Volume volume-7130a304-8b22-4ed6-978e-138f8949ef91 (7130a304-8b22-4ed6-978e-138f8949ef91): created successfully
Apr 10 13:19:09 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-cca57a88-ea10-445e-96d1-bf24a513fd72 tempest-VolumeDependencyTests-784302238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (802e31cc-cd0a-4281-b1ae-c86bb8e3961f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:19:09 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-cca57a88-ea10-445e-96d1-bf24a513fd72 tempest-VolumeDependencyTests-784302238 None] Flow 'volume_create_manager' (e787aa47-fb6a-4c51-867a-3349b08d7c51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:19:09 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-cca57a88-ea10-445e-96d1-bf24a513fd72 tempest-VolumeDependencyTests-784302238 None] Created volume successfully.
Apr 10 13:19:10 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-e84064a7-a675-4650-aa2f-506ae6b82e4c tempest-VolumeDependencyTests-784302238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:19:10 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-e84064a7-a675-4650-aa2f-506ae6b82e4c tempest-VolumeDependencyTests-784302238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:19:10 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-e84064a7-a675-4650-aa2f-506ae6b82e4c tempest-VolumeDependencyTests-784302238 None] Creating offline snapshot aabec8bd-00a3-4bcd-9605-bf4826bbc088 of volume 7130a304-8b22-4ed6-978e-138f8949ef91 {{(pid=83345) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 10 13:19:10 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[27fd7ac6-4b1b-4649-a85b-19d83d434349]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:19:10 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-e84064a7-a675-4650-aa2f-506ae6b82e4c tempest-VolumeDependencyTests-784302238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7130a304-8b22-4ed6-978e-138f8949ef91 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:19:10 devstack sudo[90474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7130a304-8b22-4ed6-978e-138f8949ef91
Apr 10 13:19:10 devstack sudo[90474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:19:10 devstack sudo[90474]: pam_unix(sudo:session): session closed for user root
Apr 10 13:19:10 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-e84064a7-a675-4650-aa2f-506ae6b82e4c tempest-VolumeDependencyTests-784302238 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7130a304-8b22-4ed6-978e-138f8949ef91" returned: 0 in 0.459s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:19:10 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-e84064a7-a675-4650-aa2f-506ae6b82e4c tempest-VolumeDependencyTests-784302238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7130a304-8b22-4ed6-978e-138f8949ef91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7130a304-8b22-4ed6-978e-138f8949ef91.aabec8bd-00a3-4bcd-9605-bf4826bbc088 1G {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:19:10 devstack sudo[90479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7130a304-8b22-4ed6-978e-138f8949ef91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7130a304-8b22-4ed6-978e-138f8949ef91.aabec8bd-00a3-4bcd-9605-bf4826bbc088 1G
Apr 10 13:19:10 devstack sudo[90479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:19:11 devstack sudo[90479]: pam_unix(sudo:session): session closed for user root
Apr 10 13:19:11 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-e84064a7-a675-4650-aa2f-506ae6b82e4c tempest-VolumeDependencyTests-784302238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7130a304-8b22-4ed6-978e-138f8949ef91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7130a304-8b22-4ed6-978e-138f8949ef91.aabec8bd-00a3-4bcd-9605-bf4826bbc088 1G" returned: 0 in 0.465s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:19:11 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-e84064a7-a675-4650-aa2f-506ae6b82e4c tempest-VolumeDependencyTests-784302238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7130a304-8b22-4ed6-978e-138f8949ef91 -F qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7130a304-8b22-4ed6-978e-138f8949ef91.aabec8bd-00a3-4bcd-9605-bf4826bbc088 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:19:11 devstack sudo[90485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7130a304-8b22-4ed6-978e-138f8949ef91 -F qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7130a304-8b22-4ed6-978e-138f8949ef91.aabec8bd-00a3-4bcd-9605-bf4826bbc088
Apr 10 13:19:11 devstack sudo[90485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:19:11 devstack sudo[90485]: pam_unix(sudo:session): session closed for user root
Apr 10 13:19:11 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-e84064a7-a675-4650-aa2f-506ae6b82e4c tempest-VolumeDependencyTests-784302238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7130a304-8b22-4ed6-978e-138f8949ef91 -F qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7130a304-8b22-4ed6-978e-138f8949ef91.aabec8bd-00a3-4bcd-9605-bf4826bbc088" returned: 0 in 0.438s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:19:11 devstack cinder-volume[83345]: WARNING cinder.volume.drivers.remotefs [None req-e84064a7-a675-4650-aa2f-506ae6b82e4c tempest-VolumeDependencyTests-784302238 None] /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7130a304-8b22-4ed6-978e-138f8949ef91.aabec8bd-00a3-4bcd-9605-bf4826bbc088 is being set with open permissions: ugo+rw
Apr 10 13:19:11 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-e84064a7-a675-4650-aa2f-506ae6b82e4c tempest-VolumeDependencyTests-784302238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7130a304-8b22-4ed6-978e-138f8949ef91.aabec8bd-00a3-4bcd-9605-bf4826bbc088 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:19:11 devstack sudo[90491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7130a304-8b22-4ed6-978e-138f8949ef91.aabec8bd-00a3-4bcd-9605-bf4826bbc088
Apr 10 13:19:11 devstack sudo[90491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:19:11 devstack sudo[90491]: pam_unix(sudo:session): session closed for user root
Apr 10 13:19:11 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-e84064a7-a675-4650-aa2f-506ae6b82e4c tempest-VolumeDependencyTests-784302238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7130a304-8b22-4ed6-978e-138f8949ef91.aabec8bd-00a3-4bcd-9605-bf4826bbc088" returned: 0 in 0.433s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:19:11 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-e84064a7-a675-4650-aa2f-506ae6b82e4c tempest-VolumeDependencyTests-784302238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7130a304-8b22-4ed6-978e-138f8949ef91.info {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:19:11 devstack sudo[90494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7130a304-8b22-4ed6-978e-138f8949ef91.info
Apr 10 13:19:11 devstack sudo[90494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:19:12 devstack sudo[90494]: pam_unix(sudo:session): session closed for user root
Apr 10 13:19:12 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-e84064a7-a675-4650-aa2f-506ae6b82e4c tempest-VolumeDependencyTests-784302238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7130a304-8b22-4ed6-978e-138f8949ef91.info" returned: 0 in 0.443s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:19:12 devstack cinder-volume[83345]: WARNING cinder.volume.drivers.remotefs [None req-e84064a7-a675-4650-aa2f-506ae6b82e4c tempest-VolumeDependencyTests-784302238 None] /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7130a304-8b22-4ed6-978e-138f8949ef91.info is being set with open permissions: ugo+rw
Apr 10 13:19:12 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-e84064a7-a675-4650-aa2f-506ae6b82e4c tempest-VolumeDependencyTests-784302238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7130a304-8b22-4ed6-978e-138f8949ef91.info {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:19:12 devstack sudo[90497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7130a304-8b22-4ed6-978e-138f8949ef91.info
Apr 10 13:19:12 devstack sudo[90497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:19:12 devstack sudo[90497]: pam_unix(sudo:session): session closed for user root
Apr 10 13:19:12 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-e84064a7-a675-4650-aa2f-506ae6b82e4c tempest-VolumeDependencyTests-784302238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7130a304-8b22-4ed6-978e-138f8949ef91.info" returned: 0 in 0.419s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:19:12 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-e84064a7-a675-4650-aa2f-506ae6b82e4c tempest-VolumeDependencyTests-784302238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.713s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:19:12 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-e84064a7-a675-4650-aa2f-506ae6b82e4c tempest-VolumeDependencyTests-784302238 None] Create snapshot completed successfully
Apr 10 13:19:13 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-54d6282c-337a-48f0-8103-10513f17b4cd tempest-VolumeDependencyTests-784302238 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:19:13 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-54d6282c-337a-48f0-8103-10513f17b4cd tempest-VolumeDependencyTests-784302238 None] Flow 'volume_create_manager' (deea1ccb-5f89-43ff-9efc-4e12a61ba281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:19:13 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-54d6282c-337a-48f0-8103-10513f17b4cd tempest-VolumeDependencyTests-784302238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b398a86-911c-4867-9626-5af577881403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:19:13 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-54d6282c-337a-48f0-8103-10513f17b4cd tempest-VolumeDependencyTests-784302238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b398a86-911c-4867-9626-5af577881403) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:19:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1886826388',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6503a79-17af-448d-90ba-42620a5c2b16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e66e2b1a9624b009e0657c059985482',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:19:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=aabec8bd-00a3-4bcd-9605-bf4826bbc088,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:19:13Z,use_quota=True,user_id='b4f60d7d21c0405f8ab4a1ae4e2e4389',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:19:13 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-54d6282c-337a-48f0-8103-10513f17b4cd tempest-VolumeDependencyTests-784302238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c960bf90-bb4a-4d69-8099-3790f43d3488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:19:13 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-54d6282c-337a-48f0-8103-10513f17b4cd tempest-VolumeDependencyTests-784302238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c960bf90-bb4a-4d69-8099-3790f43d3488) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:19:13 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-54d6282c-337a-48f0-8103-10513f17b4cd tempest-VolumeDependencyTests-784302238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bbd8302-5657-4bb6-ba68-d2f44636f500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:19:13 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-54d6282c-337a-48f0-8103-10513f17b4cd tempest-VolumeDependencyTests-784302238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bbd8302-5657-4bb6-ba68-d2f44636f500) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f6503a79-17af-448d-90ba-42620a5c2b16', 'volume_name': 'volume-f6503a79-17af-448d-90ba-42620a5c2b16', 'volume_size': 1, 'snapshot_id': 'aabec8bd-00a3-4bcd-9605-bf4826bbc088'}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:19:13 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-54d6282c-337a-48f0-8103-10513f17b4cd tempest-VolumeDependencyTests-784302238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aba691af-fe41-4078-bb9b-f91c045ea595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:19:13 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-54d6282c-337a-48f0-8103-10513f17b4cd tempest-VolumeDependencyTests-784302238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aba691af-fe41-4078-bb9b-f91c045ea595) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:19:13 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-54d6282c-337a-48f0-8103-10513f17b4cd tempest-VolumeDependencyTests-784302238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6626c5ca-83fa-4503-91e7-0f5f242a89e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:19:13 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-54d6282c-337a-48f0-8103-10513f17b4cd tempest-VolumeDependencyTests-784302238 None] Volume f6503a79-17af-448d-90ba-42620a5c2b16: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f6503a79-17af-448d-90ba-42620a5c2b16', 'volume_size': 1, 'snapshot_id': 'aabec8bd-00a3-4bcd-9605-bf4826bbc088'}
Apr 10 13:19:13 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-54d6282c-337a-48f0-8103-10513f17b4cd tempest-VolumeDependencyTests-784302238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:19:13 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-54d6282c-337a-48f0-8103-10513f17b4cd tempest-VolumeDependencyTests-784302238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:19:13 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-54d6282c-337a-48f0-8103-10513f17b4cd tempest-VolumeDependencyTests-784302238 None] Acquiring lock "cinder-quobyte-aabec8bd-00a3-4bcd-9605-bf4826bbc088-f6503a79-17af-448d-90ba-42620a5c2b16" by "_create_volume_from_snapshot" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:19:13 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-54d6282c-337a-48f0-8103-10513f17b4cd tempest-VolumeDependencyTests-784302238 None] Lock "cinder-quobyte-aabec8bd-00a3-4bcd-9605-bf4826bbc088-f6503a79-17af-448d-90ba-42620a5c2b16" acquired by "_create_volume_from_snapshot" :: waited 0.009s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:19:13 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-54d6282c-337a-48f0-8103-10513f17b4cd tempest-VolumeDependencyTests-784302238 None] Creating volume f6503a79-17af-448d-90ba-42620a5c2b16 from snapshot aabec8bd-00a3-4bcd-9605-bf4826bbc088 {{(pid=83345) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 10 13:19:13 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-54d6282c-337a-48f0-8103-10513f17b4cd tempest-VolumeDependencyTests-784302238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:19:13 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-54d6282c-337a-48f0-8103-10513f17b4cd tempest-VolumeDependencyTests-784302238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:19:13 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-54d6282c-337a-48f0-8103-10513f17b4cd tempest-VolumeDependencyTests-784302238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:19:13 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-54d6282c-337a-48f0-8103-10513f17b4cd tempest-VolumeDependencyTests-784302238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:19:13 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-54d6282c-337a-48f0-8103-10513f17b4cd tempest-VolumeDependencyTests-784302238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:19:13 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-54d6282c-337a-48f0-8103-10513f17b4cd tempest-VolumeDependencyTests-784302238 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:19:13 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-54d6282c-337a-48f0-8103-10513f17b4cd tempest-VolumeDependencyTests-784302238 None] Acquiring lock "cinder-quobyte-f6503a79-17af-448d-90ba-42620a5c2b16" by "_copy_volume_from_snapshot" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:19:13 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-54d6282c-337a-48f0-8103-10513f17b4cd tempest-VolumeDependencyTests-784302238 None] Lock "cinder-quobyte-f6503a79-17af-448d-90ba-42620a5c2b16" acquired by "_copy_volume_from_snapshot" :: waited 0.007s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:19:13 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-54d6282c-337a-48f0-8103-10513f17b4cd tempest-VolumeDependencyTests-784302238 None] snapshot: aabec8bd-00a3-4bcd-9605-bf4826bbc088, volume: f6503a79-17af-448d-90ba-42620a5c2b16,  {{(pid=83345) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 10 13:19:13 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-54d6282c-337a-48f0-8103-10513f17b4cd tempest-VolumeDependencyTests-784302238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:19:13 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-54d6282c-337a-48f0-8103-10513f17b4cd tempest-VolumeDependencyTests-784302238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:19:13 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-54d6282c-337a-48f0-8103-10513f17b4cd tempest-VolumeDependencyTests-784302238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:19:13 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-54d6282c-337a-48f0-8103-10513f17b4cd tempest-VolumeDependencyTests-784302238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:19:13 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-54d6282c-337a-48f0-8103-10513f17b4cd tempest-VolumeDependencyTests-784302238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.002s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:19:13 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[9561485b-c11b-4d2f-9bfc-a491df36d4cc]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:19:13 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-54d6282c-337a-48f0-8103-10513f17b4cd tempest-VolumeDependencyTests-784302238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7130a304-8b22-4ed6-978e-138f8949ef91.aabec8bd-00a3-4bcd-9605-bf4826bbc088 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:19:13 devstack sudo[90500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7130a304-8b22-4ed6-978e-138f8949ef91.aabec8bd-00a3-4bcd-9605-bf4826bbc088
Apr 10 13:19:13 devstack sudo[90500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:19:14 devstack sudo[90500]: pam_unix(sudo:session): session closed for user root
Apr 10 13:19:14 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-54d6282c-337a-48f0-8103-10513f17b4cd tempest-VolumeDependencyTests-784302238 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7130a304-8b22-4ed6-978e-138f8949ef91.aabec8bd-00a3-4bcd-9605-bf4826bbc088" returned: 0 in 0.457s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:19:14 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-54d6282c-337a-48f0-8103-10513f17b4cd tempest-VolumeDependencyTests-784302238 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7130a304-8b22-4ed6-978e-138f8949ef91(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 13:19:14 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-54d6282c-337a-48f0-8103-10513f17b4cd tempest-VolumeDependencyTests-784302238 None] will copy from snapshot at /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7130a304-8b22-4ed6-978e-138f8949ef91 {{(pid=83345) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 10 13:19:14 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-54d6282c-337a-48f0-8103-10513f17b4cd tempest-VolumeDependencyTests-784302238 None] Creating direct copy from snapshot {{(pid=83345) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 10 13:19:14 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb696703-0b64-4bdc-901e-afe4e02821b4]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:19:14 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-54d6282c-337a-48f0-8103-10513f17b4cd tempest-VolumeDependencyTests-784302238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7130a304-8b22-4ed6-978e-138f8949ef91 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:19:14 devstack sudo[90505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7130a304-8b22-4ed6-978e-138f8949ef91
Apr 10 13:19:14 devstack sudo[90505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:19:14 devstack sudo[90505]: pam_unix(sudo:session): session closed for user root
Apr 10 13:19:14 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-54d6282c-337a-48f0-8103-10513f17b4cd tempest-VolumeDependencyTests-784302238 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7130a304-8b22-4ed6-978e-138f8949ef91" returned: 0 in 0.510s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:19:14 devstack cinder-volume[83345]: DEBUG cinder.utils [None req-54d6282c-337a-48f0-8103-10513f17b4cd tempest-VolumeDependencyTests-784302238 None] Path /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-f6503a79-17af-448d-90ba-42620a5c2b16 not found in is_blk_device check {{(pid=83345) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 10 13:19:14 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-54d6282c-337a-48f0-8103-10513f17b4cd tempest-VolumeDependencyTests-784302238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7130a304-8b22-4ed6-978e-138f8949ef91 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-f6503a79-17af-448d-90ba-42620a5c2b16 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:19:14 devstack sudo[90510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7130a304-8b22-4ed6-978e-138f8949ef91 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-f6503a79-17af-448d-90ba-42620a5c2b16
Apr 10 13:19:14 devstack sudo[90510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:19:16 devstack sudo[90510]: pam_unix(sudo:session): session closed for user root
Apr 10 13:19:16 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-54d6282c-337a-48f0-8103-10513f17b4cd tempest-VolumeDependencyTests-784302238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7130a304-8b22-4ed6-978e-138f8949ef91 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-f6503a79-17af-448d-90ba-42620a5c2b16" returned: 0 in 1.976s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:19:16 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[79aa2cea-2927-4aa3-9a60-bf5de51aad8d]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:19:16 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-54d6282c-337a-48f0-8103-10513f17b4cd tempest-VolumeDependencyTests-784302238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7130a304-8b22-4ed6-978e-138f8949ef91 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:19:16 devstack sudo[90522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7130a304-8b22-4ed6-978e-138f8949ef91
Apr 10 13:19:16 devstack sudo[90522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:19:17 devstack sudo[90522]: pam_unix(sudo:session): session closed for user root
Apr 10 13:19:17 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-54d6282c-337a-48f0-8103-10513f17b4cd tempest-VolumeDependencyTests-784302238 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7130a304-8b22-4ed6-978e-138f8949ef91" returned: 0 in 0.578s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:19:17 devstack cinder-volume[83345]: DEBUG cinder.image.image_utils [None req-54d6282c-337a-48f0-8103-10513f17b4cd tempest-VolumeDependencyTests-784302238 None] Image conversion details: src /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7130a304-8b22-4ed6-978e-138f8949ef91, size 1024.00 MB, duration 1.98 sec, destination /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-f6503a79-17af-448d-90ba-42620a5c2b16 {{(pid=83345) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 10 13:19:17 devstack cinder-volume[83345]: INFO cinder.image.image_utils [None req-54d6282c-337a-48f0-8103-10513f17b4cd tempest-VolumeDependencyTests-784302238 None] Converted 1024.00 MB image at 517.92 MB/s
Apr 10 13:19:17 devstack cinder-volume[83345]: WARNING cinder.volume.drivers.remotefs [None req-54d6282c-337a-48f0-8103-10513f17b4cd tempest-VolumeDependencyTests-784302238 None] /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-f6503a79-17af-448d-90ba-42620a5c2b16 is being set with open permissions: ugo+rw
Apr 10 13:19:17 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-54d6282c-337a-48f0-8103-10513f17b4cd tempest-VolumeDependencyTests-784302238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-f6503a79-17af-448d-90ba-42620a5c2b16 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:19:17 devstack sudo[90527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-f6503a79-17af-448d-90ba-42620a5c2b16
Apr 10 13:19:17 devstack sudo[90527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:19:17 devstack sudo[90527]: pam_unix(sudo:session): session closed for user root
Apr 10 13:19:17 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-54d6282c-337a-48f0-8103-10513f17b4cd tempest-VolumeDependencyTests-784302238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-f6503a79-17af-448d-90ba-42620a5c2b16" returned: 0 in 0.411s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:19:17 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-54d6282c-337a-48f0-8103-10513f17b4cd tempest-VolumeDependencyTests-784302238 None] Lock "cinder-quobyte-f6503a79-17af-448d-90ba-42620a5c2b16" released by "_copy_volume_from_snapshot" :: held 3.991s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:19:17 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-54d6282c-337a-48f0-8103-10513f17b4cd tempest-VolumeDependencyTests-784302238 None] Lock "cinder-quobyte-aabec8bd-00a3-4bcd-9605-bf4826bbc088-f6503a79-17af-448d-90ba-42620a5c2b16" released by "_create_volume_from_snapshot" :: held 4.008s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:19:17 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-54d6282c-337a-48f0-8103-10513f17b4cd tempest-VolumeDependencyTests-784302238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.017s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:19:17 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-54d6282c-337a-48f0-8103-10513f17b4cd tempest-VolumeDependencyTests-784302238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6626c5ca-83fa-4503-91e7-0f5f242a89e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6503a79-17af-448d-90ba-42620a5c2b16', 'volume_size': 1, 'snapshot_id': 'aabec8bd-00a3-4bcd-9605-bf4826bbc088'}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:19:17 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-54d6282c-337a-48f0-8103-10513f17b4cd tempest-VolumeDependencyTests-784302238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff8cb27f-3792-4ddf-a091-86e74f4dfabf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:19:17 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-54d6282c-337a-48f0-8103-10513f17b4cd tempest-VolumeDependencyTests-784302238 None] Volume volume-f6503a79-17af-448d-90ba-42620a5c2b16 (f6503a79-17af-448d-90ba-42620a5c2b16): created successfully
Apr 10 13:19:17 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-54d6282c-337a-48f0-8103-10513f17b4cd tempest-VolumeDependencyTests-784302238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff8cb27f-3792-4ddf-a091-86e74f4dfabf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:19:17 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-54d6282c-337a-48f0-8103-10513f17b4cd tempest-VolumeDependencyTests-784302238 None] Flow 'volume_create_manager' (deea1ccb-5f89-43ff-9efc-4e12a61ba281) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:19:17 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-54d6282c-337a-48f0-8103-10513f17b4cd tempest-VolumeDependencyTests-784302238 None] Created volume successfully.
Apr 10 13:19:17 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-32ee10f5-9367-4fab-b473-97ee6440a0f4 tempest-VolumeDependencyTests-784302238 None] Acquiring lock "cinder-aabec8bd-00a3-4bcd-9605-bf4826bbc088-delete_snapshot" by "delete_snapshot" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:19:17 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-32ee10f5-9367-4fab-b473-97ee6440a0f4 tempest-VolumeDependencyTests-784302238 None] Lock "cinder-aabec8bd-00a3-4bcd-9605-bf4826bbc088-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:19:17 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-32ee10f5-9367-4fab-b473-97ee6440a0f4 tempest-VolumeDependencyTests-784302238 None] Acquiring lock "cinder-quobyte-7130a304-8b22-4ed6-978e-138f8949ef91" by "delete_snapshot" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:19:17 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-32ee10f5-9367-4fab-b473-97ee6440a0f4 tempest-VolumeDependencyTests-784302238 None] Lock "cinder-quobyte-7130a304-8b22-4ed6-978e-138f8949ef91" acquired by "delete_snapshot" :: waited 0.007s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:19:17 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-32ee10f5-9367-4fab-b473-97ee6440a0f4 tempest-VolumeDependencyTests-784302238 None] Acquiring lock "cinder-quobyte-aabec8bd-00a3-4bcd-9605-bf4826bbc088" by "_delete_snapshot" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:19:17 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-32ee10f5-9367-4fab-b473-97ee6440a0f4 tempest-VolumeDependencyTests-784302238 None] Lock "cinder-quobyte-aabec8bd-00a3-4bcd-9605-bf4826bbc088" acquired by "_delete_snapshot" :: waited 0.005s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:19:17 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-32ee10f5-9367-4fab-b473-97ee6440a0f4 tempest-VolumeDependencyTests-784302238 None] Deleting offline snapshot aabec8bd-00a3-4bcd-9605-bf4826bbc088 of volume 7130a304-8b22-4ed6-978e-138f8949ef91 {{(pid=83345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 10 13:19:17 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-32ee10f5-9367-4fab-b473-97ee6440a0f4 tempest-VolumeDependencyTests-784302238 None] snapshot_file for this snap is: volume-7130a304-8b22-4ed6-978e-138f8949ef91.aabec8bd-00a3-4bcd-9605-bf4826bbc088 {{(pid=83345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 10 13:19:17 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[657d6101-eb54-4630-ab0b-c3b126d6ce26]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:19:17 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-32ee10f5-9367-4fab-b473-97ee6440a0f4 tempest-VolumeDependencyTests-784302238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7130a304-8b22-4ed6-978e-138f8949ef91.aabec8bd-00a3-4bcd-9605-bf4826bbc088 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:19:17 devstack sudo[90530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7130a304-8b22-4ed6-978e-138f8949ef91.aabec8bd-00a3-4bcd-9605-bf4826bbc088
Apr 10 13:19:17 devstack sudo[90530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:19:18 devstack sudo[90530]: pam_unix(sudo:session): session closed for user root
Apr 10 13:19:18 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-32ee10f5-9367-4fab-b473-97ee6440a0f4 tempest-VolumeDependencyTests-784302238 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7130a304-8b22-4ed6-978e-138f8949ef91.aabec8bd-00a3-4bcd-9605-bf4826bbc088" returned: 0 in 0.452s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:19:18 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-32ee10f5-9367-4fab-b473-97ee6440a0f4 tempest-VolumeDependencyTests-784302238 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7130a304-8b22-4ed6-978e-138f8949ef91(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 13:19:18 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7f8836a-35e1-424a-b892-69f9b83ae171]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:19:18 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-32ee10f5-9367-4fab-b473-97ee6440a0f4 tempest-VolumeDependencyTests-784302238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7130a304-8b22-4ed6-978e-138f8949ef91 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:19:18 devstack sudo[90535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7130a304-8b22-4ed6-978e-138f8949ef91
Apr 10 13:19:18 devstack sudo[90535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:19:18 devstack sudo[90535]: pam_unix(sudo:session): session closed for user root
Apr 10 13:19:18 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-32ee10f5-9367-4fab-b473-97ee6440a0f4 tempest-VolumeDependencyTests-784302238 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7130a304-8b22-4ed6-978e-138f8949ef91" returned: 0 in 0.463s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:19:18 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-32ee10f5-9367-4fab-b473-97ee6440a0f4 tempest-VolumeDependencyTests-784302238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7130a304-8b22-4ed6-978e-138f8949ef91.aabec8bd-00a3-4bcd-9605-bf4826bbc088 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:19:18 devstack sudo[90540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7130a304-8b22-4ed6-978e-138f8949ef91.aabec8bd-00a3-4bcd-9605-bf4826bbc088
Apr 10 13:19:18 devstack sudo[90540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:19:19 devstack sudo[90540]: pam_unix(sudo:session): session closed for user root
Apr 10 13:19:19 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-32ee10f5-9367-4fab-b473-97ee6440a0f4 tempest-VolumeDependencyTests-784302238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7130a304-8b22-4ed6-978e-138f8949ef91.aabec8bd-00a3-4bcd-9605-bf4826bbc088" returned: 0 in 0.453s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:19:19 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-32ee10f5-9367-4fab-b473-97ee6440a0f4 tempest-VolumeDependencyTests-784302238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7130a304-8b22-4ed6-978e-138f8949ef91.aabec8bd-00a3-4bcd-9605-bf4826bbc088 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:19:19 devstack sudo[90551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7130a304-8b22-4ed6-978e-138f8949ef91.aabec8bd-00a3-4bcd-9605-bf4826bbc088
Apr 10 13:19:19 devstack sudo[90551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:19:19 devstack sudo[90551]: pam_unix(sudo:session): session closed for user root
Apr 10 13:19:19 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-32ee10f5-9367-4fab-b473-97ee6440a0f4 tempest-VolumeDependencyTests-784302238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7130a304-8b22-4ed6-978e-138f8949ef91.aabec8bd-00a3-4bcd-9605-bf4826bbc088" returned: 0 in 0.404s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:19:19 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-32ee10f5-9367-4fab-b473-97ee6440a0f4 tempest-VolumeDependencyTests-784302238 None] Lock "cinder-quobyte-aabec8bd-00a3-4bcd-9605-bf4826bbc088" released by "_delete_snapshot" :: held 1.824s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:19:19 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-32ee10f5-9367-4fab-b473-97ee6440a0f4 tempest-VolumeDependencyTests-784302238 None] Lock "cinder-quobyte-7130a304-8b22-4ed6-978e-138f8949ef91" released by "delete_snapshot" :: held 1.834s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:19:19 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-32ee10f5-9367-4fab-b473-97ee6440a0f4 tempest-VolumeDependencyTests-784302238 None] Created reservations ['7b357193-c2cb-4b70-ba94-1d59cd53a40b', '1b32a850-21ce-4594-9589-91e96d16671d', 'c5047444-12f7-42a3-816e-d04eb74d9da5', 'd11f7308-504f-4e26-bd3e-9b349955eee3'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:19:19 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-32ee10f5-9367-4fab-b473-97ee6440a0f4 tempest-VolumeDependencyTests-784302238 None] Delete snapshot completed successfully.
Apr 10 13:19:19 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-32ee10f5-9367-4fab-b473-97ee6440a0f4 tempest-VolumeDependencyTests-784302238 None] Lock "cinder-aabec8bd-00a3-4bcd-9605-bf4826bbc088-delete_snapshot" released by "delete_snapshot" :: held 1.911s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:19:19 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-cf4e18ef-9c09-406d-b0bd-2eac9544a788 tempest-VolumeDependencyTests-784302238 None] Acquiring lock "cinder-7130a304-8b22-4ed6-978e-138f8949ef91-delete_volume" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:19:19 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-cf4e18ef-9c09-406d-b0bd-2eac9544a788 tempest-VolumeDependencyTests-784302238 None] Lock "cinder-7130a304-8b22-4ed6-978e-138f8949ef91-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:19:19 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-cf4e18ef-9c09-406d-b0bd-2eac9544a788 tempest-VolumeDependencyTests-784302238 None] Acquiring lock "cinder-quobyte-7130a304-8b22-4ed6-978e-138f8949ef91" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:19:19 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-cf4e18ef-9c09-406d-b0bd-2eac9544a788 tempest-VolumeDependencyTests-784302238 None] Lock "cinder-quobyte-7130a304-8b22-4ed6-978e-138f8949ef91" acquired by "delete_volume" :: waited 0.008s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:19:19 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0b9daf8-45b5-46f7-815e-ca9039f655ca]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:19:19 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-cf4e18ef-9c09-406d-b0bd-2eac9544a788 tempest-VolumeDependencyTests-784302238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7130a304-8b22-4ed6-978e-138f8949ef91 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:19:19 devstack sudo[90554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7130a304-8b22-4ed6-978e-138f8949ef91
Apr 10 13:19:19 devstack sudo[90554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:19:20 devstack sudo[90554]: pam_unix(sudo:session): session closed for user root
Apr 10 13:19:20 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-cf4e18ef-9c09-406d-b0bd-2eac9544a788 tempest-VolumeDependencyTests-784302238 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7130a304-8b22-4ed6-978e-138f8949ef91" returned: 0 in 0.478s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:19:20 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-cf4e18ef-9c09-406d-b0bd-2eac9544a788 tempest-VolumeDependencyTests-784302238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7130a304-8b22-4ed6-978e-138f8949ef91 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:19:20 devstack sudo[90559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7130a304-8b22-4ed6-978e-138f8949ef91
Apr 10 13:19:20 devstack sudo[90559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:19:20 devstack sudo[90559]: pam_unix(sudo:session): session closed for user root
Apr 10 13:19:20 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-cf4e18ef-9c09-406d-b0bd-2eac9544a788 tempest-VolumeDependencyTests-784302238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7130a304-8b22-4ed6-978e-138f8949ef91" returned: 0 in 0.394s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:19:20 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-cf4e18ef-9c09-406d-b0bd-2eac9544a788 tempest-VolumeDependencyTests-784302238 None] Lock "cinder-quobyte-7130a304-8b22-4ed6-978e-138f8949ef91" released by "delete_volume" :: held 0.906s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:19:20 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-cf4e18ef-9c09-406d-b0bd-2eac9544a788 tempest-VolumeDependencyTests-784302238 None] Created reservations ['6e25b148-b76f-4f3d-8a6e-529c8fdb0d4a', 'e5f0c7a4-c6c2-435a-b4c8-7be98ab18e98', '3e47fe62-5cfa-42af-9f10-82c3ecc57060', '4913399e-7785-4a7e-aa50-a905aea63c9a'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:19:20 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-cf4e18ef-9c09-406d-b0bd-2eac9544a788 tempest-VolumeDependencyTests-784302238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:19:20 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-cf4e18ef-9c09-406d-b0bd-2eac9544a788 tempest-VolumeDependencyTests-784302238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:19:20 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-cf4e18ef-9c09-406d-b0bd-2eac9544a788 tempest-VolumeDependencyTests-784302238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:19:20 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-cf4e18ef-9c09-406d-b0bd-2eac9544a788 tempest-VolumeDependencyTests-784302238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:19:20 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-cf4e18ef-9c09-406d-b0bd-2eac9544a788 tempest-VolumeDependencyTests-784302238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:19:20 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-cf4e18ef-9c09-406d-b0bd-2eac9544a788 tempest-VolumeDependencyTests-784302238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:19:20 devstack sudo[90562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:19:20 devstack sudo[90562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:19:21 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec35bf5b-d093-4625-9da2-fe65c2134736 tempest-VolumeDependencyTests-784302238 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:19:21 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ec35bf5b-d093-4625-9da2-fe65c2134736 tempest-VolumeDependencyTests-784302238 None] Flow 'volume_create_manager' (5bccfb18-0251-4000-8d6d-8bbc8f558d6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:19:21 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ec35bf5b-d093-4625-9da2-fe65c2134736 tempest-VolumeDependencyTests-784302238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87dde346-378f-44a3-8266-e96beec0847c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:19:21 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ec35bf5b-d093-4625-9da2-fe65c2134736 tempest-VolumeDependencyTests-784302238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87dde346-378f-44a3-8266-e96beec0847c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:19:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1399951582',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adfb33dd-42d6-44ea-bb3e-530bbeaf3900,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e66e2b1a9624b009e0657c059985482',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:19:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:19:21Z,use_quota=True,user_id='b4f60d7d21c0405f8ab4a1ae4e2e4389',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:19:21 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ec35bf5b-d093-4625-9da2-fe65c2134736 tempest-VolumeDependencyTests-784302238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fa9d4b5-dc5e-4000-9adc-d539170475db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:19:21 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ec35bf5b-d093-4625-9da2-fe65c2134736 tempest-VolumeDependencyTests-784302238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fa9d4b5-dc5e-4000-9adc-d539170475db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:19:21 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ec35bf5b-d093-4625-9da2-fe65c2134736 tempest-VolumeDependencyTests-784302238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd599bd1-89ba-4480-82a6-1a22de6145d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:19:21 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ec35bf5b-d093-4625-9da2-fe65c2134736 tempest-VolumeDependencyTests-784302238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd599bd1-89ba-4480-82a6-1a22de6145d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'adfb33dd-42d6-44ea-bb3e-530bbeaf3900', 'volume_name': 'volume-adfb33dd-42d6-44ea-bb3e-530bbeaf3900', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:19:21 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ec35bf5b-d093-4625-9da2-fe65c2134736 tempest-VolumeDependencyTests-784302238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78765ff2-c7a7-4563-8d63-6354d8b93232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:19:21 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ec35bf5b-d093-4625-9da2-fe65c2134736 tempest-VolumeDependencyTests-784302238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78765ff2-c7a7-4563-8d63-6354d8b93232) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:19:21 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ec35bf5b-d093-4625-9da2-fe65c2134736 tempest-VolumeDependencyTests-784302238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4fefce4-dbcd-4950-852d-c06c238f19a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:19:21 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-ec35bf5b-d093-4625-9da2-fe65c2134736 tempest-VolumeDependencyTests-784302238 None] Volume adfb33dd-42d6-44ea-bb3e-530bbeaf3900: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-adfb33dd-42d6-44ea-bb3e-530bbeaf3900', 'volume_size': 1}
Apr 10 13:19:21 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-ec35bf5b-d093-4625-9da2-fe65c2134736 tempest-VolumeDependencyTests-784302238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:19:21 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-ec35bf5b-d093-4625-9da2-fe65c2134736 tempest-VolumeDependencyTests-784302238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:19:21 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-ec35bf5b-d093-4625-9da2-fe65c2134736 tempest-VolumeDependencyTests-784302238 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f252bf08b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:19:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1399951582',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adfb33dd-42d6-44ea-bb3e-530bbeaf3900,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e66e2b1a9624b009e0657c059985482',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:19:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:19:21Z,use_quota=True,user_id='b4f60d7d21c0405f8ab4a1ae4e2e4389',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)}" {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 13:19:21 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-ec35bf5b-d093-4625-9da2-fe65c2134736 tempest-VolumeDependencyTests-784302238 None] Creating volume adfb33dd-42d6-44ea-bb3e-530bbeaf3900 {{(pid=83345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 13:19:21 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-ec35bf5b-d093-4625-9da2-fe65c2134736 tempest-VolumeDependencyTests-784302238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:19:21 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-ec35bf5b-d093-4625-9da2-fe65c2134736 tempest-VolumeDependencyTests-784302238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:19:21 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-ec35bf5b-d093-4625-9da2-fe65c2134736 tempest-VolumeDependencyTests-784302238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:19:21 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-ec35bf5b-d093-4625-9da2-fe65c2134736 tempest-VolumeDependencyTests-784302238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:19:21 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-ec35bf5b-d093-4625-9da2-fe65c2134736 tempest-VolumeDependencyTests-784302238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:19:21 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-ec35bf5b-d093-4625-9da2-fe65c2134736 tempest-VolumeDependencyTests-784302238 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:19:21 devstack cinder-volume[83345]: INFO cinder.volume.drivers.remotefs [None req-ec35bf5b-d093-4625-9da2-fe65c2134736 tempest-VolumeDependencyTests-784302238 None] casted to osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331
Apr 10 13:19:21 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ec35bf5b-d093-4625-9da2-fe65c2134736 tempest-VolumeDependencyTests-784302238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-adfb33dd-42d6-44ea-bb3e-530bbeaf3900 1073741824 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:19:21 devstack sudo[90565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-adfb33dd-42d6-44ea-bb3e-530bbeaf3900 1073741824
Apr 10 13:19:21 devstack sudo[90565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:19:21 devstack sudo[90562]: pam_unix(sudo:session): session closed for user root
Apr 10 13:19:21 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-cf4e18ef-9c09-406d-b0bd-2eac9544a788 tempest-VolumeDependencyTests-784302238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.447s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:19:21 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-cf4e18ef-9c09-406d-b0bd-2eac9544a788 tempest-VolumeDependencyTests-784302238 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:19:21 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-cf4e18ef-9c09-406d-b0bd-2eac9544a788 tempest-VolumeDependencyTests-784302238 None] Deleted volume successfully.
Apr 10 13:19:21 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-cf4e18ef-9c09-406d-b0bd-2eac9544a788 tempest-VolumeDependencyTests-784302238 None] Lock "cinder-7130a304-8b22-4ed6-978e-138f8949ef91-delete_volume" released by "delete_volume" :: held 1.474s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:19:21 devstack sudo[90565]: pam_unix(sudo:session): session closed for user root
Apr 10 13:19:21 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ec35bf5b-d093-4625-9da2-fe65c2134736 tempest-VolumeDependencyTests-784302238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-adfb33dd-42d6-44ea-bb3e-530bbeaf3900 1073741824" returned: 0 in 0.491s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:19:21 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ec35bf5b-d093-4625-9da2-fe65c2134736 tempest-VolumeDependencyTests-784302238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-adfb33dd-42d6-44ea-bb3e-530bbeaf3900 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:19:21 devstack sudo[90571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-adfb33dd-42d6-44ea-bb3e-530bbeaf3900
Apr 10 13:19:21 devstack sudo[90571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:19:22 devstack sudo[90571]: pam_unix(sudo:session): session closed for user root
Apr 10 13:19:22 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ec35bf5b-d093-4625-9da2-fe65c2134736 tempest-VolumeDependencyTests-784302238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-adfb33dd-42d6-44ea-bb3e-530bbeaf3900" returned: 0 in 0.403s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:19:22 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-ec35bf5b-d093-4625-9da2-fe65c2134736 tempest-VolumeDependencyTests-784302238 None] <== create_volume: return (920ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'} {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 13:19:22 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-ec35bf5b-d093-4625-9da2-fe65c2134736 tempest-VolumeDependencyTests-784302238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.924s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:19:22 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ec35bf5b-d093-4625-9da2-fe65c2134736 tempest-VolumeDependencyTests-784302238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4fefce4-dbcd-4950-852d-c06c238f19a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-adfb33dd-42d6-44ea-bb3e-530bbeaf3900', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:19:22 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ec35bf5b-d093-4625-9da2-fe65c2134736 tempest-VolumeDependencyTests-784302238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c74f251-3dfc-4eba-9ab2-3c4141213784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:19:22 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-ec35bf5b-d093-4625-9da2-fe65c2134736 tempest-VolumeDependencyTests-784302238 None] Volume volume-adfb33dd-42d6-44ea-bb3e-530bbeaf3900 (adfb33dd-42d6-44ea-bb3e-530bbeaf3900): created successfully
Apr 10 13:19:22 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ec35bf5b-d093-4625-9da2-fe65c2134736 tempest-VolumeDependencyTests-784302238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c74f251-3dfc-4eba-9ab2-3c4141213784) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:19:22 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ec35bf5b-d093-4625-9da2-fe65c2134736 tempest-VolumeDependencyTests-784302238 None] Flow 'volume_create_manager' (5bccfb18-0251-4000-8d6d-8bbc8f558d6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:19:22 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-ec35bf5b-d093-4625-9da2-fe65c2134736 tempest-VolumeDependencyTests-784302238 None] Created volume successfully.
Apr 10 13:19:23 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-44820b71-e50b-4484-af18-84beff43e698 tempest-VolumeDependencyTests-784302238 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:19:23 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-44820b71-e50b-4484-af18-84beff43e698 tempest-VolumeDependencyTests-784302238 None] Flow 'volume_create_manager' (4ff0fff6-553d-45c9-878a-370acce91b39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:19:23 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-44820b71-e50b-4484-af18-84beff43e698 tempest-VolumeDependencyTests-784302238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fbc4b61-1d6c-4ca8-b0bd-8c90ec2f819b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:19:23 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-44820b71-e50b-4484-af18-84beff43e698 tempest-VolumeDependencyTests-784302238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fbc4b61-1d6c-4ca8-b0bd-8c90ec2f819b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:19:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1576433348',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d4df908-ba15-4086-829f-79ebb904fc8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e66e2b1a9624b009e0657c059985482',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:19:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=adfb33dd-42d6-44ea-bb3e-530bbeaf3900,status='creating',terminated_at=None,updated_at=2026-04-10T11:19:23Z,use_quota=True,user_id='b4f60d7d21c0405f8ab4a1ae4e2e4389',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:19:23 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-44820b71-e50b-4484-af18-84beff43e698 tempest-VolumeDependencyTests-784302238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9890e250-68c9-4bcd-b1cc-db2eea2bbbc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:19:23 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-44820b71-e50b-4484-af18-84beff43e698 tempest-VolumeDependencyTests-784302238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9890e250-68c9-4bcd-b1cc-db2eea2bbbc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:19:23 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-44820b71-e50b-4484-af18-84beff43e698 tempest-VolumeDependencyTests-784302238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18b57ba9-4d52-474e-9b6d-3fe7a028786f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:19:23 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-44820b71-e50b-4484-af18-84beff43e698 tempest-VolumeDependencyTests-784302238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18b57ba9-4d52-474e-9b6d-3fe7a028786f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '4d4df908-ba15-4086-829f-79ebb904fc8a', 'volume_name': 'volume-4d4df908-ba15-4086-829f-79ebb904fc8a', 'volume_size': 1, 'source_volid': 'adfb33dd-42d6-44ea-bb3e-530bbeaf3900', 'source_volstatus': 'available'}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:19:23 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-44820b71-e50b-4484-af18-84beff43e698 tempest-VolumeDependencyTests-784302238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8f34cd7-ce3d-492a-bc31-207ca97ea646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:19:23 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-44820b71-e50b-4484-af18-84beff43e698 tempest-VolumeDependencyTests-784302238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8f34cd7-ce3d-492a-bc31-207ca97ea646) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:19:23 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-44820b71-e50b-4484-af18-84beff43e698 tempest-VolumeDependencyTests-784302238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef039acc-726b-4bcd-b7ec-262e98aafd7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:19:23 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-44820b71-e50b-4484-af18-84beff43e698 tempest-VolumeDependencyTests-784302238 None] Volume 4d4df908-ba15-4086-829f-79ebb904fc8a: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-4d4df908-ba15-4086-829f-79ebb904fc8a', 'volume_size': 1, 'source_volid': 'adfb33dd-42d6-44ea-bb3e-530bbeaf3900', 'source_volstatus': 'available'}
Apr 10 13:19:23 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-44820b71-e50b-4484-af18-84beff43e698 tempest-VolumeDependencyTests-784302238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:19:23 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-44820b71-e50b-4484-af18-84beff43e698 tempest-VolumeDependencyTests-784302238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:19:23 devstack cinder-volume[83345]: INFO cinder.volume.drivers.remotefs [None req-44820b71-e50b-4484-af18-84beff43e698 tempest-VolumeDependencyTests-784302238 None] Cloning volume adfb33dd-42d6-44ea-bb3e-530bbeaf3900 to volume 4d4df908-ba15-4086-829f-79ebb904fc8a
Apr 10 13:19:23 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-44820b71-e50b-4484-af18-84beff43e698 tempest-VolumeDependencyTests-784302238 None] Creating offline snapshot de1383ec-51c1-4a71-9c15-3de05a79f5f8 of volume adfb33dd-42d6-44ea-bb3e-530bbeaf3900 {{(pid=83345) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 10 13:19:23 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[926167a9-0fb8-4b99-87b1-6a3c712d30f0]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:19:23 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-44820b71-e50b-4484-af18-84beff43e698 tempest-VolumeDependencyTests-784302238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-adfb33dd-42d6-44ea-bb3e-530bbeaf3900 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:19:23 devstack sudo[90575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-adfb33dd-42d6-44ea-bb3e-530bbeaf3900
Apr 10 13:19:23 devstack sudo[90575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:19:24 devstack sudo[90575]: pam_unix(sudo:session): session closed for user root
Apr 10 13:19:24 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-44820b71-e50b-4484-af18-84beff43e698 tempest-VolumeDependencyTests-784302238 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-adfb33dd-42d6-44ea-bb3e-530bbeaf3900" returned: 0 in 0.578s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:19:24 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-44820b71-e50b-4484-af18-84beff43e698 tempest-VolumeDependencyTests-784302238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-adfb33dd-42d6-44ea-bb3e-530bbeaf3900,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-adfb33dd-42d6-44ea-bb3e-530bbeaf3900.de1383ec-51c1-4a71-9c15-3de05a79f5f8 1G {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:19:24 devstack sudo[90580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-adfb33dd-42d6-44ea-bb3e-530bbeaf3900,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-adfb33dd-42d6-44ea-bb3e-530bbeaf3900.de1383ec-51c1-4a71-9c15-3de05a79f5f8 1G
Apr 10 13:19:24 devstack sudo[90580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:19:24 devstack sudo[90580]: pam_unix(sudo:session): session closed for user root
Apr 10 13:19:24 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-44820b71-e50b-4484-af18-84beff43e698 tempest-VolumeDependencyTests-784302238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-adfb33dd-42d6-44ea-bb3e-530bbeaf3900,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-adfb33dd-42d6-44ea-bb3e-530bbeaf3900.de1383ec-51c1-4a71-9c15-3de05a79f5f8 1G" returned: 0 in 0.524s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:19:24 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-44820b71-e50b-4484-af18-84beff43e698 tempest-VolumeDependencyTests-784302238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-adfb33dd-42d6-44ea-bb3e-530bbeaf3900 -F qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-adfb33dd-42d6-44ea-bb3e-530bbeaf3900.de1383ec-51c1-4a71-9c15-3de05a79f5f8 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:19:24 devstack sudo[90585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-adfb33dd-42d6-44ea-bb3e-530bbeaf3900 -F qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-adfb33dd-42d6-44ea-bb3e-530bbeaf3900.de1383ec-51c1-4a71-9c15-3de05a79f5f8
Apr 10 13:19:24 devstack sudo[90585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:19:25 devstack sudo[90585]: pam_unix(sudo:session): session closed for user root
Apr 10 13:19:25 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-44820b71-e50b-4484-af18-84beff43e698 tempest-VolumeDependencyTests-784302238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-adfb33dd-42d6-44ea-bb3e-530bbeaf3900 -F qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-adfb33dd-42d6-44ea-bb3e-530bbeaf3900.de1383ec-51c1-4a71-9c15-3de05a79f5f8" returned: 0 in 0.431s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:19:25 devstack cinder-volume[83345]: WARNING cinder.volume.drivers.remotefs [None req-44820b71-e50b-4484-af18-84beff43e698 tempest-VolumeDependencyTests-784302238 None] /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-adfb33dd-42d6-44ea-bb3e-530bbeaf3900.de1383ec-51c1-4a71-9c15-3de05a79f5f8 is being set with open permissions: ugo+rw
Apr 10 13:19:25 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-44820b71-e50b-4484-af18-84beff43e698 tempest-VolumeDependencyTests-784302238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-adfb33dd-42d6-44ea-bb3e-530bbeaf3900.de1383ec-51c1-4a71-9c15-3de05a79f5f8 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:19:25 devstack sudo[90590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-adfb33dd-42d6-44ea-bb3e-530bbeaf3900.de1383ec-51c1-4a71-9c15-3de05a79f5f8
Apr 10 13:19:25 devstack sudo[90590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:19:25 devstack sudo[90590]: pam_unix(sudo:session): session closed for user root
Apr 10 13:19:25 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-44820b71-e50b-4484-af18-84beff43e698 tempest-VolumeDependencyTests-784302238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-adfb33dd-42d6-44ea-bb3e-530bbeaf3900.de1383ec-51c1-4a71-9c15-3de05a79f5f8" returned: 0 in 0.417s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:19:25 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-44820b71-e50b-4484-af18-84beff43e698 tempest-VolumeDependencyTests-784302238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-adfb33dd-42d6-44ea-bb3e-530bbeaf3900.info {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:19:25 devstack sudo[90593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-adfb33dd-42d6-44ea-bb3e-530bbeaf3900.info
Apr 10 13:19:25 devstack sudo[90593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:19:26 devstack sudo[90593]: pam_unix(sudo:session): session closed for user root
Apr 10 13:19:26 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-44820b71-e50b-4484-af18-84beff43e698 tempest-VolumeDependencyTests-784302238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-adfb33dd-42d6-44ea-bb3e-530bbeaf3900.info" returned: 0 in 0.403s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:19:26 devstack cinder-volume[83345]: WARNING cinder.volume.drivers.remotefs [None req-44820b71-e50b-4484-af18-84beff43e698 tempest-VolumeDependencyTests-784302238 None] /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-adfb33dd-42d6-44ea-bb3e-530bbeaf3900.info is being set with open permissions: ugo+rw
Apr 10 13:19:26 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-44820b71-e50b-4484-af18-84beff43e698 tempest-VolumeDependencyTests-784302238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-adfb33dd-42d6-44ea-bb3e-530bbeaf3900.info {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:19:26 devstack sudo[90596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-adfb33dd-42d6-44ea-bb3e-530bbeaf3900.info
Apr 10 13:19:26 devstack sudo[90596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:19:26 devstack sudo[90596]: pam_unix(sudo:session): session closed for user root
Apr 10 13:19:26 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-44820b71-e50b-4484-af18-84beff43e698 tempest-VolumeDependencyTests-784302238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-adfb33dd-42d6-44ea-bb3e-530bbeaf3900.info" returned: 0 in 0.410s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:19:26 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-44820b71-e50b-4484-af18-84beff43e698 tempest-VolumeDependencyTests-784302238 None] Acquiring lock "cinder-quobyte-4d4df908-ba15-4086-829f-79ebb904fc8a" by "_copy_volume_from_snapshot" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:19:26 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-44820b71-e50b-4484-af18-84beff43e698 tempest-VolumeDependencyTests-784302238 None] Lock "cinder-quobyte-4d4df908-ba15-4086-829f-79ebb904fc8a" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:19:26 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-44820b71-e50b-4484-af18-84beff43e698 tempest-VolumeDependencyTests-784302238 None] snapshot: de1383ec-51c1-4a71-9c15-3de05a79f5f8, volume: 4d4df908-ba15-4086-829f-79ebb904fc8a,  {{(pid=83345) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 10 13:19:26 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-44820b71-e50b-4484-af18-84beff43e698 tempest-VolumeDependencyTests-784302238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:19:26 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-44820b71-e50b-4484-af18-84beff43e698 tempest-VolumeDependencyTests-784302238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:19:26 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-44820b71-e50b-4484-af18-84beff43e698 tempest-VolumeDependencyTests-784302238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:19:26 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-44820b71-e50b-4484-af18-84beff43e698 tempest-VolumeDependencyTests-784302238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:19:26 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-44820b71-e50b-4484-af18-84beff43e698 tempest-VolumeDependencyTests-784302238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:19:26 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[b603b792-44d6-454c-9fe3-893b11bf5993]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:19:26 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-44820b71-e50b-4484-af18-84beff43e698 tempest-VolumeDependencyTests-784302238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-adfb33dd-42d6-44ea-bb3e-530bbeaf3900.de1383ec-51c1-4a71-9c15-3de05a79f5f8 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:19:26 devstack sudo[90599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-adfb33dd-42d6-44ea-bb3e-530bbeaf3900.de1383ec-51c1-4a71-9c15-3de05a79f5f8
Apr 10 13:19:26 devstack sudo[90599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:19:26 devstack sudo[90599]: pam_unix(sudo:session): session closed for user root
Apr 10 13:19:26 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-44820b71-e50b-4484-af18-84beff43e698 tempest-VolumeDependencyTests-784302238 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-adfb33dd-42d6-44ea-bb3e-530bbeaf3900.de1383ec-51c1-4a71-9c15-3de05a79f5f8" returned: 0 in 0.467s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:19:26 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-44820b71-e50b-4484-af18-84beff43e698 tempest-VolumeDependencyTests-784302238 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-adfb33dd-42d6-44ea-bb3e-530bbeaf3900(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 13:19:26 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-44820b71-e50b-4484-af18-84beff43e698 tempest-VolumeDependencyTests-784302238 None] will copy from snapshot at /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-adfb33dd-42d6-44ea-bb3e-530bbeaf3900 {{(pid=83345) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 10 13:19:26 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-44820b71-e50b-4484-af18-84beff43e698 tempest-VolumeDependencyTests-784302238 None] Creating direct copy from snapshot {{(pid=83345) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 10 13:19:26 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[11862b5f-67aa-4f0d-8b5a-cf461acb4965]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:19:26 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-44820b71-e50b-4484-af18-84beff43e698 tempest-VolumeDependencyTests-784302238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-adfb33dd-42d6-44ea-bb3e-530bbeaf3900 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:19:27 devstack sudo[90604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-adfb33dd-42d6-44ea-bb3e-530bbeaf3900
Apr 10 13:19:27 devstack sudo[90604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:19:27 devstack sudo[90604]: pam_unix(sudo:session): session closed for user root
Apr 10 13:19:27 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-44820b71-e50b-4484-af18-84beff43e698 tempest-VolumeDependencyTests-784302238 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-adfb33dd-42d6-44ea-bb3e-530bbeaf3900" returned: 0 in 0.465s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:19:27 devstack cinder-volume[83345]: DEBUG cinder.utils [None req-44820b71-e50b-4484-af18-84beff43e698 tempest-VolumeDependencyTests-784302238 None] Path /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4d4df908-ba15-4086-829f-79ebb904fc8a not found in is_blk_device check {{(pid=83345) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 10 13:19:27 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-44820b71-e50b-4484-af18-84beff43e698 tempest-VolumeDependencyTests-784302238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-adfb33dd-42d6-44ea-bb3e-530bbeaf3900 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4d4df908-ba15-4086-829f-79ebb904fc8a {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:19:27 devstack sudo[90609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-adfb33dd-42d6-44ea-bb3e-530bbeaf3900 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4d4df908-ba15-4086-829f-79ebb904fc8a
Apr 10 13:19:27 devstack sudo[90609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:19:29 devstack sudo[90609]: pam_unix(sudo:session): session closed for user root
Apr 10 13:19:29 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-44820b71-e50b-4484-af18-84beff43e698 tempest-VolumeDependencyTests-784302238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-adfb33dd-42d6-44ea-bb3e-530bbeaf3900 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4d4df908-ba15-4086-829f-79ebb904fc8a" returned: 0 in 2.107s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:19:29 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[37973835-69da-49c0-9d43-de80994c16c6]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:19:29 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-44820b71-e50b-4484-af18-84beff43e698 tempest-VolumeDependencyTests-784302238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-adfb33dd-42d6-44ea-bb3e-530bbeaf3900 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:19:29 devstack sudo[90655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-adfb33dd-42d6-44ea-bb3e-530bbeaf3900
Apr 10 13:19:29 devstack sudo[90655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:19:30 devstack sudo[90655]: pam_unix(sudo:session): session closed for user root
Apr 10 13:19:30 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-44820b71-e50b-4484-af18-84beff43e698 tempest-VolumeDependencyTests-784302238 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-adfb33dd-42d6-44ea-bb3e-530bbeaf3900" returned: 0 in 0.604s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:19:30 devstack cinder-volume[83345]: DEBUG cinder.image.image_utils [None req-44820b71-e50b-4484-af18-84beff43e698 tempest-VolumeDependencyTests-784302238 None] Image conversion details: src /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-adfb33dd-42d6-44ea-bb3e-530bbeaf3900, size 1024.00 MB, duration 2.11 sec, destination /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4d4df908-ba15-4086-829f-79ebb904fc8a {{(pid=83345) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 10 13:19:30 devstack cinder-volume[83345]: INFO cinder.image.image_utils [None req-44820b71-e50b-4484-af18-84beff43e698 tempest-VolumeDependencyTests-784302238 None] Converted 1024.00 MB image at 485.70 MB/s
Apr 10 13:19:30 devstack cinder-volume[83345]: WARNING cinder.volume.drivers.remotefs [None req-44820b71-e50b-4484-af18-84beff43e698 tempest-VolumeDependencyTests-784302238 None] /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4d4df908-ba15-4086-829f-79ebb904fc8a is being set with open permissions: ugo+rw
Apr 10 13:19:30 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-44820b71-e50b-4484-af18-84beff43e698 tempest-VolumeDependencyTests-784302238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4d4df908-ba15-4086-829f-79ebb904fc8a {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:19:30 devstack sudo[90660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4d4df908-ba15-4086-829f-79ebb904fc8a
Apr 10 13:19:30 devstack sudo[90660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:19:30 devstack sudo[90660]: pam_unix(sudo:session): session closed for user root
Apr 10 13:19:30 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-44820b71-e50b-4484-af18-84beff43e698 tempest-VolumeDependencyTests-784302238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4d4df908-ba15-4086-829f-79ebb904fc8a" returned: 0 in 0.408s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:19:30 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-44820b71-e50b-4484-af18-84beff43e698 tempest-VolumeDependencyTests-784302238 None] Lock "cinder-quobyte-4d4df908-ba15-4086-829f-79ebb904fc8a" released by "_copy_volume_from_snapshot" :: held 4.093s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:19:30 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-44820b71-e50b-4484-af18-84beff43e698 tempest-VolumeDependencyTests-784302238 None] Acquiring lock "cinder-quobyte-de1383ec-51c1-4a71-9c15-3de05a79f5f8" by "_delete_snapshot" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:19:30 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-44820b71-e50b-4484-af18-84beff43e698 tempest-VolumeDependencyTests-784302238 None] Lock "cinder-quobyte-de1383ec-51c1-4a71-9c15-3de05a79f5f8" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:19:30 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-44820b71-e50b-4484-af18-84beff43e698 tempest-VolumeDependencyTests-784302238 None] Deleting offline snapshot de1383ec-51c1-4a71-9c15-3de05a79f5f8 of volume adfb33dd-42d6-44ea-bb3e-530bbeaf3900 {{(pid=83345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 10 13:19:30 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-44820b71-e50b-4484-af18-84beff43e698 tempest-VolumeDependencyTests-784302238 None] snapshot_file for this snap is: volume-adfb33dd-42d6-44ea-bb3e-530bbeaf3900.de1383ec-51c1-4a71-9c15-3de05a79f5f8 {{(pid=83345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 10 13:19:30 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[86cb5a51-79b1-4d21-9132-cf2466c34bb5]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:19:30 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-44820b71-e50b-4484-af18-84beff43e698 tempest-VolumeDependencyTests-784302238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-adfb33dd-42d6-44ea-bb3e-530bbeaf3900.de1383ec-51c1-4a71-9c15-3de05a79f5f8 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:19:30 devstack sudo[90663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-adfb33dd-42d6-44ea-bb3e-530bbeaf3900.de1383ec-51c1-4a71-9c15-3de05a79f5f8
Apr 10 13:19:30 devstack sudo[90663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:19:31 devstack sudo[90663]: pam_unix(sudo:session): session closed for user root
Apr 10 13:19:31 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-44820b71-e50b-4484-af18-84beff43e698 tempest-VolumeDependencyTests-784302238 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-adfb33dd-42d6-44ea-bb3e-530bbeaf3900.de1383ec-51c1-4a71-9c15-3de05a79f5f8" returned: 0 in 0.471s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:19:31 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-44820b71-e50b-4484-af18-84beff43e698 tempest-VolumeDependencyTests-784302238 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-adfb33dd-42d6-44ea-bb3e-530bbeaf3900(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 13:19:31 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9bc2609-2214-4b11-aaa7-cff493b95a7c]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:19:31 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-44820b71-e50b-4484-af18-84beff43e698 tempest-VolumeDependencyTests-784302238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-adfb33dd-42d6-44ea-bb3e-530bbeaf3900 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:19:31 devstack sudo[90668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-adfb33dd-42d6-44ea-bb3e-530bbeaf3900
Apr 10 13:19:31 devstack sudo[90668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:19:31 devstack sudo[90668]: pam_unix(sudo:session): session closed for user root
Apr 10 13:19:31 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-44820b71-e50b-4484-af18-84beff43e698 tempest-VolumeDependencyTests-784302238 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-adfb33dd-42d6-44ea-bb3e-530bbeaf3900" returned: 0 in 0.470s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:19:31 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-44820b71-e50b-4484-af18-84beff43e698 tempest-VolumeDependencyTests-784302238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-adfb33dd-42d6-44ea-bb3e-530bbeaf3900.de1383ec-51c1-4a71-9c15-3de05a79f5f8 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:19:31 devstack sudo[90674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-adfb33dd-42d6-44ea-bb3e-530bbeaf3900.de1383ec-51c1-4a71-9c15-3de05a79f5f8
Apr 10 13:19:31 devstack sudo[90674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:19:32 devstack sudo[90674]: pam_unix(sudo:session): session closed for user root
Apr 10 13:19:32 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-44820b71-e50b-4484-af18-84beff43e698 tempest-VolumeDependencyTests-784302238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-adfb33dd-42d6-44ea-bb3e-530bbeaf3900.de1383ec-51c1-4a71-9c15-3de05a79f5f8" returned: 0 in 0.463s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:19:32 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-44820b71-e50b-4484-af18-84beff43e698 tempest-VolumeDependencyTests-784302238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-adfb33dd-42d6-44ea-bb3e-530bbeaf3900.de1383ec-51c1-4a71-9c15-3de05a79f5f8 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:19:32 devstack sudo[90679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-adfb33dd-42d6-44ea-bb3e-530bbeaf3900.de1383ec-51c1-4a71-9c15-3de05a79f5f8
Apr 10 13:19:32 devstack sudo[90679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:19:32 devstack sudo[90679]: pam_unix(sudo:session): session closed for user root
Apr 10 13:19:32 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-44820b71-e50b-4484-af18-84beff43e698 tempest-VolumeDependencyTests-784302238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-adfb33dd-42d6-44ea-bb3e-530bbeaf3900.de1383ec-51c1-4a71-9c15-3de05a79f5f8" returned: 0 in 0.394s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:19:32 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-44820b71-e50b-4484-af18-84beff43e698 tempest-VolumeDependencyTests-784302238 None] Lock "cinder-quobyte-de1383ec-51c1-4a71-9c15-3de05a79f5f8" released by "_delete_snapshot" :: held 1.839s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:19:32 devstack cinder-volume[83345]: DEBUG dbcounter [-] [83345] Writing DB stats cinder:UPDATE=167,cinder:INSERT=48,cinder:SELECT=132,cinder:DELETE=15 {{(pid=83345) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 10 13:19:32 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-44820b71-e50b-4484-af18-84beff43e698 tempest-VolumeDependencyTests-784302238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 8.817s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:19:32 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-44820b71-e50b-4484-af18-84beff43e698 tempest-VolumeDependencyTests-784302238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef039acc-726b-4bcd-b7ec-262e98aafd7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d4df908-ba15-4086-829f-79ebb904fc8a', 'volume_size': 1, 'source_volid': 'adfb33dd-42d6-44ea-bb3e-530bbeaf3900', 'source_volstatus': 'available'}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:19:32 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-44820b71-e50b-4484-af18-84beff43e698 tempest-VolumeDependencyTests-784302238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82038487-2658-4813-80f2-384635bd0f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:19:32 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-44820b71-e50b-4484-af18-84beff43e698 tempest-VolumeDependencyTests-784302238 None] Volume volume-4d4df908-ba15-4086-829f-79ebb904fc8a (4d4df908-ba15-4086-829f-79ebb904fc8a): created successfully
Apr 10 13:19:32 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-44820b71-e50b-4484-af18-84beff43e698 tempest-VolumeDependencyTests-784302238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82038487-2658-4813-80f2-384635bd0f45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:19:32 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-44820b71-e50b-4484-af18-84beff43e698 tempest-VolumeDependencyTests-784302238 None] Flow 'volume_create_manager' (4ff0fff6-553d-45c9-878a-370acce91b39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:19:32 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-44820b71-e50b-4484-af18-84beff43e698 tempest-VolumeDependencyTests-784302238 None] Created volume successfully.
Apr 10 13:19:32 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-ecd13655-c61e-4ac6-b1c2-a245b9754637 tempest-VolumeDependencyTests-784302238 None] Acquiring lock "cinder-adfb33dd-42d6-44ea-bb3e-530bbeaf3900-delete_volume" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:19:32 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-ecd13655-c61e-4ac6-b1c2-a245b9754637 tempest-VolumeDependencyTests-784302238 None] Lock "cinder-adfb33dd-42d6-44ea-bb3e-530bbeaf3900-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:19:33 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-ecd13655-c61e-4ac6-b1c2-a245b9754637 tempest-VolumeDependencyTests-784302238 None] Acquiring lock "cinder-quobyte-adfb33dd-42d6-44ea-bb3e-530bbeaf3900" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:19:33 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-ecd13655-c61e-4ac6-b1c2-a245b9754637 tempest-VolumeDependencyTests-784302238 None] Lock "cinder-quobyte-adfb33dd-42d6-44ea-bb3e-530bbeaf3900" acquired by "delete_volume" :: waited 0.006s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:19:33 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[4652e5fc-1024-4d1c-a8e8-f3f56acb8091]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:19:33 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ecd13655-c61e-4ac6-b1c2-a245b9754637 tempest-VolumeDependencyTests-784302238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-adfb33dd-42d6-44ea-bb3e-530bbeaf3900 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:19:33 devstack sudo[90682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-adfb33dd-42d6-44ea-bb3e-530bbeaf3900
Apr 10 13:19:33 devstack sudo[90682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:19:33 devstack sudo[90682]: pam_unix(sudo:session): session closed for user root
Apr 10 13:19:33 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ecd13655-c61e-4ac6-b1c2-a245b9754637 tempest-VolumeDependencyTests-784302238 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-adfb33dd-42d6-44ea-bb3e-530bbeaf3900" returned: 0 in 0.454s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:19:33 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ecd13655-c61e-4ac6-b1c2-a245b9754637 tempest-VolumeDependencyTests-784302238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-adfb33dd-42d6-44ea-bb3e-530bbeaf3900 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:19:33 devstack sudo[90687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-adfb33dd-42d6-44ea-bb3e-530bbeaf3900
Apr 10 13:19:33 devstack sudo[90687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:19:33 devstack sudo[90687]: pam_unix(sudo:session): session closed for user root
Apr 10 13:19:33 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ecd13655-c61e-4ac6-b1c2-a245b9754637 tempest-VolumeDependencyTests-784302238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-adfb33dd-42d6-44ea-bb3e-530bbeaf3900" returned: 0 in 0.414s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:19:33 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-ecd13655-c61e-4ac6-b1c2-a245b9754637 tempest-VolumeDependencyTests-784302238 None] Lock "cinder-quobyte-adfb33dd-42d6-44ea-bb3e-530bbeaf3900" released by "delete_volume" :: held 0.900s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:19:33 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-ecd13655-c61e-4ac6-b1c2-a245b9754637 tempest-VolumeDependencyTests-784302238 None] Created reservations ['479a89d5-e5bd-45a6-9fe0-e751ac0f9d45', '3dfa907f-8c07-4c10-a4df-5a863e4fa64d', '67aee017-bc19-4e5e-9600-4518742423a5', 'b6468190-123a-474a-8af8-271dbad70af9'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:19:33 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-ecd13655-c61e-4ac6-b1c2-a245b9754637 tempest-VolumeDependencyTests-784302238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:19:33 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-ecd13655-c61e-4ac6-b1c2-a245b9754637 tempest-VolumeDependencyTests-784302238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:19:33 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-ecd13655-c61e-4ac6-b1c2-a245b9754637 tempest-VolumeDependencyTests-784302238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:19:33 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-ecd13655-c61e-4ac6-b1c2-a245b9754637 tempest-VolumeDependencyTests-784302238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:19:33 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-ecd13655-c61e-4ac6-b1c2-a245b9754637 tempest-VolumeDependencyTests-784302238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:19:33 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ecd13655-c61e-4ac6-b1c2-a245b9754637 tempest-VolumeDependencyTests-784302238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:19:34 devstack sudo[90690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:19:34 devstack sudo[90690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:19:34 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-80deaa34-6fc0-486b-bfe7-a7ff67bb43e5 tempest-VolumeDependencyTests-784302238 None] Acquiring lock "cinder-4d4df908-ba15-4086-829f-79ebb904fc8a-delete_volume" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:19:34 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-80deaa34-6fc0-486b-bfe7-a7ff67bb43e5 tempest-VolumeDependencyTests-784302238 None] Lock "cinder-4d4df908-ba15-4086-829f-79ebb904fc8a-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:19:34 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-80deaa34-6fc0-486b-bfe7-a7ff67bb43e5 tempest-VolumeDependencyTests-784302238 None] Acquiring lock "cinder-quobyte-4d4df908-ba15-4086-829f-79ebb904fc8a" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:19:34 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-80deaa34-6fc0-486b-bfe7-a7ff67bb43e5 tempest-VolumeDependencyTests-784302238 None] Lock "cinder-quobyte-4d4df908-ba15-4086-829f-79ebb904fc8a" acquired by "delete_volume" :: waited 0.006s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:19:34 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ee072cd-f0f0-42e2-8027-9756a746051f]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:19:34 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-80deaa34-6fc0-486b-bfe7-a7ff67bb43e5 tempest-VolumeDependencyTests-784302238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4d4df908-ba15-4086-829f-79ebb904fc8a {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:19:34 devstack sudo[90692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4d4df908-ba15-4086-829f-79ebb904fc8a
Apr 10 13:19:34 devstack sudo[90692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:19:34 devstack sudo[90690]: pam_unix(sudo:session): session closed for user root
Apr 10 13:19:34 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ecd13655-c61e-4ac6-b1c2-a245b9754637 tempest-VolumeDependencyTests-784302238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.489s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:19:34 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-ecd13655-c61e-4ac6-b1c2-a245b9754637 tempest-VolumeDependencyTests-784302238 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:19:34 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-ecd13655-c61e-4ac6-b1c2-a245b9754637 tempest-VolumeDependencyTests-784302238 None] Deleted volume successfully.
Apr 10 13:19:34 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-ecd13655-c61e-4ac6-b1c2-a245b9754637 tempest-VolumeDependencyTests-784302238 None] Lock "cinder-adfb33dd-42d6-44ea-bb3e-530bbeaf3900-delete_volume" released by "delete_volume" :: held 1.504s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:19:34 devstack sudo[90692]: pam_unix(sudo:session): session closed for user root
Apr 10 13:19:34 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-80deaa34-6fc0-486b-bfe7-a7ff67bb43e5 tempest-VolumeDependencyTests-784302238 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4d4df908-ba15-4086-829f-79ebb904fc8a" returned: 0 in 0.487s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:19:34 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-80deaa34-6fc0-486b-bfe7-a7ff67bb43e5 tempest-VolumeDependencyTests-784302238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4d4df908-ba15-4086-829f-79ebb904fc8a {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:19:34 devstack sudo[90698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4d4df908-ba15-4086-829f-79ebb904fc8a
Apr 10 13:19:34 devstack sudo[90698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:19:35 devstack sudo[90698]: pam_unix(sudo:session): session closed for user root
Apr 10 13:19:35 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-80deaa34-6fc0-486b-bfe7-a7ff67bb43e5 tempest-VolumeDependencyTests-784302238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4d4df908-ba15-4086-829f-79ebb904fc8a" returned: 0 in 0.418s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:19:35 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-80deaa34-6fc0-486b-bfe7-a7ff67bb43e5 tempest-VolumeDependencyTests-784302238 None] Lock "cinder-quobyte-4d4df908-ba15-4086-829f-79ebb904fc8a" released by "delete_volume" :: held 0.924s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:19:35 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-80deaa34-6fc0-486b-bfe7-a7ff67bb43e5 tempest-VolumeDependencyTests-784302238 None] Created reservations ['381dd313-19eb-4465-9c2e-c5709da408eb', '0da2494e-c40a-4365-9968-b29fbb74d9b7', '32d5bdb5-8081-4ef5-99d7-ca6f47d98d0f', 'ebe9ba1e-e502-4522-96c2-31509c290420'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:19:35 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-80deaa34-6fc0-486b-bfe7-a7ff67bb43e5 tempest-VolumeDependencyTests-784302238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:19:35 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-80deaa34-6fc0-486b-bfe7-a7ff67bb43e5 tempest-VolumeDependencyTests-784302238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:19:35 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-80deaa34-6fc0-486b-bfe7-a7ff67bb43e5 tempest-VolumeDependencyTests-784302238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:19:35 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-80deaa34-6fc0-486b-bfe7-a7ff67bb43e5 tempest-VolumeDependencyTests-784302238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:19:35 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-80deaa34-6fc0-486b-bfe7-a7ff67bb43e5 tempest-VolumeDependencyTests-784302238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:19:35 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-80deaa34-6fc0-486b-bfe7-a7ff67bb43e5 tempest-VolumeDependencyTests-784302238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:19:35 devstack sudo[90701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:19:35 devstack sudo[90701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:19:35 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-856b7a2d-0a66-45df-9515-a33a1ab8a963 tempest-VolumeDependencyTests-784302238 None] Acquiring lock "cinder-f6503a79-17af-448d-90ba-42620a5c2b16-delete_volume" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:19:35 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-856b7a2d-0a66-45df-9515-a33a1ab8a963 tempest-VolumeDependencyTests-784302238 None] Lock "cinder-f6503a79-17af-448d-90ba-42620a5c2b16-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:19:35 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-856b7a2d-0a66-45df-9515-a33a1ab8a963 tempest-VolumeDependencyTests-784302238 None] Acquiring lock "cinder-quobyte-f6503a79-17af-448d-90ba-42620a5c2b16" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:19:35 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-856b7a2d-0a66-45df-9515-a33a1ab8a963 tempest-VolumeDependencyTests-784302238 None] Lock "cinder-quobyte-f6503a79-17af-448d-90ba-42620a5c2b16" acquired by "delete_volume" :: waited 0.007s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:19:35 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[47d3b15e-a513-4603-821d-45221115ef50]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:19:35 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-856b7a2d-0a66-45df-9515-a33a1ab8a963 tempest-VolumeDependencyTests-784302238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-f6503a79-17af-448d-90ba-42620a5c2b16 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:19:35 devstack sudo[90703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-f6503a79-17af-448d-90ba-42620a5c2b16
Apr 10 13:19:35 devstack sudo[90703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:19:35 devstack sudo[90701]: pam_unix(sudo:session): session closed for user root
Apr 10 13:19:35 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-80deaa34-6fc0-486b-bfe7-a7ff67bb43e5 tempest-VolumeDependencyTests-784302238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.441s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:19:35 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-80deaa34-6fc0-486b-bfe7-a7ff67bb43e5 tempest-VolumeDependencyTests-784302238 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:19:35 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-80deaa34-6fc0-486b-bfe7-a7ff67bb43e5 tempest-VolumeDependencyTests-784302238 None] Deleted volume successfully.
Apr 10 13:19:35 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-80deaa34-6fc0-486b-bfe7-a7ff67bb43e5 tempest-VolumeDependencyTests-784302238 None] Lock "cinder-4d4df908-ba15-4086-829f-79ebb904fc8a-delete_volume" released by "delete_volume" :: held 1.491s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:19:35 devstack sudo[90703]: pam_unix(sudo:session): session closed for user root
Apr 10 13:19:35 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-856b7a2d-0a66-45df-9515-a33a1ab8a963 tempest-VolumeDependencyTests-784302238 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-f6503a79-17af-448d-90ba-42620a5c2b16" returned: 0 in 0.485s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:19:35 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-856b7a2d-0a66-45df-9515-a33a1ab8a963 tempest-VolumeDependencyTests-784302238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-f6503a79-17af-448d-90ba-42620a5c2b16 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:19:35 devstack sudo[90709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-f6503a79-17af-448d-90ba-42620a5c2b16
Apr 10 13:19:35 devstack sudo[90709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:19:36 devstack sudo[90709]: pam_unix(sudo:session): session closed for user root
Apr 10 13:19:36 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-856b7a2d-0a66-45df-9515-a33a1ab8a963 tempest-VolumeDependencyTests-784302238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-f6503a79-17af-448d-90ba-42620a5c2b16" returned: 0 in 0.413s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:19:36 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-856b7a2d-0a66-45df-9515-a33a1ab8a963 tempest-VolumeDependencyTests-784302238 None] Lock "cinder-quobyte-f6503a79-17af-448d-90ba-42620a5c2b16" released by "delete_volume" :: held 0.926s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:19:36 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-856b7a2d-0a66-45df-9515-a33a1ab8a963 tempest-VolumeDependencyTests-784302238 None] Created reservations ['b5ba673b-704e-4ce1-9c26-4ee22db31d48', 'add2677a-bb90-47b2-ace6-270a881910e1', '7d8227bd-3988-4135-b1ed-79bdcdcd88f4', '049a85cc-2e14-49f5-bff5-8d5500c0d7e4'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:19:36 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-856b7a2d-0a66-45df-9515-a33a1ab8a963 tempest-VolumeDependencyTests-784302238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:19:36 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-856b7a2d-0a66-45df-9515-a33a1ab8a963 tempest-VolumeDependencyTests-784302238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:19:36 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-856b7a2d-0a66-45df-9515-a33a1ab8a963 tempest-VolumeDependencyTests-784302238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:19:36 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-856b7a2d-0a66-45df-9515-a33a1ab8a963 tempest-VolumeDependencyTests-784302238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:19:36 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-856b7a2d-0a66-45df-9515-a33a1ab8a963 tempest-VolumeDependencyTests-784302238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:19:36 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-856b7a2d-0a66-45df-9515-a33a1ab8a963 tempest-VolumeDependencyTests-784302238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:19:36 devstack sudo[90712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:19:36 devstack sudo[90712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:19:36 devstack sudo[90712]: pam_unix(sudo:session): session closed for user root
Apr 10 13:19:36 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-856b7a2d-0a66-45df-9515-a33a1ab8a963 tempest-VolumeDependencyTests-784302238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.457s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:19:36 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-856b7a2d-0a66-45df-9515-a33a1ab8a963 tempest-VolumeDependencyTests-784302238 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:19:36 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-856b7a2d-0a66-45df-9515-a33a1ab8a963 tempest-VolumeDependencyTests-784302238 None] Deleted volume successfully.
Apr 10 13:19:36 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-856b7a2d-0a66-45df-9515-a33a1ab8a963 tempest-VolumeDependencyTests-784302238 None] Lock "cinder-f6503a79-17af-448d-90ba-42620a5c2b16-delete_volume" released by "delete_volume" :: held 1.504s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:19:43 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f2e7b34-ae57-4625-bb89-5c1081ffc79a tempest-CreateVolumesFromSnapshotTest-1784307287 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:19:43 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-1f2e7b34-ae57-4625-bb89-5c1081ffc79a tempest-CreateVolumesFromSnapshotTest-1784307287 None] Flow 'volume_create_manager' (2002621d-5bc4-42d5-83ed-445ba3e2f1e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:19:43 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-1f2e7b34-ae57-4625-bb89-5c1081ffc79a tempest-CreateVolumesFromSnapshotTest-1784307287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a3f244c-0302-4a53-89ee-5fda5545e675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:19:43 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-1f2e7b34-ae57-4625-bb89-5c1081ffc79a tempest-CreateVolumesFromSnapshotTest-1784307287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a3f244c-0302-4a53-89ee-5fda5545e675) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:19:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-879570687',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2529db32-32c8-4010-a67c-17c41254c290,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a18e4377f1c74528bb941686c897075f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:19:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:19:43Z,use_quota=True,user_id='7b4ce4eac6304d9684ac825aeb5fb7a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:19:43 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-1f2e7b34-ae57-4625-bb89-5c1081ffc79a tempest-CreateVolumesFromSnapshotTest-1784307287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccade324-03a0-498e-b29d-12be844effe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:19:43 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-1f2e7b34-ae57-4625-bb89-5c1081ffc79a tempest-CreateVolumesFromSnapshotTest-1784307287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccade324-03a0-498e-b29d-12be844effe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:19:43 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-1f2e7b34-ae57-4625-bb89-5c1081ffc79a tempest-CreateVolumesFromSnapshotTest-1784307287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35c7746b-512d-42d2-89be-54f5a6da45aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:19:43 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-1f2e7b34-ae57-4625-bb89-5c1081ffc79a tempest-CreateVolumesFromSnapshotTest-1784307287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35c7746b-512d-42d2-89be-54f5a6da45aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2529db32-32c8-4010-a67c-17c41254c290', 'volume_name': 'volume-2529db32-32c8-4010-a67c-17c41254c290', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:19:43 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-1f2e7b34-ae57-4625-bb89-5c1081ffc79a tempest-CreateVolumesFromSnapshotTest-1784307287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (087e412d-d150-411b-b3ce-e2b9a9789516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:19:43 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-1f2e7b34-ae57-4625-bb89-5c1081ffc79a tempest-CreateVolumesFromSnapshotTest-1784307287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (087e412d-d150-411b-b3ce-e2b9a9789516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:19:43 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-1f2e7b34-ae57-4625-bb89-5c1081ffc79a tempest-CreateVolumesFromSnapshotTest-1784307287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf68bc6a-021a-4699-b93b-b85c568f2789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:19:43 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-1f2e7b34-ae57-4625-bb89-5c1081ffc79a tempest-CreateVolumesFromSnapshotTest-1784307287 None] Volume 2529db32-32c8-4010-a67c-17c41254c290: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2529db32-32c8-4010-a67c-17c41254c290', 'volume_size': 1}
Apr 10 13:19:43 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-1f2e7b34-ae57-4625-bb89-5c1081ffc79a tempest-CreateVolumesFromSnapshotTest-1784307287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:19:43 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-1f2e7b34-ae57-4625-bb89-5c1081ffc79a tempest-CreateVolumesFromSnapshotTest-1784307287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:19:43 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-1f2e7b34-ae57-4625-bb89-5c1081ffc79a tempest-CreateVolumesFromSnapshotTest-1784307287 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f252bf08b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:19:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-879570687',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2529db32-32c8-4010-a67c-17c41254c290,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a18e4377f1c74528bb941686c897075f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:19:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:19:43Z,use_quota=True,user_id='7b4ce4eac6304d9684ac825aeb5fb7a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)}" {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 13:19:43 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-1f2e7b34-ae57-4625-bb89-5c1081ffc79a tempest-CreateVolumesFromSnapshotTest-1784307287 None] Creating volume 2529db32-32c8-4010-a67c-17c41254c290 {{(pid=83345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 13:19:43 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-1f2e7b34-ae57-4625-bb89-5c1081ffc79a tempest-CreateVolumesFromSnapshotTest-1784307287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:19:43 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-1f2e7b34-ae57-4625-bb89-5c1081ffc79a tempest-CreateVolumesFromSnapshotTest-1784307287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:19:43 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-1f2e7b34-ae57-4625-bb89-5c1081ffc79a tempest-CreateVolumesFromSnapshotTest-1784307287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:19:43 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-1f2e7b34-ae57-4625-bb89-5c1081ffc79a tempest-CreateVolumesFromSnapshotTest-1784307287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:19:43 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-1f2e7b34-ae57-4625-bb89-5c1081ffc79a tempest-CreateVolumesFromSnapshotTest-1784307287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:19:43 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-1f2e7b34-ae57-4625-bb89-5c1081ffc79a tempest-CreateVolumesFromSnapshotTest-1784307287 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:19:43 devstack cinder-volume[83345]: INFO cinder.volume.drivers.remotefs [None req-1f2e7b34-ae57-4625-bb89-5c1081ffc79a tempest-CreateVolumesFromSnapshotTest-1784307287 None] casted to osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331
Apr 10 13:19:43 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-1f2e7b34-ae57-4625-bb89-5c1081ffc79a tempest-CreateVolumesFromSnapshotTest-1784307287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-2529db32-32c8-4010-a67c-17c41254c290 1073741824 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:19:43 devstack sudo[90755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-2529db32-32c8-4010-a67c-17c41254c290 1073741824
Apr 10 13:19:43 devstack sudo[90755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:19:43 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e737e01-4ca4-43bc-b04c-487fffc47ed6 tempest-VolumeDependencyTests-1052055728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:19:43 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-9e737e01-4ca4-43bc-b04c-487fffc47ed6 tempest-VolumeDependencyTests-1052055728 None] Flow 'volume_create_manager' (070b6bee-e364-496a-b095-a367137638ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:19:43 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-9e737e01-4ca4-43bc-b04c-487fffc47ed6 tempest-VolumeDependencyTests-1052055728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a99664b3-ffcb-4e25-be80-4ccc82fad978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:19:43 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-9e737e01-4ca4-43bc-b04c-487fffc47ed6 tempest-VolumeDependencyTests-1052055728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a99664b3-ffcb-4e25-be80-4ccc82fad978) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:19:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1620361560',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51731cea-d883-4a30-a10a-53c990e379c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b860b753090645ad91f52b3e138634de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:19:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:19:43Z,use_quota=True,user_id='866c4ed007134f509b6d0152fa189d0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:19:43 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-9e737e01-4ca4-43bc-b04c-487fffc47ed6 tempest-VolumeDependencyTests-1052055728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d67bfc72-23f3-468f-8f28-3539fc6e053c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:19:43 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-9e737e01-4ca4-43bc-b04c-487fffc47ed6 tempest-VolumeDependencyTests-1052055728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d67bfc72-23f3-468f-8f28-3539fc6e053c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:19:43 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-9e737e01-4ca4-43bc-b04c-487fffc47ed6 tempest-VolumeDependencyTests-1052055728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45e531ce-18fb-4d2b-a021-2591f0891ebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:19:43 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-9e737e01-4ca4-43bc-b04c-487fffc47ed6 tempest-VolumeDependencyTests-1052055728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45e531ce-18fb-4d2b-a021-2591f0891ebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51731cea-d883-4a30-a10a-53c990e379c4', 'volume_name': 'volume-51731cea-d883-4a30-a10a-53c990e379c4', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:19:43 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-9e737e01-4ca4-43bc-b04c-487fffc47ed6 tempest-VolumeDependencyTests-1052055728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05e486f0-c4e2-4c3a-909c-0540749583eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:19:43 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-9e737e01-4ca4-43bc-b04c-487fffc47ed6 tempest-VolumeDependencyTests-1052055728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05e486f0-c4e2-4c3a-909c-0540749583eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:19:43 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-9e737e01-4ca4-43bc-b04c-487fffc47ed6 tempest-VolumeDependencyTests-1052055728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b032b17-1cde-4970-9382-1e9f242d5d92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:19:43 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-9e737e01-4ca4-43bc-b04c-487fffc47ed6 tempest-VolumeDependencyTests-1052055728 None] Volume 51731cea-d883-4a30-a10a-53c990e379c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51731cea-d883-4a30-a10a-53c990e379c4', 'volume_size': 1}
Apr 10 13:19:43 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-9e737e01-4ca4-43bc-b04c-487fffc47ed6 tempest-VolumeDependencyTests-1052055728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:19:43 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-88e325fc-289f-45a1-a658-471c41789b41 tempest-CreateVolumesFromImageTest-885723365 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:19:43 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-88e325fc-289f-45a1-a658-471c41789b41 tempest-CreateVolumesFromImageTest-885723365 None] Flow 'volume_create_manager' (57de2476-caee-4ff6-a5c2-381fd762d79d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:19:43 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-88e325fc-289f-45a1-a658-471c41789b41 tempest-CreateVolumesFromImageTest-885723365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ce8fda7-1b68-465b-b95c-7b5ab22321fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:19:43 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-88e325fc-289f-45a1-a658-471c41789b41 tempest-CreateVolumesFromImageTest-885723365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ce8fda7-1b68-465b-b95c-7b5ab22321fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:19:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-807317758',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c22068b8-c3fd-44af-bb88-ab44c3ec5a3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89bf312972314f27977b368c37be4364',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:19:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:19:44Z,use_quota=True,user_id='d12bbf695b8442fba9e6a64813b7aabb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:19:43 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-88e325fc-289f-45a1-a658-471c41789b41 tempest-CreateVolumesFromImageTest-885723365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43f850d3-85cc-4a84-865a-e61859f313f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:19:43 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-88e325fc-289f-45a1-a658-471c41789b41 tempest-CreateVolumesFromImageTest-885723365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43f850d3-85cc-4a84-865a-e61859f313f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:19:43 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-88e325fc-289f-45a1-a658-471c41789b41 tempest-CreateVolumesFromImageTest-885723365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da106f73-fd01-481a-aa4f-5111dc68a30d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:19:43 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-88e325fc-289f-45a1-a658-471c41789b41 tempest-CreateVolumesFromImageTest-885723365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da106f73-fd01-481a-aa4f-5111dc68a30d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c22068b8-c3fd-44af-bb88-ab44c3ec5a3a', 'volume_name': 'volume-c22068b8-c3fd-44af-bb88-ab44c3ec5a3a', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:19:43 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-88e325fc-289f-45a1-a658-471c41789b41 tempest-CreateVolumesFromImageTest-885723365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (027e8982-bc3d-427a-ae3c-00ed46792061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:19:43 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-88e325fc-289f-45a1-a658-471c41789b41 tempest-CreateVolumesFromImageTest-885723365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (027e8982-bc3d-427a-ae3c-00ed46792061) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:19:43 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-88e325fc-289f-45a1-a658-471c41789b41 tempest-CreateVolumesFromImageTest-885723365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bb397b5-9004-47dc-a0d4-9762343a6826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:19:43 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-88e325fc-289f-45a1-a658-471c41789b41 tempest-CreateVolumesFromImageTest-885723365 None] Volume c22068b8-c3fd-44af-bb88-ab44c3ec5a3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c22068b8-c3fd-44af-bb88-ab44c3ec5a3a', 'volume_size': 1}
Apr 10 13:19:43 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-88e325fc-289f-45a1-a658-471c41789b41 tempest-CreateVolumesFromImageTest-885723365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:19:43 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ee7aba0-eee0-49ed-a86d-e6052e33dca1 tempest-CreateVolumesFromImageTest-885723365 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:19:43 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-4ee7aba0-eee0-49ed-a86d-e6052e33dca1 tempest-CreateVolumesFromImageTest-885723365 None] Flow 'volume_create_manager' (4d386074-0373-4cb8-a01c-1231dab0723d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:19:43 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-4ee7aba0-eee0-49ed-a86d-e6052e33dca1 tempest-CreateVolumesFromImageTest-885723365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48cd9588-20c0-4399-b5ee-d107b1b5a634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:19:43 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-4ee7aba0-eee0-49ed-a86d-e6052e33dca1 tempest-CreateVolumesFromImageTest-885723365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48cd9588-20c0-4399-b5ee-d107b1b5a634) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:19:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1708774484',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=864a7f83-e5b2-4dc1-a140-0b41692aa303,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89bf312972314f27977b368c37be4364',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:19:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:19:44Z,use_quota=True,user_id='d12bbf695b8442fba9e6a64813b7aabb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:19:43 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-4ee7aba0-eee0-49ed-a86d-e6052e33dca1 tempest-CreateVolumesFromImageTest-885723365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (092860b7-97c8-4fe0-a3ab-822c393c9c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:19:43 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-4ee7aba0-eee0-49ed-a86d-e6052e33dca1 tempest-CreateVolumesFromImageTest-885723365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (092860b7-97c8-4fe0-a3ab-822c393c9c18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:19:43 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-4ee7aba0-eee0-49ed-a86d-e6052e33dca1 tempest-CreateVolumesFromImageTest-885723365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f65aeb6-91a6-4167-8bca-69380fa0afaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:19:43 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-4ee7aba0-eee0-49ed-a86d-e6052e33dca1 tempest-CreateVolumesFromImageTest-885723365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f65aeb6-91a6-4167-8bca-69380fa0afaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '864a7f83-e5b2-4dc1-a140-0b41692aa303', 'volume_name': 'volume-864a7f83-e5b2-4dc1-a140-0b41692aa303', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:19:43 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-4ee7aba0-eee0-49ed-a86d-e6052e33dca1 tempest-CreateVolumesFromImageTest-885723365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78584d1d-75da-40d6-8f3a-a3b03b96e29d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:19:43 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-4ee7aba0-eee0-49ed-a86d-e6052e33dca1 tempest-CreateVolumesFromImageTest-885723365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78584d1d-75da-40d6-8f3a-a3b03b96e29d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:19:43 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-4ee7aba0-eee0-49ed-a86d-e6052e33dca1 tempest-CreateVolumesFromImageTest-885723365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29626bc0-0116-4542-9949-e10ce73e6122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:19:43 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-4ee7aba0-eee0-49ed-a86d-e6052e33dca1 tempest-CreateVolumesFromImageTest-885723365 None] Volume 864a7f83-e5b2-4dc1-a140-0b41692aa303: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-864a7f83-e5b2-4dc1-a140-0b41692aa303', 'volume_size': 1}
Apr 10 13:19:43 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-4ee7aba0-eee0-49ed-a86d-e6052e33dca1 tempest-CreateVolumesFromImageTest-885723365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:19:44 devstack sudo[90755]: pam_unix(sudo:session): session closed for user root
Apr 10 13:19:44 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-1f2e7b34-ae57-4625-bb89-5c1081ffc79a tempest-CreateVolumesFromSnapshotTest-1784307287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-2529db32-32c8-4010-a67c-17c41254c290 1073741824" returned: 0 in 0.628s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:19:44 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-1f2e7b34-ae57-4625-bb89-5c1081ffc79a tempest-CreateVolumesFromSnapshotTest-1784307287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-2529db32-32c8-4010-a67c-17c41254c290 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:19:44 devstack sudo[90760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-2529db32-32c8-4010-a67c-17c41254c290
Apr 10 13:19:44 devstack sudo[90760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:19:44 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed610734-81f7-4fc6-83eb-62bd695e568d tempest-CreateVolumesFromImageTest-885723365 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:19:44 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ed610734-81f7-4fc6-83eb-62bd695e568d tempest-CreateVolumesFromImageTest-885723365 None] Flow 'volume_create_manager' (3cdd84c3-4c81-4044-b766-e1d08f4bc923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:19:44 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ed610734-81f7-4fc6-83eb-62bd695e568d tempest-CreateVolumesFromImageTest-885723365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b811289-cde9-40cc-8c19-933c9bf189bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:19:44 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ed610734-81f7-4fc6-83eb-62bd695e568d tempest-CreateVolumesFromImageTest-885723365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b811289-cde9-40cc-8c19-933c9bf189bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:19:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1243939048',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1cf9098-6200-4bbe-8d86-97d5008960fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89bf312972314f27977b368c37be4364',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:19:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:19:44Z,use_quota=True,user_id='d12bbf695b8442fba9e6a64813b7aabb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:19:44 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ed610734-81f7-4fc6-83eb-62bd695e568d tempest-CreateVolumesFromImageTest-885723365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61f4ec48-62ce-4003-8cfa-594990cb2156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:19:44 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ed610734-81f7-4fc6-83eb-62bd695e568d tempest-CreateVolumesFromImageTest-885723365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61f4ec48-62ce-4003-8cfa-594990cb2156) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:19:44 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ed610734-81f7-4fc6-83eb-62bd695e568d tempest-CreateVolumesFromImageTest-885723365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e89993b-8d9b-4b45-aeae-d304ff722aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:19:44 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ed610734-81f7-4fc6-83eb-62bd695e568d tempest-CreateVolumesFromImageTest-885723365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e89993b-8d9b-4b45-aeae-d304ff722aa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1cf9098-6200-4bbe-8d86-97d5008960fa', 'volume_name': 'volume-a1cf9098-6200-4bbe-8d86-97d5008960fa', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:19:44 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ed610734-81f7-4fc6-83eb-62bd695e568d tempest-CreateVolumesFromImageTest-885723365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7859a7fa-4f21-44f1-afe8-bd9161fe3fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:19:44 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ed610734-81f7-4fc6-83eb-62bd695e568d tempest-CreateVolumesFromImageTest-885723365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7859a7fa-4f21-44f1-afe8-bd9161fe3fc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:19:44 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ed610734-81f7-4fc6-83eb-62bd695e568d tempest-CreateVolumesFromImageTest-885723365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dbb0c35-d105-4385-ae96-f46de361fdaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:19:44 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-ed610734-81f7-4fc6-83eb-62bd695e568d tempest-CreateVolumesFromImageTest-885723365 None] Volume a1cf9098-6200-4bbe-8d86-97d5008960fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1cf9098-6200-4bbe-8d86-97d5008960fa', 'volume_size': 1}
Apr 10 13:19:44 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-ed610734-81f7-4fc6-83eb-62bd695e568d tempest-CreateVolumesFromImageTest-885723365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:19:44 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-3da8d59d-d912-4705-b4dd-367d1dc7e000 tempest-CreateVolumesFromImageTest-885723365 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:19:44 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-3da8d59d-d912-4705-b4dd-367d1dc7e000 tempest-CreateVolumesFromImageTest-885723365 None] Flow 'volume_create_manager' (2856ae41-3eeb-4843-a00a-2eba17fd9530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:19:44 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-3da8d59d-d912-4705-b4dd-367d1dc7e000 tempest-CreateVolumesFromImageTest-885723365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c840a592-7a85-4f40-83cf-6fd19c79ca73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:19:44 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-3da8d59d-d912-4705-b4dd-367d1dc7e000 tempest-CreateVolumesFromImageTest-885723365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c840a592-7a85-4f40-83cf-6fd19c79ca73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:19:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1857274732',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac0224ab-26f8-47a8-ab27-eb486a615cc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89bf312972314f27977b368c37be4364',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:19:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:19:44Z,use_quota=True,user_id='d12bbf695b8442fba9e6a64813b7aabb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:19:44 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-3da8d59d-d912-4705-b4dd-367d1dc7e000 tempest-CreateVolumesFromImageTest-885723365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7435ec6-3a6e-42f9-9c62-1fff0acdc60e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:19:44 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-3da8d59d-d912-4705-b4dd-367d1dc7e000 tempest-CreateVolumesFromImageTest-885723365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7435ec6-3a6e-42f9-9c62-1fff0acdc60e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:19:44 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-3da8d59d-d912-4705-b4dd-367d1dc7e000 tempest-CreateVolumesFromImageTest-885723365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc2a325e-85fb-4ce7-af3f-ec2f6c849042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:19:44 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-3da8d59d-d912-4705-b4dd-367d1dc7e000 tempest-CreateVolumesFromImageTest-885723365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc2a325e-85fb-4ce7-af3f-ec2f6c849042) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac0224ab-26f8-47a8-ab27-eb486a615cc1', 'volume_name': 'volume-ac0224ab-26f8-47a8-ab27-eb486a615cc1', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:19:44 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-3da8d59d-d912-4705-b4dd-367d1dc7e000 tempest-CreateVolumesFromImageTest-885723365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (836c8013-cfed-434c-abf3-3362ade2db81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:19:44 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-3da8d59d-d912-4705-b4dd-367d1dc7e000 tempest-CreateVolumesFromImageTest-885723365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (836c8013-cfed-434c-abf3-3362ade2db81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:19:44 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-3da8d59d-d912-4705-b4dd-367d1dc7e000 tempest-CreateVolumesFromImageTest-885723365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f056be25-cb6d-4cbb-8c87-d80b057a29f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:19:44 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-3da8d59d-d912-4705-b4dd-367d1dc7e000 tempest-CreateVolumesFromImageTest-885723365 None] Volume ac0224ab-26f8-47a8-ab27-eb486a615cc1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac0224ab-26f8-47a8-ab27-eb486a615cc1', 'volume_size': 1}
Apr 10 13:19:44 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-3da8d59d-d912-4705-b4dd-367d1dc7e000 tempest-CreateVolumesFromImageTest-885723365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:19:44 devstack sudo[90760]: pam_unix(sudo:session): session closed for user root
Apr 10 13:19:44 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-1f2e7b34-ae57-4625-bb89-5c1081ffc79a tempest-CreateVolumesFromSnapshotTest-1784307287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-2529db32-32c8-4010-a67c-17c41254c290" returned: 0 in 0.522s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:19:44 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-1f2e7b34-ae57-4625-bb89-5c1081ffc79a tempest-CreateVolumesFromSnapshotTest-1784307287 None] <== create_volume: return (1182ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'} {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 13:19:44 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-1f2e7b34-ae57-4625-bb89-5c1081ffc79a tempest-CreateVolumesFromSnapshotTest-1784307287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.184s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:19:44 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-9e737e01-4ca4-43bc-b04c-487fffc47ed6 tempest-VolumeDependencyTests-1052055728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.034s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:19:44 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-9e737e01-4ca4-43bc-b04c-487fffc47ed6 tempest-VolumeDependencyTests-1052055728 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f252bf08b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:19:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1620361560',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51731cea-d883-4a30-a10a-53c990e379c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b860b753090645ad91f52b3e138634de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:19:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:19:43Z,use_quota=True,user_id='866c4ed007134f509b6d0152fa189d0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)}" {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 13:19:44 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-9e737e01-4ca4-43bc-b04c-487fffc47ed6 tempest-VolumeDependencyTests-1052055728 None] Creating volume 51731cea-d883-4a30-a10a-53c990e379c4 {{(pid=83345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 13:19:44 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-9e737e01-4ca4-43bc-b04c-487fffc47ed6 tempest-VolumeDependencyTests-1052055728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:19:44 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-9e737e01-4ca4-43bc-b04c-487fffc47ed6 tempest-VolumeDependencyTests-1052055728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:19:44 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-9e737e01-4ca4-43bc-b04c-487fffc47ed6 tempest-VolumeDependencyTests-1052055728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:19:44 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-9e737e01-4ca4-43bc-b04c-487fffc47ed6 tempest-VolumeDependencyTests-1052055728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:19:44 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-9e737e01-4ca4-43bc-b04c-487fffc47ed6 tempest-VolumeDependencyTests-1052055728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:19:44 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-9e737e01-4ca4-43bc-b04c-487fffc47ed6 tempest-VolumeDependencyTests-1052055728 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:19:44 devstack cinder-volume[83345]: INFO cinder.volume.drivers.remotefs [None req-9e737e01-4ca4-43bc-b04c-487fffc47ed6 tempest-VolumeDependencyTests-1052055728 None] casted to osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331
Apr 10 13:19:44 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-9e737e01-4ca4-43bc-b04c-487fffc47ed6 tempest-VolumeDependencyTests-1052055728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-51731cea-d883-4a30-a10a-53c990e379c4 1073741824 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:19:44 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-1f2e7b34-ae57-4625-bb89-5c1081ffc79a tempest-CreateVolumesFromSnapshotTest-1784307287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf68bc6a-021a-4699-b93b-b85c568f2789) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2529db32-32c8-4010-a67c-17c41254c290', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:19:44 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-1f2e7b34-ae57-4625-bb89-5c1081ffc79a tempest-CreateVolumesFromSnapshotTest-1784307287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef1f2ba7-6a56-4a53-bf86-ffb7281a78ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:19:44 devstack sudo[90763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-51731cea-d883-4a30-a10a-53c990e379c4 1073741824
Apr 10 13:19:44 devstack sudo[90763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:19:44 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-1f2e7b34-ae57-4625-bb89-5c1081ffc79a tempest-CreateVolumesFromSnapshotTest-1784307287 None] Volume volume-2529db32-32c8-4010-a67c-17c41254c290 (2529db32-32c8-4010-a67c-17c41254c290): created successfully
Apr 10 13:19:44 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-1f2e7b34-ae57-4625-bb89-5c1081ffc79a tempest-CreateVolumesFromSnapshotTest-1784307287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef1f2ba7-6a56-4a53-bf86-ffb7281a78ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:19:44 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-1f2e7b34-ae57-4625-bb89-5c1081ffc79a tempest-CreateVolumesFromSnapshotTest-1784307287 None] Flow 'volume_create_manager' (2002621d-5bc4-42d5-83ed-445ba3e2f1e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:19:44 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-1f2e7b34-ae57-4625-bb89-5c1081ffc79a tempest-CreateVolumesFromSnapshotTest-1784307287 None] Created volume successfully.
Apr 10 13:19:44 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-e80ab30a-98bd-45e2-821e-79ac4455b1ce tempest-CreateVolumesFromImageTest-885723365 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:19:44 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-e80ab30a-98bd-45e2-821e-79ac4455b1ce tempest-CreateVolumesFromImageTest-885723365 None] Flow 'volume_create_manager' (5f34247c-3eeb-489b-b957-b3f21ab852a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:19:44 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-e80ab30a-98bd-45e2-821e-79ac4455b1ce tempest-CreateVolumesFromImageTest-885723365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f29738a1-5a03-44a0-ba21-d7f35ca15ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:19:44 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-e80ab30a-98bd-45e2-821e-79ac4455b1ce tempest-CreateVolumesFromImageTest-885723365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f29738a1-5a03-44a0-ba21-d7f35ca15ded) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:19:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1140583188',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcd0dddb-67aa-4708-aa9b-954fb7263479,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89bf312972314f27977b368c37be4364',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:19:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:19:45Z,use_quota=True,user_id='d12bbf695b8442fba9e6a64813b7aabb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:19:44 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-e80ab30a-98bd-45e2-821e-79ac4455b1ce tempest-CreateVolumesFromImageTest-885723365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (630d8dea-301d-420b-ad56-c13abdeff4a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:19:44 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-e80ab30a-98bd-45e2-821e-79ac4455b1ce tempest-CreateVolumesFromImageTest-885723365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (630d8dea-301d-420b-ad56-c13abdeff4a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:19:44 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-e80ab30a-98bd-45e2-821e-79ac4455b1ce tempest-CreateVolumesFromImageTest-885723365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73390be9-a87c-4b5c-9142-84cca81e63d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:19:44 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-e80ab30a-98bd-45e2-821e-79ac4455b1ce tempest-CreateVolumesFromImageTest-885723365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73390be9-a87c-4b5c-9142-84cca81e63d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dcd0dddb-67aa-4708-aa9b-954fb7263479', 'volume_name': 'volume-dcd0dddb-67aa-4708-aa9b-954fb7263479', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:19:44 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-e80ab30a-98bd-45e2-821e-79ac4455b1ce tempest-CreateVolumesFromImageTest-885723365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98515811-b306-4ac7-b50b-f8ff79b5d632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:19:44 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-e80ab30a-98bd-45e2-821e-79ac4455b1ce tempest-CreateVolumesFromImageTest-885723365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98515811-b306-4ac7-b50b-f8ff79b5d632) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:19:44 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-e80ab30a-98bd-45e2-821e-79ac4455b1ce tempest-CreateVolumesFromImageTest-885723365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (027647cf-a759-44e0-8e7b-2bf9a8109b8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:19:44 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-e80ab30a-98bd-45e2-821e-79ac4455b1ce tempest-CreateVolumesFromImageTest-885723365 None] Volume dcd0dddb-67aa-4708-aa9b-954fb7263479: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dcd0dddb-67aa-4708-aa9b-954fb7263479', 'volume_size': 1}
Apr 10 13:19:44 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-e80ab30a-98bd-45e2-821e-79ac4455b1ce tempest-CreateVolumesFromImageTest-885723365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:19:45 devstack sudo[90763]: pam_unix(sudo:session): session closed for user root
Apr 10 13:19:45 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-9e737e01-4ca4-43bc-b04c-487fffc47ed6 tempest-VolumeDependencyTests-1052055728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-51731cea-d883-4a30-a10a-53c990e379c4 1073741824" returned: 0 in 0.563s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:19:45 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-9e737e01-4ca4-43bc-b04c-487fffc47ed6 tempest-VolumeDependencyTests-1052055728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-51731cea-d883-4a30-a10a-53c990e379c4 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:19:45 devstack sudo[90768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-51731cea-d883-4a30-a10a-53c990e379c4
Apr 10 13:19:45 devstack sudo[90768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:19:45 devstack sudo[90768]: pam_unix(sudo:session): session closed for user root
Apr 10 13:19:45 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-9e737e01-4ca4-43bc-b04c-487fffc47ed6 tempest-VolumeDependencyTests-1052055728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-51731cea-d883-4a30-a10a-53c990e379c4" returned: 0 in 0.411s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:19:45 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-9e737e01-4ca4-43bc-b04c-487fffc47ed6 tempest-VolumeDependencyTests-1052055728 None] <== create_volume: return (994ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'} {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 13:19:45 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-9e737e01-4ca4-43bc-b04c-487fffc47ed6 tempest-VolumeDependencyTests-1052055728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.997s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:19:45 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-88e325fc-289f-45a1-a658-471c41789b41 tempest-CreateVolumesFromImageTest-885723365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.866s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:19:45 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-88e325fc-289f-45a1-a658-471c41789b41 tempest-CreateVolumesFromImageTest-885723365 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f252bf08b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:19:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-807317758',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c22068b8-c3fd-44af-bb88-ab44c3ec5a3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89bf312972314f27977b368c37be4364',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:19:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:19:44Z,use_quota=True,user_id='d12bbf695b8442fba9e6a64813b7aabb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)}" {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 13:19:45 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-88e325fc-289f-45a1-a658-471c41789b41 tempest-CreateVolumesFromImageTest-885723365 None] Creating volume c22068b8-c3fd-44af-bb88-ab44c3ec5a3a {{(pid=83345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 13:19:45 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-88e325fc-289f-45a1-a658-471c41789b41 tempest-CreateVolumesFromImageTest-885723365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:19:45 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-88e325fc-289f-45a1-a658-471c41789b41 tempest-CreateVolumesFromImageTest-885723365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:19:45 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-88e325fc-289f-45a1-a658-471c41789b41 tempest-CreateVolumesFromImageTest-885723365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:19:45 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-88e325fc-289f-45a1-a658-471c41789b41 tempest-CreateVolumesFromImageTest-885723365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:19:45 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-88e325fc-289f-45a1-a658-471c41789b41 tempest-CreateVolumesFromImageTest-885723365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:19:45 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-88e325fc-289f-45a1-a658-471c41789b41 tempest-CreateVolumesFromImageTest-885723365 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:19:45 devstack cinder-volume[83345]: INFO cinder.volume.drivers.remotefs [None req-88e325fc-289f-45a1-a658-471c41789b41 tempest-CreateVolumesFromImageTest-885723365 None] casted to osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331
Apr 10 13:19:45 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-88e325fc-289f-45a1-a658-471c41789b41 tempest-CreateVolumesFromImageTest-885723365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-c22068b8-c3fd-44af-bb88-ab44c3ec5a3a 1073741824 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:19:45 devstack sudo[90771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-c22068b8-c3fd-44af-bb88-ab44c3ec5a3a 1073741824
Apr 10 13:19:45 devstack sudo[90771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:19:45 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-9e737e01-4ca4-43bc-b04c-487fffc47ed6 tempest-VolumeDependencyTests-1052055728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b032b17-1cde-4970-9382-1e9f242d5d92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51731cea-d883-4a30-a10a-53c990e379c4', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:19:45 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-9e737e01-4ca4-43bc-b04c-487fffc47ed6 tempest-VolumeDependencyTests-1052055728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (048cb08b-29c7-47ca-9c91-3e82a00764d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:19:45 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-9e737e01-4ca4-43bc-b04c-487fffc47ed6 tempest-VolumeDependencyTests-1052055728 None] Volume volume-51731cea-d883-4a30-a10a-53c990e379c4 (51731cea-d883-4a30-a10a-53c990e379c4): created successfully
Apr 10 13:19:45 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-9e737e01-4ca4-43bc-b04c-487fffc47ed6 tempest-VolumeDependencyTests-1052055728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (048cb08b-29c7-47ca-9c91-3e82a00764d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:19:45 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-9e737e01-4ca4-43bc-b04c-487fffc47ed6 tempest-VolumeDependencyTests-1052055728 None] Flow 'volume_create_manager' (070b6bee-e364-496a-b095-a367137638ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:19:45 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-9e737e01-4ca4-43bc-b04c-487fffc47ed6 tempest-VolumeDependencyTests-1052055728 None] Created volume successfully.
Apr 10 13:19:45 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-04f62c94-b1da-4591-8308-3244894a6e4c tempest-CreateVolumesFromSnapshotTest-1784307287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:19:46 devstack sudo[90771]: pam_unix(sudo:session): session closed for user root
Apr 10 13:19:46 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-88e325fc-289f-45a1-a658-471c41789b41 tempest-CreateVolumesFromImageTest-885723365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-c22068b8-c3fd-44af-bb88-ab44c3ec5a3a 1073741824" returned: 0 in 0.543s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:19:46 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-88e325fc-289f-45a1-a658-471c41789b41 tempest-CreateVolumesFromImageTest-885723365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-c22068b8-c3fd-44af-bb88-ab44c3ec5a3a {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:19:46 devstack sudo[90776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-c22068b8-c3fd-44af-bb88-ab44c3ec5a3a
Apr 10 13:19:46 devstack sudo[90776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:19:46 devstack sudo[90776]: pam_unix(sudo:session): session closed for user root
Apr 10 13:19:46 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-88e325fc-289f-45a1-a658-471c41789b41 tempest-CreateVolumesFromImageTest-885723365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-c22068b8-c3fd-44af-bb88-ab44c3ec5a3a" returned: 0 in 0.485s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:19:46 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-88e325fc-289f-45a1-a658-471c41789b41 tempest-CreateVolumesFromImageTest-885723365 None] <== create_volume: return (1069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'} {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 13:19:46 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-88e325fc-289f-45a1-a658-471c41789b41 tempest-CreateVolumesFromImageTest-885723365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.072s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:19:46 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-4ee7aba0-eee0-49ed-a86d-e6052e33dca1 tempest-CreateVolumesFromImageTest-885723365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.729s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:19:46 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-4ee7aba0-eee0-49ed-a86d-e6052e33dca1 tempest-CreateVolumesFromImageTest-885723365 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f252bf08b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:19:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1708774484',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=864a7f83-e5b2-4dc1-a140-0b41692aa303,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89bf312972314f27977b368c37be4364',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:19:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:19:44Z,use_quota=True,user_id='d12bbf695b8442fba9e6a64813b7aabb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)}" {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 13:19:46 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-4ee7aba0-eee0-49ed-a86d-e6052e33dca1 tempest-CreateVolumesFromImageTest-885723365 None] Creating volume 864a7f83-e5b2-4dc1-a140-0b41692aa303 {{(pid=83345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 13:19:46 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-4ee7aba0-eee0-49ed-a86d-e6052e33dca1 tempest-CreateVolumesFromImageTest-885723365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:19:46 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-4ee7aba0-eee0-49ed-a86d-e6052e33dca1 tempest-CreateVolumesFromImageTest-885723365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:19:46 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-4ee7aba0-eee0-49ed-a86d-e6052e33dca1 tempest-CreateVolumesFromImageTest-885723365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:19:46 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-4ee7aba0-eee0-49ed-a86d-e6052e33dca1 tempest-CreateVolumesFromImageTest-885723365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:19:46 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-4ee7aba0-eee0-49ed-a86d-e6052e33dca1 tempest-CreateVolumesFromImageTest-885723365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:19:46 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-4ee7aba0-eee0-49ed-a86d-e6052e33dca1 tempest-CreateVolumesFromImageTest-885723365 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:19:46 devstack cinder-volume[83345]: INFO cinder.volume.drivers.remotefs [None req-4ee7aba0-eee0-49ed-a86d-e6052e33dca1 tempest-CreateVolumesFromImageTest-885723365 None] casted to osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331
Apr 10 13:19:46 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-4ee7aba0-eee0-49ed-a86d-e6052e33dca1 tempest-CreateVolumesFromImageTest-885723365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-864a7f83-e5b2-4dc1-a140-0b41692aa303 1073741824 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:19:46 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-88e325fc-289f-45a1-a658-471c41789b41 tempest-CreateVolumesFromImageTest-885723365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bb397b5-9004-47dc-a0d4-9762343a6826) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c22068b8-c3fd-44af-bb88-ab44c3ec5a3a', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:19:46 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-88e325fc-289f-45a1-a658-471c41789b41 tempest-CreateVolumesFromImageTest-885723365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae53726f-8a4d-433b-960e-9476695a3033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:19:46 devstack sudo[90779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-864a7f83-e5b2-4dc1-a140-0b41692aa303 1073741824
Apr 10 13:19:46 devstack sudo[90779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:19:46 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-88e325fc-289f-45a1-a658-471c41789b41 tempest-CreateVolumesFromImageTest-885723365 None] Volume volume-c22068b8-c3fd-44af-bb88-ab44c3ec5a3a (c22068b8-c3fd-44af-bb88-ab44c3ec5a3a): created successfully
Apr 10 13:19:46 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-88e325fc-289f-45a1-a658-471c41789b41 tempest-CreateVolumesFromImageTest-885723365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae53726f-8a4d-433b-960e-9476695a3033) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:19:46 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-88e325fc-289f-45a1-a658-471c41789b41 tempest-CreateVolumesFromImageTest-885723365 None] Flow 'volume_create_manager' (57de2476-caee-4ff6-a5c2-381fd762d79d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:19:46 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-88e325fc-289f-45a1-a658-471c41789b41 tempest-CreateVolumesFromImageTest-885723365 None] Created volume successfully.
Apr 10 13:19:46 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-5827edb6-3885-46fa-bd41-01a743369106 tempest-VolumeDependencyTests-1052055728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:19:47 devstack sudo[90779]: pam_unix(sudo:session): session closed for user root
Apr 10 13:19:47 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-4ee7aba0-eee0-49ed-a86d-e6052e33dca1 tempest-CreateVolumesFromImageTest-885723365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-864a7f83-e5b2-4dc1-a140-0b41692aa303 1073741824" returned: 0 in 0.606s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:19:47 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-4ee7aba0-eee0-49ed-a86d-e6052e33dca1 tempest-CreateVolumesFromImageTest-885723365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-864a7f83-e5b2-4dc1-a140-0b41692aa303 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:19:47 devstack sudo[90786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-864a7f83-e5b2-4dc1-a140-0b41692aa303
Apr 10 13:19:47 devstack sudo[90786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:19:47 devstack sudo[90786]: pam_unix(sudo:session): session closed for user root
Apr 10 13:19:47 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-4ee7aba0-eee0-49ed-a86d-e6052e33dca1 tempest-CreateVolumesFromImageTest-885723365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-864a7f83-e5b2-4dc1-a140-0b41692aa303" returned: 0 in 0.424s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:19:47 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-4ee7aba0-eee0-49ed-a86d-e6052e33dca1 tempest-CreateVolumesFromImageTest-885723365 None] <== create_volume: return (1058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'} {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 13:19:47 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-4ee7aba0-eee0-49ed-a86d-e6052e33dca1 tempest-CreateVolumesFromImageTest-885723365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.062s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:19:47 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-ed610734-81f7-4fc6-83eb-62bd695e568d tempest-CreateVolumesFromImageTest-885723365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.544s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:19:47 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-ed610734-81f7-4fc6-83eb-62bd695e568d tempest-CreateVolumesFromImageTest-885723365 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f252bf08b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:19:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1243939048',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1cf9098-6200-4bbe-8d86-97d5008960fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89bf312972314f27977b368c37be4364',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:19:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:19:44Z,use_quota=True,user_id='d12bbf695b8442fba9e6a64813b7aabb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)}" {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 13:19:47 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-ed610734-81f7-4fc6-83eb-62bd695e568d tempest-CreateVolumesFromImageTest-885723365 None] Creating volume a1cf9098-6200-4bbe-8d86-97d5008960fa {{(pid=83345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 13:19:47 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-ed610734-81f7-4fc6-83eb-62bd695e568d tempest-CreateVolumesFromImageTest-885723365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:19:47 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-ed610734-81f7-4fc6-83eb-62bd695e568d tempest-CreateVolumesFromImageTest-885723365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:19:47 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-ed610734-81f7-4fc6-83eb-62bd695e568d tempest-CreateVolumesFromImageTest-885723365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:19:47 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-ed610734-81f7-4fc6-83eb-62bd695e568d tempest-CreateVolumesFromImageTest-885723365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:19:47 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-ed610734-81f7-4fc6-83eb-62bd695e568d tempest-CreateVolumesFromImageTest-885723365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:19:47 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-ed610734-81f7-4fc6-83eb-62bd695e568d tempest-CreateVolumesFromImageTest-885723365 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:19:47 devstack cinder-volume[83345]: INFO cinder.volume.drivers.remotefs [None req-ed610734-81f7-4fc6-83eb-62bd695e568d tempest-CreateVolumesFromImageTest-885723365 None] casted to osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331
Apr 10 13:19:47 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ed610734-81f7-4fc6-83eb-62bd695e568d tempest-CreateVolumesFromImageTest-885723365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-a1cf9098-6200-4bbe-8d86-97d5008960fa 1073741824 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:19:47 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-4ee7aba0-eee0-49ed-a86d-e6052e33dca1 tempest-CreateVolumesFromImageTest-885723365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29626bc0-0116-4542-9949-e10ce73e6122) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-864a7f83-e5b2-4dc1-a140-0b41692aa303', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:19:47 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-4ee7aba0-eee0-49ed-a86d-e6052e33dca1 tempest-CreateVolumesFromImageTest-885723365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef7541b1-c84a-4b03-a80a-5fccf9e85398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:19:47 devstack sudo[90789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-a1cf9098-6200-4bbe-8d86-97d5008960fa 1073741824
Apr 10 13:19:47 devstack sudo[90789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:19:47 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-4ee7aba0-eee0-49ed-a86d-e6052e33dca1 tempest-CreateVolumesFromImageTest-885723365 None] Volume volume-864a7f83-e5b2-4dc1-a140-0b41692aa303 (864a7f83-e5b2-4dc1-a140-0b41692aa303): created successfully
Apr 10 13:19:47 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-4ee7aba0-eee0-49ed-a86d-e6052e33dca1 tempest-CreateVolumesFromImageTest-885723365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef7541b1-c84a-4b03-a80a-5fccf9e85398) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:19:47 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-4ee7aba0-eee0-49ed-a86d-e6052e33dca1 tempest-CreateVolumesFromImageTest-885723365 None] Flow 'volume_create_manager' (4d386074-0373-4cb8-a01c-1231dab0723d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:19:47 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-4ee7aba0-eee0-49ed-a86d-e6052e33dca1 tempest-CreateVolumesFromImageTest-885723365 None] Created volume successfully.
Apr 10 13:19:48 devstack sudo[90789]: pam_unix(sudo:session): session closed for user root
Apr 10 13:19:48 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ed610734-81f7-4fc6-83eb-62bd695e568d tempest-CreateVolumesFromImageTest-885723365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-a1cf9098-6200-4bbe-8d86-97d5008960fa 1073741824" returned: 0 in 0.547s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:19:48 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ed610734-81f7-4fc6-83eb-62bd695e568d tempest-CreateVolumesFromImageTest-885723365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-a1cf9098-6200-4bbe-8d86-97d5008960fa {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:19:48 devstack sudo[90794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-a1cf9098-6200-4bbe-8d86-97d5008960fa
Apr 10 13:19:48 devstack sudo[90794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:19:48 devstack sudo[90794]: pam_unix(sudo:session): session closed for user root
Apr 10 13:19:48 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ed610734-81f7-4fc6-83eb-62bd695e568d tempest-CreateVolumesFromImageTest-885723365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-a1cf9098-6200-4bbe-8d86-97d5008960fa" returned: 0 in 0.439s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:19:48 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-ed610734-81f7-4fc6-83eb-62bd695e568d tempest-CreateVolumesFromImageTest-885723365 None] <== create_volume: return (1007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'} {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 13:19:48 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-ed610734-81f7-4fc6-83eb-62bd695e568d tempest-CreateVolumesFromImageTest-885723365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.011s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:19:48 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-3da8d59d-d912-4705-b4dd-367d1dc7e000 tempest-CreateVolumesFromImageTest-885723365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.275s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:19:48 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-3da8d59d-d912-4705-b4dd-367d1dc7e000 tempest-CreateVolumesFromImageTest-885723365 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f252bf08b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:19:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1857274732',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac0224ab-26f8-47a8-ab27-eb486a615cc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89bf312972314f27977b368c37be4364',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:19:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:19:44Z,use_quota=True,user_id='d12bbf695b8442fba9e6a64813b7aabb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)}" {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 13:19:48 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-3da8d59d-d912-4705-b4dd-367d1dc7e000 tempest-CreateVolumesFromImageTest-885723365 None] Creating volume ac0224ab-26f8-47a8-ab27-eb486a615cc1 {{(pid=83345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 13:19:48 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-3da8d59d-d912-4705-b4dd-367d1dc7e000 tempest-CreateVolumesFromImageTest-885723365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:19:48 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-3da8d59d-d912-4705-b4dd-367d1dc7e000 tempest-CreateVolumesFromImageTest-885723365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:19:48 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-3da8d59d-d912-4705-b4dd-367d1dc7e000 tempest-CreateVolumesFromImageTest-885723365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:19:48 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-3da8d59d-d912-4705-b4dd-367d1dc7e000 tempest-CreateVolumesFromImageTest-885723365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:19:48 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-3da8d59d-d912-4705-b4dd-367d1dc7e000 tempest-CreateVolumesFromImageTest-885723365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:19:48 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-3da8d59d-d912-4705-b4dd-367d1dc7e000 tempest-CreateVolumesFromImageTest-885723365 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:19:48 devstack cinder-volume[83345]: INFO cinder.volume.drivers.remotefs [None req-3da8d59d-d912-4705-b4dd-367d1dc7e000 tempest-CreateVolumesFromImageTest-885723365 None] casted to osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331
Apr 10 13:19:48 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-3da8d59d-d912-4705-b4dd-367d1dc7e000 tempest-CreateVolumesFromImageTest-885723365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-ac0224ab-26f8-47a8-ab27-eb486a615cc1 1073741824 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:19:48 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ed610734-81f7-4fc6-83eb-62bd695e568d tempest-CreateVolumesFromImageTest-885723365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dbb0c35-d105-4385-ae96-f46de361fdaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1cf9098-6200-4bbe-8d86-97d5008960fa', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:19:48 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ed610734-81f7-4fc6-83eb-62bd695e568d tempest-CreateVolumesFromImageTest-885723365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8dd1dd5-ba82-427d-b2b1-76b20f39bb3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:19:48 devstack sudo[90797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-ac0224ab-26f8-47a8-ab27-eb486a615cc1 1073741824
Apr 10 13:19:48 devstack sudo[90797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:19:48 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-ed610734-81f7-4fc6-83eb-62bd695e568d tempest-CreateVolumesFromImageTest-885723365 None] Volume volume-a1cf9098-6200-4bbe-8d86-97d5008960fa (a1cf9098-6200-4bbe-8d86-97d5008960fa): created successfully
Apr 10 13:19:48 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ed610734-81f7-4fc6-83eb-62bd695e568d tempest-CreateVolumesFromImageTest-885723365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8dd1dd5-ba82-427d-b2b1-76b20f39bb3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:19:48 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-ed610734-81f7-4fc6-83eb-62bd695e568d tempest-CreateVolumesFromImageTest-885723365 None] Flow 'volume_create_manager' (3cdd84c3-4c81-4044-b766-e1d08f4bc923) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:19:48 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-ed610734-81f7-4fc6-83eb-62bd695e568d tempest-CreateVolumesFromImageTest-885723365 None] Created volume successfully.
Apr 10 13:19:49 devstack sudo[90797]: pam_unix(sudo:session): session closed for user root
Apr 10 13:19:49 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-3da8d59d-d912-4705-b4dd-367d1dc7e000 tempest-CreateVolumesFromImageTest-885723365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-ac0224ab-26f8-47a8-ab27-eb486a615cc1 1073741824" returned: 0 in 0.556s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:19:49 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-3da8d59d-d912-4705-b4dd-367d1dc7e000 tempest-CreateVolumesFromImageTest-885723365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-ac0224ab-26f8-47a8-ab27-eb486a615cc1 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:19:49 devstack sudo[90802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-ac0224ab-26f8-47a8-ab27-eb486a615cc1
Apr 10 13:19:49 devstack sudo[90802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:19:49 devstack sudo[90802]: pam_unix(sudo:session): session closed for user root
Apr 10 13:19:49 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-3da8d59d-d912-4705-b4dd-367d1dc7e000 tempest-CreateVolumesFromImageTest-885723365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-ac0224ab-26f8-47a8-ab27-eb486a615cc1" returned: 0 in 0.475s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:19:49 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-3da8d59d-d912-4705-b4dd-367d1dc7e000 tempest-CreateVolumesFromImageTest-885723365 None] <== create_volume: return (1059ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'} {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 13:19:49 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-3da8d59d-d912-4705-b4dd-367d1dc7e000 tempest-CreateVolumesFromImageTest-885723365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.062s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:19:49 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-e80ab30a-98bd-45e2-821e-79ac4455b1ce tempest-CreateVolumesFromImageTest-885723365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.086s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:19:49 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-e80ab30a-98bd-45e2-821e-79ac4455b1ce tempest-CreateVolumesFromImageTest-885723365 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f252bf08b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:19:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1140583188',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcd0dddb-67aa-4708-aa9b-954fb7263479,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89bf312972314f27977b368c37be4364',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:19:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:19:45Z,use_quota=True,user_id='d12bbf695b8442fba9e6a64813b7aabb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)}" {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 13:19:49 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-e80ab30a-98bd-45e2-821e-79ac4455b1ce tempest-CreateVolumesFromImageTest-885723365 None] Creating volume dcd0dddb-67aa-4708-aa9b-954fb7263479 {{(pid=83345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 13:19:49 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-e80ab30a-98bd-45e2-821e-79ac4455b1ce tempest-CreateVolumesFromImageTest-885723365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:19:49 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-e80ab30a-98bd-45e2-821e-79ac4455b1ce tempest-CreateVolumesFromImageTest-885723365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:19:49 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-e80ab30a-98bd-45e2-821e-79ac4455b1ce tempest-CreateVolumesFromImageTest-885723365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:19:49 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-e80ab30a-98bd-45e2-821e-79ac4455b1ce tempest-CreateVolumesFromImageTest-885723365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:19:49 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-e80ab30a-98bd-45e2-821e-79ac4455b1ce tempest-CreateVolumesFromImageTest-885723365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:19:49 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-e80ab30a-98bd-45e2-821e-79ac4455b1ce tempest-CreateVolumesFromImageTest-885723365 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:19:49 devstack cinder-volume[83345]: INFO cinder.volume.drivers.remotefs [None req-e80ab30a-98bd-45e2-821e-79ac4455b1ce tempest-CreateVolumesFromImageTest-885723365 None] casted to osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331
Apr 10 13:19:49 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-e80ab30a-98bd-45e2-821e-79ac4455b1ce tempest-CreateVolumesFromImageTest-885723365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-dcd0dddb-67aa-4708-aa9b-954fb7263479 1073741824 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:19:49 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-3da8d59d-d912-4705-b4dd-367d1dc7e000 tempest-CreateVolumesFromImageTest-885723365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f056be25-cb6d-4cbb-8c87-d80b057a29f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac0224ab-26f8-47a8-ab27-eb486a615cc1', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:19:49 devstack sudo[90805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-dcd0dddb-67aa-4708-aa9b-954fb7263479 1073741824
Apr 10 13:19:49 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-3da8d59d-d912-4705-b4dd-367d1dc7e000 tempest-CreateVolumesFromImageTest-885723365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4eee4ca-4ba5-427f-829c-a9697a1006a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:19:49 devstack sudo[90805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:19:49 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-3da8d59d-d912-4705-b4dd-367d1dc7e000 tempest-CreateVolumesFromImageTest-885723365 None] Volume volume-ac0224ab-26f8-47a8-ab27-eb486a615cc1 (ac0224ab-26f8-47a8-ab27-eb486a615cc1): created successfully
Apr 10 13:19:49 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-3da8d59d-d912-4705-b4dd-367d1dc7e000 tempest-CreateVolumesFromImageTest-885723365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4eee4ca-4ba5-427f-829c-a9697a1006a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:19:49 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-3da8d59d-d912-4705-b4dd-367d1dc7e000 tempest-CreateVolumesFromImageTest-885723365 None] Flow 'volume_create_manager' (2856ae41-3eeb-4843-a00a-2eba17fd9530) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:19:49 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-3da8d59d-d912-4705-b4dd-367d1dc7e000 tempest-CreateVolumesFromImageTest-885723365 None] Created volume successfully.
Apr 10 13:19:50 devstack sudo[90805]: pam_unix(sudo:session): session closed for user root
Apr 10 13:19:50 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-e80ab30a-98bd-45e2-821e-79ac4455b1ce tempest-CreateVolumesFromImageTest-885723365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-dcd0dddb-67aa-4708-aa9b-954fb7263479 1073741824" returned: 0 in 0.566s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:19:50 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-e80ab30a-98bd-45e2-821e-79ac4455b1ce tempest-CreateVolumesFromImageTest-885723365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-dcd0dddb-67aa-4708-aa9b-954fb7263479 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:19:50 devstack sudo[90810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-dcd0dddb-67aa-4708-aa9b-954fb7263479
Apr 10 13:19:50 devstack sudo[90810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:19:50 devstack sudo[90810]: pam_unix(sudo:session): session closed for user root
Apr 10 13:19:50 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-e80ab30a-98bd-45e2-821e-79ac4455b1ce tempest-CreateVolumesFromImageTest-885723365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-dcd0dddb-67aa-4708-aa9b-954fb7263479" returned: 0 in 0.463s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:19:50 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-e80ab30a-98bd-45e2-821e-79ac4455b1ce tempest-CreateVolumesFromImageTest-885723365 None] <== create_volume: return (1056ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'} {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 13:19:50 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-e80ab30a-98bd-45e2-821e-79ac4455b1ce tempest-CreateVolumesFromImageTest-885723365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.058s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:19:50 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-04f62c94-b1da-4591-8308-3244894a6e4c tempest-CreateVolumesFromSnapshotTest-1784307287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.104s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:19:50 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-04f62c94-b1da-4591-8308-3244894a6e4c tempest-CreateVolumesFromSnapshotTest-1784307287 None] Creating offline snapshot 407c027b-0bad-4410-9258-7f7b4f74bcd3 of volume 2529db32-32c8-4010-a67c-17c41254c290 {{(pid=83345) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 10 13:19:50 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-e80ab30a-98bd-45e2-821e-79ac4455b1ce tempest-CreateVolumesFromImageTest-885723365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (027647cf-a759-44e0-8e7b-2bf9a8109b8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dcd0dddb-67aa-4708-aa9b-954fb7263479', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:19:50 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-e80ab30a-98bd-45e2-821e-79ac4455b1ce tempest-CreateVolumesFromImageTest-885723365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f12a461-b3eb-4666-b6ac-d64c1c33828c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:19:50 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b09482b-cbb2-4908-b9eb-4b5dd7c0d892]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:19:50 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-04f62c94-b1da-4591-8308-3244894a6e4c tempest-CreateVolumesFromSnapshotTest-1784307287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-2529db32-32c8-4010-a67c-17c41254c290 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:19:50 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-e80ab30a-98bd-45e2-821e-79ac4455b1ce tempest-CreateVolumesFromImageTest-885723365 None] Volume volume-dcd0dddb-67aa-4708-aa9b-954fb7263479 (dcd0dddb-67aa-4708-aa9b-954fb7263479): created successfully
Apr 10 13:19:50 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-e80ab30a-98bd-45e2-821e-79ac4455b1ce tempest-CreateVolumesFromImageTest-885723365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f12a461-b3eb-4666-b6ac-d64c1c33828c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:19:50 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-e80ab30a-98bd-45e2-821e-79ac4455b1ce tempest-CreateVolumesFromImageTest-885723365 None] Flow 'volume_create_manager' (5f34247c-3eeb-489b-b957-b3f21ab852a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:19:50 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-e80ab30a-98bd-45e2-821e-79ac4455b1ce tempest-CreateVolumesFromImageTest-885723365 None] Created volume successfully.
Apr 10 13:19:50 devstack sudo[90813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-2529db32-32c8-4010-a67c-17c41254c290
Apr 10 13:19:50 devstack sudo[90813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:19:51 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-397969c4-8a13-408b-95c1-9637eb350cf5 tempest-CreateVolumesFromImageTest-885723365 None] Acquiring lock "cinder-dcd0dddb-67aa-4708-aa9b-954fb7263479-delete_volume" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:19:51 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-397969c4-8a13-408b-95c1-9637eb350cf5 tempest-CreateVolumesFromImageTest-885723365 None] Lock "cinder-dcd0dddb-67aa-4708-aa9b-954fb7263479-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:19:51 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-397969c4-8a13-408b-95c1-9637eb350cf5 tempest-CreateVolumesFromImageTest-885723365 None] Acquiring lock "cinder-quobyte-dcd0dddb-67aa-4708-aa9b-954fb7263479" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:19:51 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-397969c4-8a13-408b-95c1-9637eb350cf5 tempest-CreateVolumesFromImageTest-885723365 None] Lock "cinder-quobyte-dcd0dddb-67aa-4708-aa9b-954fb7263479" acquired by "delete_volume" :: waited 0.011s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:19:51 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[63c79716-2580-4577-a324-c45882bd4d8f]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:19:51 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-397969c4-8a13-408b-95c1-9637eb350cf5 tempest-CreateVolumesFromImageTest-885723365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-dcd0dddb-67aa-4708-aa9b-954fb7263479 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:19:51 devstack sudo[90813]: pam_unix(sudo:session): session closed for user root
Apr 10 13:19:51 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-04f62c94-b1da-4591-8308-3244894a6e4c tempest-CreateVolumesFromSnapshotTest-1784307287 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-2529db32-32c8-4010-a67c-17c41254c290" returned: 0 in 0.574s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:19:51 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-04f62c94-b1da-4591-8308-3244894a6e4c tempest-CreateVolumesFromSnapshotTest-1784307287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-2529db32-32c8-4010-a67c-17c41254c290,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-2529db32-32c8-4010-a67c-17c41254c290.407c027b-0bad-4410-9258-7f7b4f74bcd3 1G {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:19:51 devstack sudo[90818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-dcd0dddb-67aa-4708-aa9b-954fb7263479
Apr 10 13:19:51 devstack sudo[90818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:19:51 devstack sudo[90820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-2529db32-32c8-4010-a67c-17c41254c290,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-2529db32-32c8-4010-a67c-17c41254c290.407c027b-0bad-4410-9258-7f7b4f74bcd3 1G
Apr 10 13:19:51 devstack sudo[90820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:19:51 devstack sudo[90818]: pam_unix(sudo:session): session closed for user root
Apr 10 13:19:51 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-397969c4-8a13-408b-95c1-9637eb350cf5 tempest-CreateVolumesFromImageTest-885723365 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-dcd0dddb-67aa-4708-aa9b-954fb7263479" returned: 0 in 0.477s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:19:51 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-397969c4-8a13-408b-95c1-9637eb350cf5 tempest-CreateVolumesFromImageTest-885723365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-dcd0dddb-67aa-4708-aa9b-954fb7263479 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:19:51 devstack sudo[90829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-dcd0dddb-67aa-4708-aa9b-954fb7263479
Apr 10 13:19:51 devstack sudo[90829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:19:52 devstack sudo[90820]: pam_unix(sudo:session): session closed for user root
Apr 10 13:19:52 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-04f62c94-b1da-4591-8308-3244894a6e4c tempest-CreateVolumesFromSnapshotTest-1784307287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-2529db32-32c8-4010-a67c-17c41254c290,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-2529db32-32c8-4010-a67c-17c41254c290.407c027b-0bad-4410-9258-7f7b4f74bcd3 1G" returned: 0 in 0.572s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:19:52 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-04f62c94-b1da-4591-8308-3244894a6e4c tempest-CreateVolumesFromSnapshotTest-1784307287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2529db32-32c8-4010-a67c-17c41254c290 -F qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-2529db32-32c8-4010-a67c-17c41254c290.407c027b-0bad-4410-9258-7f7b4f74bcd3 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:19:52 devstack sudo[90831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2529db32-32c8-4010-a67c-17c41254c290 -F qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-2529db32-32c8-4010-a67c-17c41254c290.407c027b-0bad-4410-9258-7f7b4f74bcd3
Apr 10 13:19:52 devstack sudo[90831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:19:52 devstack sudo[90829]: pam_unix(sudo:session): session closed for user root
Apr 10 13:19:52 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-397969c4-8a13-408b-95c1-9637eb350cf5 tempest-CreateVolumesFromImageTest-885723365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-dcd0dddb-67aa-4708-aa9b-954fb7263479" returned: 0 in 0.491s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:19:52 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-397969c4-8a13-408b-95c1-9637eb350cf5 tempest-CreateVolumesFromImageTest-885723365 None] Lock "cinder-quobyte-dcd0dddb-67aa-4708-aa9b-954fb7263479" released by "delete_volume" :: held 0.997s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:19:52 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-397969c4-8a13-408b-95c1-9637eb350cf5 tempest-CreateVolumesFromImageTest-885723365 None] Created reservations ['859cf83c-7a45-4ec5-9b4a-f2144793b275', '9d2eae21-6abe-4c56-b4ee-e7e6436ef4e7', '7ff35855-ae8f-4cfe-b75f-d82dcb3c7d02', 'c7a7521c-5098-4b4c-a938-531e1b14bd3f'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:19:52 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-397969c4-8a13-408b-95c1-9637eb350cf5 tempest-CreateVolumesFromImageTest-885723365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:19:52 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-397969c4-8a13-408b-95c1-9637eb350cf5 tempest-CreateVolumesFromImageTest-885723365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:19:52 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-397969c4-8a13-408b-95c1-9637eb350cf5 tempest-CreateVolumesFromImageTest-885723365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:19:52 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-397969c4-8a13-408b-95c1-9637eb350cf5 tempest-CreateVolumesFromImageTest-885723365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:19:52 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-397969c4-8a13-408b-95c1-9637eb350cf5 tempest-CreateVolumesFromImageTest-885723365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:19:52 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-397969c4-8a13-408b-95c1-9637eb350cf5 tempest-CreateVolumesFromImageTest-885723365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:19:52 devstack sudo[90837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:19:52 devstack sudo[90837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:19:52 devstack sudo[90831]: pam_unix(sudo:session): session closed for user root
Apr 10 13:19:52 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-04f62c94-b1da-4591-8308-3244894a6e4c tempest-CreateVolumesFromSnapshotTest-1784307287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2529db32-32c8-4010-a67c-17c41254c290 -F qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-2529db32-32c8-4010-a67c-17c41254c290.407c027b-0bad-4410-9258-7f7b4f74bcd3" returned: 0 in 0.489s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:19:52 devstack cinder-volume[83345]: WARNING cinder.volume.drivers.remotefs [None req-04f62c94-b1da-4591-8308-3244894a6e4c tempest-CreateVolumesFromSnapshotTest-1784307287 None] /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-2529db32-32c8-4010-a67c-17c41254c290.407c027b-0bad-4410-9258-7f7b4f74bcd3 is being set with open permissions: ugo+rw
Apr 10 13:19:52 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-04f62c94-b1da-4591-8308-3244894a6e4c tempest-CreateVolumesFromSnapshotTest-1784307287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-2529db32-32c8-4010-a67c-17c41254c290.407c027b-0bad-4410-9258-7f7b4f74bcd3 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:19:52 devstack sudo[90839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-2529db32-32c8-4010-a67c-17c41254c290.407c027b-0bad-4410-9258-7f7b4f74bcd3
Apr 10 13:19:52 devstack sudo[90839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:19:52 devstack sudo[90839]: pam_unix(sudo:session): session closed for user root
Apr 10 13:19:52 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-04f62c94-b1da-4591-8308-3244894a6e4c tempest-CreateVolumesFromSnapshotTest-1784307287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-2529db32-32c8-4010-a67c-17c41254c290.407c027b-0bad-4410-9258-7f7b4f74bcd3" returned: 0 in 0.437s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:19:52 devstack sudo[90837]: pam_unix(sudo:session): session closed for user root
Apr 10 13:19:52 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-397969c4-8a13-408b-95c1-9637eb350cf5 tempest-CreateVolumesFromImageTest-885723365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.515s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:19:53 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-397969c4-8a13-408b-95c1-9637eb350cf5 tempest-CreateVolumesFromImageTest-885723365 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:19:53 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-397969c4-8a13-408b-95c1-9637eb350cf5 tempest-CreateVolumesFromImageTest-885723365 None] Deleted volume successfully.
Apr 10 13:19:53 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-04f62c94-b1da-4591-8308-3244894a6e4c tempest-CreateVolumesFromSnapshotTest-1784307287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-2529db32-32c8-4010-a67c-17c41254c290.info {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:19:53 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-397969c4-8a13-408b-95c1-9637eb350cf5 tempest-CreateVolumesFromImageTest-885723365 None] Lock "cinder-dcd0dddb-67aa-4708-aa9b-954fb7263479-delete_volume" released by "delete_volume" :: held 1.690s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:19:53 devstack sudo[90843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-2529db32-32c8-4010-a67c-17c41254c290.info
Apr 10 13:19:53 devstack sudo[90843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:19:53 devstack sudo[90843]: pam_unix(sudo:session): session closed for user root
Apr 10 13:19:53 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-04f62c94-b1da-4591-8308-3244894a6e4c tempest-CreateVolumesFromSnapshotTest-1784307287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-2529db32-32c8-4010-a67c-17c41254c290.info" returned: 0 in 0.421s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:19:53 devstack cinder-volume[83345]: WARNING cinder.volume.drivers.remotefs [None req-04f62c94-b1da-4591-8308-3244894a6e4c tempest-CreateVolumesFromSnapshotTest-1784307287 None] /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-2529db32-32c8-4010-a67c-17c41254c290.info is being set with open permissions: ugo+rw
Apr 10 13:19:53 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-04f62c94-b1da-4591-8308-3244894a6e4c tempest-CreateVolumesFromSnapshotTest-1784307287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-2529db32-32c8-4010-a67c-17c41254c290.info {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:19:53 devstack sudo[90846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-2529db32-32c8-4010-a67c-17c41254c290.info
Apr 10 13:19:53 devstack sudo[90846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:19:53 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-c3922956-dc5c-43f2-add7-bc53648086d4 tempest-CreateVolumesFromImageTest-885723365 None] Acquiring lock "cinder-ac0224ab-26f8-47a8-ab27-eb486a615cc1-delete_volume" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:19:53 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-c3922956-dc5c-43f2-add7-bc53648086d4 tempest-CreateVolumesFromImageTest-885723365 None] Lock "cinder-ac0224ab-26f8-47a8-ab27-eb486a615cc1-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:19:53 devstack cinder-volume[83345]: DEBUG oslo_service.periodic_task [None req-c3f44832-ad7f-424b-a850-32c7352a19c5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83345) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 10 13:19:53 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-c3f44832-ad7f-424b-a850-32c7352a19c5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:19:53 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-c3f44832-ad7f-424b-a850-32c7352a19c5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:19:53 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-c3f44832-ad7f-424b-a850-32c7352a19c5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:19:53 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-c3f44832-ad7f-424b-a850-32c7352a19c5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:19:53 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-c3f44832-ad7f-424b-a850-32c7352a19c5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:19:53 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-c3f44832-ad7f-424b-a850-32c7352a19c5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:19:53 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-c3922956-dc5c-43f2-add7-bc53648086d4 tempest-CreateVolumesFromImageTest-885723365 None] Acquiring lock "cinder-quobyte-ac0224ab-26f8-47a8-ab27-eb486a615cc1" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:19:53 devstack sudo[90848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:19:53 devstack sudo[90848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:19:53 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-c3922956-dc5c-43f2-add7-bc53648086d4 tempest-CreateVolumesFromImageTest-885723365 None] Lock "cinder-quobyte-ac0224ab-26f8-47a8-ab27-eb486a615cc1" acquired by "delete_volume" :: waited 0.012s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:19:53 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[be0605ff-e81c-4d7f-acc1-5ce804fcb807]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:19:53 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-c3922956-dc5c-43f2-add7-bc53648086d4 tempest-CreateVolumesFromImageTest-885723365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-ac0224ab-26f8-47a8-ab27-eb486a615cc1 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:19:53 devstack sudo[90850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-ac0224ab-26f8-47a8-ab27-eb486a615cc1
Apr 10 13:19:53 devstack sudo[90850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:19:53 devstack sudo[90846]: pam_unix(sudo:session): session closed for user root
Apr 10 13:19:53 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-04f62c94-b1da-4591-8308-3244894a6e4c tempest-CreateVolumesFromSnapshotTest-1784307287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-2529db32-32c8-4010-a67c-17c41254c290.info" returned: 0 in 0.511s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:19:53 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-04f62c94-b1da-4591-8308-3244894a6e4c tempest-CreateVolumesFromSnapshotTest-1784307287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.100s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:19:53 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-5827edb6-3885-46fa-bd41-01a743369106 tempest-VolumeDependencyTests-1052055728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.010s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:19:53 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-5827edb6-3885-46fa-bd41-01a743369106 tempest-VolumeDependencyTests-1052055728 None] Creating offline snapshot bc0ca10d-6198-4514-86c2-f56b6ab7dcf1 of volume 51731cea-d883-4a30-a10a-53c990e379c4 {{(pid=83345) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 10 13:19:54 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-04f62c94-b1da-4591-8308-3244894a6e4c tempest-CreateVolumesFromSnapshotTest-1784307287 None] Create snapshot completed successfully
Apr 10 13:19:54 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[44d888a8-2fa8-49a3-a7e1-90d9f00311a5]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:19:54 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-5827edb6-3885-46fa-bd41-01a743369106 tempest-VolumeDependencyTests-1052055728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-51731cea-d883-4a30-a10a-53c990e379c4 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:19:54 devstack sudo[90854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-51731cea-d883-4a30-a10a-53c990e379c4
Apr 10 13:19:54 devstack sudo[90854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:19:54 devstack sudo[90848]: pam_unix(sudo:session): session closed for user root
Apr 10 13:19:54 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-c3f44832-ad7f-424b-a850-32c7352a19c5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.548s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:19:54 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-c3f44832-ad7f-424b-a850-32c7352a19c5 None None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:19:54 devstack sudo[90850]: pam_unix(sudo:session): session closed for user root
Apr 10 13:19:54 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-c3922956-dc5c-43f2-add7-bc53648086d4 tempest-CreateVolumesFromImageTest-885723365 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-ac0224ab-26f8-47a8-ab27-eb486a615cc1" returned: 0 in 0.548s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:19:54 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-c3922956-dc5c-43f2-add7-bc53648086d4 tempest-CreateVolumesFromImageTest-885723365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-ac0224ab-26f8-47a8-ab27-eb486a615cc1 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:19:54 devstack sudo[90859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-ac0224ab-26f8-47a8-ab27-eb486a615cc1
Apr 10 13:19:54 devstack sudo[90859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:19:54 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbc323d0-828d-4530-bb72-405140bc6af0 tempest-CreateVolumesFromSnapshotTest-1784307287 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:19:54 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-bbc323d0-828d-4530-bb72-405140bc6af0 tempest-CreateVolumesFromSnapshotTest-1784307287 None] Flow 'volume_create_manager' (8127be80-1a2a-4027-bea4-93bce8e10b2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:19:54 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-bbc323d0-828d-4530-bb72-405140bc6af0 tempest-CreateVolumesFromSnapshotTest-1784307287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17259deb-6c73-49b5-a5f0-bb384d569379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:19:54 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-bbc323d0-828d-4530-bb72-405140bc6af0 tempest-CreateVolumesFromSnapshotTest-1784307287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17259deb-6c73-49b5-a5f0-bb384d569379) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:19:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-230440589',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e956d633-adf1-42b7-a96e-d913763867ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a18e4377f1c74528bb941686c897075f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:19:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:19:54Z,use_quota=True,user_id='7b4ce4eac6304d9684ac825aeb5fb7a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:19:54 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-bbc323d0-828d-4530-bb72-405140bc6af0 tempest-CreateVolumesFromSnapshotTest-1784307287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (788f9879-54c1-46a5-9a0f-8984d7d422a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:19:54 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-bbc323d0-828d-4530-bb72-405140bc6af0 tempest-CreateVolumesFromSnapshotTest-1784307287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (788f9879-54c1-46a5-9a0f-8984d7d422a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:19:54 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-bbc323d0-828d-4530-bb72-405140bc6af0 tempest-CreateVolumesFromSnapshotTest-1784307287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec0d6a59-fe57-4919-a90a-cdeebfa76047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:19:54 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-bbc323d0-828d-4530-bb72-405140bc6af0 tempest-CreateVolumesFromSnapshotTest-1784307287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec0d6a59-fe57-4919-a90a-cdeebfa76047) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e956d633-adf1-42b7-a96e-d913763867ce', 'volume_name': 'volume-e956d633-adf1-42b7-a96e-d913763867ce', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:19:54 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-bbc323d0-828d-4530-bb72-405140bc6af0 tempest-CreateVolumesFromSnapshotTest-1784307287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec4c301f-3dd1-40c0-8b44-72384ddf810b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:19:54 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-bbc323d0-828d-4530-bb72-405140bc6af0 tempest-CreateVolumesFromSnapshotTest-1784307287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec4c301f-3dd1-40c0-8b44-72384ddf810b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:19:54 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-bbc323d0-828d-4530-bb72-405140bc6af0 tempest-CreateVolumesFromSnapshotTest-1784307287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ba68ba1-6d41-4f85-9e46-3eee6c3903ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:19:54 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-bbc323d0-828d-4530-bb72-405140bc6af0 tempest-CreateVolumesFromSnapshotTest-1784307287 None] Volume e956d633-adf1-42b7-a96e-d913763867ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e956d633-adf1-42b7-a96e-d913763867ce', 'volume_size': 1}
Apr 10 13:19:54 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-bbc323d0-828d-4530-bb72-405140bc6af0 tempest-CreateVolumesFromSnapshotTest-1784307287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:19:54 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c973681-826f-4770-9238-b3780c62dedb tempest-CreateVolumesFromSnapshotTest-1784307287 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:19:54 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-5c973681-826f-4770-9238-b3780c62dedb tempest-CreateVolumesFromSnapshotTest-1784307287 None] Flow 'volume_create_manager' (f9adf894-3596-47dc-ac50-56deee7d3fa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:19:54 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-5c973681-826f-4770-9238-b3780c62dedb tempest-CreateVolumesFromSnapshotTest-1784307287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f2b394a-08be-4cf0-a4f2-ae2d75ae9f54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:19:54 devstack sudo[90854]: pam_unix(sudo:session): session closed for user root
Apr 10 13:19:54 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-5c973681-826f-4770-9238-b3780c62dedb tempest-CreateVolumesFromSnapshotTest-1784307287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f2b394a-08be-4cf0-a4f2-ae2d75ae9f54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:19:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-786332143',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f2f63fa-9bbd-4196-bdbe-aac49a2382b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a18e4377f1c74528bb941686c897075f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:19:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:19:55Z,use_quota=True,user_id='7b4ce4eac6304d9684ac825aeb5fb7a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:19:54 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-5c973681-826f-4770-9238-b3780c62dedb tempest-CreateVolumesFromSnapshotTest-1784307287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc7f5a1d-cde3-42f6-8c50-350d5368136b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:19:54 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-5c973681-826f-4770-9238-b3780c62dedb tempest-CreateVolumesFromSnapshotTest-1784307287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc7f5a1d-cde3-42f6-8c50-350d5368136b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:19:54 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-5c973681-826f-4770-9238-b3780c62dedb tempest-CreateVolumesFromSnapshotTest-1784307287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08797493-98f5-4957-998c-69ffa944c27d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:19:54 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-5c973681-826f-4770-9238-b3780c62dedb tempest-CreateVolumesFromSnapshotTest-1784307287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08797493-98f5-4957-998c-69ffa944c27d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f2f63fa-9bbd-4196-bdbe-aac49a2382b6', 'volume_name': 'volume-4f2f63fa-9bbd-4196-bdbe-aac49a2382b6', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:19:54 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-5c973681-826f-4770-9238-b3780c62dedb tempest-CreateVolumesFromSnapshotTest-1784307287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f2cb82a-2658-4182-9dea-5f695825dd92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:19:54 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-5c973681-826f-4770-9238-b3780c62dedb tempest-CreateVolumesFromSnapshotTest-1784307287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f2cb82a-2658-4182-9dea-5f695825dd92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:19:54 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-5c973681-826f-4770-9238-b3780c62dedb tempest-CreateVolumesFromSnapshotTest-1784307287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5727be05-c589-46ed-ab1b-2cc184edb601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:19:54 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-5c973681-826f-4770-9238-b3780c62dedb tempest-CreateVolumesFromSnapshotTest-1784307287 None] Volume 4f2f63fa-9bbd-4196-bdbe-aac49a2382b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f2f63fa-9bbd-4196-bdbe-aac49a2382b6', 'volume_size': 1}
Apr 10 13:19:54 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-5c973681-826f-4770-9238-b3780c62dedb tempest-CreateVolumesFromSnapshotTest-1784307287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:19:54 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-5827edb6-3885-46fa-bd41-01a743369106 tempest-VolumeDependencyTests-1052055728 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-51731cea-d883-4a30-a10a-53c990e379c4" returned: 0 in 0.817s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:19:54 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-5827edb6-3885-46fa-bd41-01a743369106 tempest-VolumeDependencyTests-1052055728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-51731cea-d883-4a30-a10a-53c990e379c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-51731cea-d883-4a30-a10a-53c990e379c4.bc0ca10d-6198-4514-86c2-f56b6ab7dcf1 1G {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:19:54 devstack sudo[90865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-51731cea-d883-4a30-a10a-53c990e379c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-51731cea-d883-4a30-a10a-53c990e379c4.bc0ca10d-6198-4514-86c2-f56b6ab7dcf1 1G
Apr 10 13:19:54 devstack sudo[90865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:19:54 devstack sudo[90859]: pam_unix(sudo:session): session closed for user root
Apr 10 13:19:54 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-c3922956-dc5c-43f2-add7-bc53648086d4 tempest-CreateVolumesFromImageTest-885723365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-ac0224ab-26f8-47a8-ab27-eb486a615cc1" returned: 0 in 0.697s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:19:54 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-c3922956-dc5c-43f2-add7-bc53648086d4 tempest-CreateVolumesFromImageTest-885723365 None] Lock "cinder-quobyte-ac0224ab-26f8-47a8-ab27-eb486a615cc1" released by "delete_volume" :: held 1.293s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:19:54 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6e91123-046d-4503-9ab5-f3300aad6fcc tempest-CreateVolumesFromSnapshotTest-1784307287 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:19:55 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-c6e91123-046d-4503-9ab5-f3300aad6fcc tempest-CreateVolumesFromSnapshotTest-1784307287 None] Flow 'volume_create_manager' (0323045a-2205-4f68-9735-30f05d27c066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:19:55 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-c6e91123-046d-4503-9ab5-f3300aad6fcc tempest-CreateVolumesFromSnapshotTest-1784307287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7a030f2-b4fd-4e30-84e0-5c49eac2d2d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:19:55 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-c6e91123-046d-4503-9ab5-f3300aad6fcc tempest-CreateVolumesFromSnapshotTest-1784307287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7a030f2-b4fd-4e30-84e0-5c49eac2d2d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:19:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1101286447',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=384950bf-fdaa-4b43-8bbf-231096f646f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a18e4377f1c74528bb941686c897075f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:19:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:19:55Z,use_quota=True,user_id='7b4ce4eac6304d9684ac825aeb5fb7a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:19:55 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-c6e91123-046d-4503-9ab5-f3300aad6fcc tempest-CreateVolumesFromSnapshotTest-1784307287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (933f1d79-5ccb-418e-8a4f-1338db65d527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:19:55 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-c6e91123-046d-4503-9ab5-f3300aad6fcc tempest-CreateVolumesFromSnapshotTest-1784307287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (933f1d79-5ccb-418e-8a4f-1338db65d527) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:19:55 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-c6e91123-046d-4503-9ab5-f3300aad6fcc tempest-CreateVolumesFromSnapshotTest-1784307287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46abab86-c1d4-4624-8d3f-d4a970202cc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:19:55 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-c6e91123-046d-4503-9ab5-f3300aad6fcc tempest-CreateVolumesFromSnapshotTest-1784307287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46abab86-c1d4-4624-8d3f-d4a970202cc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '384950bf-fdaa-4b43-8bbf-231096f646f7', 'volume_name': 'volume-384950bf-fdaa-4b43-8bbf-231096f646f7', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:19:55 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-c6e91123-046d-4503-9ab5-f3300aad6fcc tempest-CreateVolumesFromSnapshotTest-1784307287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a0f93fd-cd41-4ed4-b2aa-dbb099c2551e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:19:55 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-c6e91123-046d-4503-9ab5-f3300aad6fcc tempest-CreateVolumesFromSnapshotTest-1784307287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a0f93fd-cd41-4ed4-b2aa-dbb099c2551e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:19:55 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-c6e91123-046d-4503-9ab5-f3300aad6fcc tempest-CreateVolumesFromSnapshotTest-1784307287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b716d8d5-ed17-47b0-831b-520d3a774fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:19:55 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-c6e91123-046d-4503-9ab5-f3300aad6fcc tempest-CreateVolumesFromSnapshotTest-1784307287 None] Volume 384950bf-fdaa-4b43-8bbf-231096f646f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-384950bf-fdaa-4b43-8bbf-231096f646f7', 'volume_size': 1}
Apr 10 13:19:55 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-c6e91123-046d-4503-9ab5-f3300aad6fcc tempest-CreateVolumesFromSnapshotTest-1784307287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:19:55 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-c3922956-dc5c-43f2-add7-bc53648086d4 tempest-CreateVolumesFromImageTest-885723365 None] Created reservations ['06386a36-10e1-4e2a-bb61-666393349813', 'b2f0649c-6830-41d6-af35-808e4463dd17', 'a0827869-ca99-4683-8729-b48433585bba', '37da2675-1162-4aeb-80d4-bcfa88ba645e'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:19:55 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-c3922956-dc5c-43f2-add7-bc53648086d4 tempest-CreateVolumesFromImageTest-885723365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:19:55 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-c3922956-dc5c-43f2-add7-bc53648086d4 tempest-CreateVolumesFromImageTest-885723365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:19:55 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-c3922956-dc5c-43f2-add7-bc53648086d4 tempest-CreateVolumesFromImageTest-885723365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:19:55 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-c3922956-dc5c-43f2-add7-bc53648086d4 tempest-CreateVolumesFromImageTest-885723365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:19:55 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-c3922956-dc5c-43f2-add7-bc53648086d4 tempest-CreateVolumesFromImageTest-885723365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:19:55 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-c3922956-dc5c-43f2-add7-bc53648086d4 tempest-CreateVolumesFromImageTest-885723365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:19:55 devstack sudo[90867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:19:55 devstack sudo[90867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:19:55 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d54c8c8-ebd5-4bc9-911d-eeccb7ec1b6c tempest-CreateVolumesFromSnapshotTest-1784307287 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:19:55 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-9d54c8c8-ebd5-4bc9-911d-eeccb7ec1b6c tempest-CreateVolumesFromSnapshotTest-1784307287 None] Flow 'volume_create_manager' (5dd97dab-9fca-4683-b253-97d0f66a03a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:19:55 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-9d54c8c8-ebd5-4bc9-911d-eeccb7ec1b6c tempest-CreateVolumesFromSnapshotTest-1784307287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24730c7d-0c2d-4a96-aad5-4660b50dfa2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:19:55 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-9d54c8c8-ebd5-4bc9-911d-eeccb7ec1b6c tempest-CreateVolumesFromSnapshotTest-1784307287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24730c7d-0c2d-4a96-aad5-4660b50dfa2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:19:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2087359845',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b9cbc12-e90f-4320-b23e-cc5516c1a2b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a18e4377f1c74528bb941686c897075f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:19:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:19:55Z,use_quota=True,user_id='7b4ce4eac6304d9684ac825aeb5fb7a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:19:55 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-9d54c8c8-ebd5-4bc9-911d-eeccb7ec1b6c tempest-CreateVolumesFromSnapshotTest-1784307287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c52b7b8b-f64d-41af-858f-21ec4f861793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:19:55 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-9d54c8c8-ebd5-4bc9-911d-eeccb7ec1b6c tempest-CreateVolumesFromSnapshotTest-1784307287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c52b7b8b-f64d-41af-858f-21ec4f861793) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:19:55 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-9d54c8c8-ebd5-4bc9-911d-eeccb7ec1b6c tempest-CreateVolumesFromSnapshotTest-1784307287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9319f500-67ed-47a8-8f1a-f8fe768b457b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:19:55 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-9d54c8c8-ebd5-4bc9-911d-eeccb7ec1b6c tempest-CreateVolumesFromSnapshotTest-1784307287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9319f500-67ed-47a8-8f1a-f8fe768b457b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b9cbc12-e90f-4320-b23e-cc5516c1a2b2', 'volume_name': 'volume-2b9cbc12-e90f-4320-b23e-cc5516c1a2b2', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:19:55 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-9d54c8c8-ebd5-4bc9-911d-eeccb7ec1b6c tempest-CreateVolumesFromSnapshotTest-1784307287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5b74f5c-4072-4a34-b873-c8532f5a6489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:19:55 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-9d54c8c8-ebd5-4bc9-911d-eeccb7ec1b6c tempest-CreateVolumesFromSnapshotTest-1784307287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5b74f5c-4072-4a34-b873-c8532f5a6489) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:19:55 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-9d54c8c8-ebd5-4bc9-911d-eeccb7ec1b6c tempest-CreateVolumesFromSnapshotTest-1784307287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (345c06ff-acaf-4cfb-8b3b-f95c2c668e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:19:55 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-9d54c8c8-ebd5-4bc9-911d-eeccb7ec1b6c tempest-CreateVolumesFromSnapshotTest-1784307287 None] Volume 2b9cbc12-e90f-4320-b23e-cc5516c1a2b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b9cbc12-e90f-4320-b23e-cc5516c1a2b2', 'volume_size': 1}
Apr 10 13:19:55 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-9d54c8c8-ebd5-4bc9-911d-eeccb7ec1b6c tempest-CreateVolumesFromSnapshotTest-1784307287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:19:55 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-2be49fa8-8b2e-4ff6-8e3b-f74fe28684c4 tempest-CreateVolumesFromSnapshotTest-1784307287 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:19:55 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-2be49fa8-8b2e-4ff6-8e3b-f74fe28684c4 tempest-CreateVolumesFromSnapshotTest-1784307287 None] Flow 'volume_create_manager' (57684e45-0cbe-440d-ab8b-2ab7dee52687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:19:55 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-2be49fa8-8b2e-4ff6-8e3b-f74fe28684c4 tempest-CreateVolumesFromSnapshotTest-1784307287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7be3c487-aba9-4654-ab37-536ef6eae049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:19:55 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-2be49fa8-8b2e-4ff6-8e3b-f74fe28684c4 tempest-CreateVolumesFromSnapshotTest-1784307287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7be3c487-aba9-4654-ab37-536ef6eae049) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:19:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-155597474',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d51372a-ead7-45c9-8ee1-7a28ab8d1e9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a18e4377f1c74528bb941686c897075f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:19:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:19:56Z,use_quota=True,user_id='7b4ce4eac6304d9684ac825aeb5fb7a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:19:55 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-2be49fa8-8b2e-4ff6-8e3b-f74fe28684c4 tempest-CreateVolumesFromSnapshotTest-1784307287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (252900b3-73fb-4267-932b-5c820d53f52c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:19:55 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-2be49fa8-8b2e-4ff6-8e3b-f74fe28684c4 tempest-CreateVolumesFromSnapshotTest-1784307287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (252900b3-73fb-4267-932b-5c820d53f52c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:19:55 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-2be49fa8-8b2e-4ff6-8e3b-f74fe28684c4 tempest-CreateVolumesFromSnapshotTest-1784307287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed228271-58e2-4f56-88ea-00d55f3afb05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:19:55 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-2be49fa8-8b2e-4ff6-8e3b-f74fe28684c4 tempest-CreateVolumesFromSnapshotTest-1784307287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed228271-58e2-4f56-88ea-00d55f3afb05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d51372a-ead7-45c9-8ee1-7a28ab8d1e9d', 'volume_name': 'volume-1d51372a-ead7-45c9-8ee1-7a28ab8d1e9d', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:19:55 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-2be49fa8-8b2e-4ff6-8e3b-f74fe28684c4 tempest-CreateVolumesFromSnapshotTest-1784307287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94e5d7a3-bd5d-4420-8bfc-86393f2acbea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:19:55 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-2be49fa8-8b2e-4ff6-8e3b-f74fe28684c4 tempest-CreateVolumesFromSnapshotTest-1784307287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94e5d7a3-bd5d-4420-8bfc-86393f2acbea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:19:55 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-2be49fa8-8b2e-4ff6-8e3b-f74fe28684c4 tempest-CreateVolumesFromSnapshotTest-1784307287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fc78357-01ca-4762-ab84-19bab2613bca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:19:55 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-2be49fa8-8b2e-4ff6-8e3b-f74fe28684c4 tempest-CreateVolumesFromSnapshotTest-1784307287 None] Volume 1d51372a-ead7-45c9-8ee1-7a28ab8d1e9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d51372a-ead7-45c9-8ee1-7a28ab8d1e9d', 'volume_size': 1}
Apr 10 13:19:55 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-2be49fa8-8b2e-4ff6-8e3b-f74fe28684c4 tempest-CreateVolumesFromSnapshotTest-1784307287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:19:55 devstack sudo[90867]: pam_unix(sudo:session): session closed for user root
Apr 10 13:19:55 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-c3922956-dc5c-43f2-add7-bc53648086d4 tempest-CreateVolumesFromImageTest-885723365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.576s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:19:55 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-c3922956-dc5c-43f2-add7-bc53648086d4 tempest-CreateVolumesFromImageTest-885723365 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:19:55 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-c3922956-dc5c-43f2-add7-bc53648086d4 tempest-CreateVolumesFromImageTest-885723365 None] Deleted volume successfully.
Apr 10 13:19:55 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-c3922956-dc5c-43f2-add7-bc53648086d4 tempest-CreateVolumesFromImageTest-885723365 None] Lock "cinder-ac0224ab-26f8-47a8-ab27-eb486a615cc1-delete_volume" released by "delete_volume" :: held 2.165s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:19:55 devstack sudo[90865]: pam_unix(sudo:session): session closed for user root
Apr 10 13:19:55 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-5827edb6-3885-46fa-bd41-01a743369106 tempest-VolumeDependencyTests-1052055728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-51731cea-d883-4a30-a10a-53c990e379c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-51731cea-d883-4a30-a10a-53c990e379c4.bc0ca10d-6198-4514-86c2-f56b6ab7dcf1 1G" returned: 0 in 0.955s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:19:55 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-5827edb6-3885-46fa-bd41-01a743369106 tempest-VolumeDependencyTests-1052055728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51731cea-d883-4a30-a10a-53c990e379c4 -F qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-51731cea-d883-4a30-a10a-53c990e379c4.bc0ca10d-6198-4514-86c2-f56b6ab7dcf1 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:19:55 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-1d0f5105-d89d-42fc-962e-207f69f3c775 tempest-CreateVolumesFromImageTest-885723365 None] Acquiring lock "cinder-a1cf9098-6200-4bbe-8d86-97d5008960fa-delete_volume" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:19:55 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-1d0f5105-d89d-42fc-962e-207f69f3c775 tempest-CreateVolumesFromImageTest-885723365 None] Lock "cinder-a1cf9098-6200-4bbe-8d86-97d5008960fa-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:19:55 devstack sudo[90873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51731cea-d883-4a30-a10a-53c990e379c4 -F qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-51731cea-d883-4a30-a10a-53c990e379c4.bc0ca10d-6198-4514-86c2-f56b6ab7dcf1
Apr 10 13:19:55 devstack sudo[90873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:19:55 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-1d0f5105-d89d-42fc-962e-207f69f3c775 tempest-CreateVolumesFromImageTest-885723365 None] Acquiring lock "cinder-quobyte-a1cf9098-6200-4bbe-8d86-97d5008960fa" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:19:55 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-1d0f5105-d89d-42fc-962e-207f69f3c775 tempest-CreateVolumesFromImageTest-885723365 None] Lock "cinder-quobyte-a1cf9098-6200-4bbe-8d86-97d5008960fa" acquired by "delete_volume" :: waited 0.009s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:19:55 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d19467a-7db8-4cda-b214-a0cceb9b7ddb]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:19:55 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-1d0f5105-d89d-42fc-962e-207f69f3c775 tempest-CreateVolumesFromImageTest-885723365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-a1cf9098-6200-4bbe-8d86-97d5008960fa {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:19:55 devstack sudo[90875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-a1cf9098-6200-4bbe-8d86-97d5008960fa
Apr 10 13:19:55 devstack sudo[90875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:19:56 devstack sudo[90875]: pam_unix(sudo:session): session closed for user root
Apr 10 13:19:56 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-1d0f5105-d89d-42fc-962e-207f69f3c775 tempest-CreateVolumesFromImageTest-885723365 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-a1cf9098-6200-4bbe-8d86-97d5008960fa" returned: 0 in 0.524s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:19:56 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-1d0f5105-d89d-42fc-962e-207f69f3c775 tempest-CreateVolumesFromImageTest-885723365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-a1cf9098-6200-4bbe-8d86-97d5008960fa {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:19:56 devstack sudo[90873]: pam_unix(sudo:session): session closed for user root
Apr 10 13:19:56 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-5827edb6-3885-46fa-bd41-01a743369106 tempest-VolumeDependencyTests-1052055728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51731cea-d883-4a30-a10a-53c990e379c4 -F qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-51731cea-d883-4a30-a10a-53c990e379c4.bc0ca10d-6198-4514-86c2-f56b6ab7dcf1" returned: 0 in 0.681s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:19:56 devstack cinder-volume[83345]: WARNING cinder.volume.drivers.remotefs [None req-5827edb6-3885-46fa-bd41-01a743369106 tempest-VolumeDependencyTests-1052055728 None] /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-51731cea-d883-4a30-a10a-53c990e379c4.bc0ca10d-6198-4514-86c2-f56b6ab7dcf1 is being set with open permissions: ugo+rw
Apr 10 13:19:56 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-5827edb6-3885-46fa-bd41-01a743369106 tempest-VolumeDependencyTests-1052055728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-51731cea-d883-4a30-a10a-53c990e379c4.bc0ca10d-6198-4514-86c2-f56b6ab7dcf1 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:19:56 devstack sudo[90883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-a1cf9098-6200-4bbe-8d86-97d5008960fa
Apr 10 13:19:56 devstack sudo[90883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:19:56 devstack sudo[90884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-51731cea-d883-4a30-a10a-53c990e379c4.bc0ca10d-6198-4514-86c2-f56b6ab7dcf1
Apr 10 13:19:56 devstack sudo[90884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:19:56 devstack sudo[90883]: pam_unix(sudo:session): session closed for user root
Apr 10 13:19:56 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-1d0f5105-d89d-42fc-962e-207f69f3c775 tempest-CreateVolumesFromImageTest-885723365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-a1cf9098-6200-4bbe-8d86-97d5008960fa" returned: 0 in 0.525s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:19:56 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-1d0f5105-d89d-42fc-962e-207f69f3c775 tempest-CreateVolumesFromImageTest-885723365 None] Lock "cinder-quobyte-a1cf9098-6200-4bbe-8d86-97d5008960fa" released by "delete_volume" :: held 1.091s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:19:57 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-1d0f5105-d89d-42fc-962e-207f69f3c775 tempest-CreateVolumesFromImageTest-885723365 None] Created reservations ['6305871b-ed14-4f61-b01b-e4f5722f1fb5', '1e72a076-d9f5-46b9-be8d-4cea90b2d76b', 'fad55ab6-6634-45d9-a852-dddc7f8f325a', 'cc997148-6d20-4352-a75c-557c1bc5bf11'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:19:57 devstack sudo[90884]: pam_unix(sudo:session): session closed for user root
Apr 10 13:19:57 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-5827edb6-3885-46fa-bd41-01a743369106 tempest-VolumeDependencyTests-1052055728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-51731cea-d883-4a30-a10a-53c990e379c4.bc0ca10d-6198-4514-86c2-f56b6ab7dcf1" returned: 0 in 0.551s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:19:57 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-5827edb6-3885-46fa-bd41-01a743369106 tempest-VolumeDependencyTests-1052055728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-51731cea-d883-4a30-a10a-53c990e379c4.info {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:19:57 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-1d0f5105-d89d-42fc-962e-207f69f3c775 tempest-CreateVolumesFromImageTest-885723365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:19:57 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-1d0f5105-d89d-42fc-962e-207f69f3c775 tempest-CreateVolumesFromImageTest-885723365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:19:57 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-1d0f5105-d89d-42fc-962e-207f69f3c775 tempest-CreateVolumesFromImageTest-885723365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:19:57 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-1d0f5105-d89d-42fc-962e-207f69f3c775 tempest-CreateVolumesFromImageTest-885723365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:19:57 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-1d0f5105-d89d-42fc-962e-207f69f3c775 tempest-CreateVolumesFromImageTest-885723365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:19:57 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-1d0f5105-d89d-42fc-962e-207f69f3c775 tempest-CreateVolumesFromImageTest-885723365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:19:57 devstack sudo[90889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-51731cea-d883-4a30-a10a-53c990e379c4.info
Apr 10 13:19:57 devstack sudo[90889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:19:57 devstack sudo[90891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:19:57 devstack sudo[90891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:19:57 devstack sudo[90889]: pam_unix(sudo:session): session closed for user root
Apr 10 13:19:57 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-5827edb6-3885-46fa-bd41-01a743369106 tempest-VolumeDependencyTests-1052055728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-51731cea-d883-4a30-a10a-53c990e379c4.info" returned: 0 in 0.468s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:19:57 devstack cinder-volume[83345]: WARNING cinder.volume.drivers.remotefs [None req-5827edb6-3885-46fa-bd41-01a743369106 tempest-VolumeDependencyTests-1052055728 None] /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-51731cea-d883-4a30-a10a-53c990e379c4.info is being set with open permissions: ugo+rw
Apr 10 13:19:57 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-5827edb6-3885-46fa-bd41-01a743369106 tempest-VolumeDependencyTests-1052055728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-51731cea-d883-4a30-a10a-53c990e379c4.info {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:19:57 devstack sudo[90895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-51731cea-d883-4a30-a10a-53c990e379c4.info
Apr 10 13:19:57 devstack sudo[90895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:19:57 devstack sudo[90891]: pam_unix(sudo:session): session closed for user root
Apr 10 13:19:57 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-1d0f5105-d89d-42fc-962e-207f69f3c775 tempest-CreateVolumesFromImageTest-885723365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.481s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:19:57 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-1d0f5105-d89d-42fc-962e-207f69f3c775 tempest-CreateVolumesFromImageTest-885723365 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:19:57 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-1d0f5105-d89d-42fc-962e-207f69f3c775 tempest-CreateVolumesFromImageTest-885723365 None] Deleted volume successfully.
Apr 10 13:19:57 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-1d0f5105-d89d-42fc-962e-207f69f3c775 tempest-CreateVolumesFromImageTest-885723365 None] Lock "cinder-a1cf9098-6200-4bbe-8d86-97d5008960fa-delete_volume" released by "delete_volume" :: held 1.758s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:19:57 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-af788040-b239-4657-999b-2f88901fad59 tempest-CreateVolumesFromImageTest-885723365 None] Acquiring lock "cinder-864a7f83-e5b2-4dc1-a140-0b41692aa303-delete_volume" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:19:57 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-af788040-b239-4657-999b-2f88901fad59 tempest-CreateVolumesFromImageTest-885723365 None] Lock "cinder-864a7f83-e5b2-4dc1-a140-0b41692aa303-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:19:58 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-af788040-b239-4657-999b-2f88901fad59 tempest-CreateVolumesFromImageTest-885723365 None] Acquiring lock "cinder-quobyte-864a7f83-e5b2-4dc1-a140-0b41692aa303" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:19:58 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-af788040-b239-4657-999b-2f88901fad59 tempest-CreateVolumesFromImageTest-885723365 None] Lock "cinder-quobyte-864a7f83-e5b2-4dc1-a140-0b41692aa303" acquired by "delete_volume" :: waited 0.008s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:19:58 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5cc7b78-ccfb-4928-923a-3c52c5dc9eb6]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:19:58 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-af788040-b239-4657-999b-2f88901fad59 tempest-CreateVolumesFromImageTest-885723365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-864a7f83-e5b2-4dc1-a140-0b41692aa303 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:19:58 devstack sudo[90895]: pam_unix(sudo:session): session closed for user root
Apr 10 13:19:58 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-5827edb6-3885-46fa-bd41-01a743369106 tempest-VolumeDependencyTests-1052055728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-51731cea-d883-4a30-a10a-53c990e379c4.info" returned: 0 in 0.566s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:19:58 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-5827edb6-3885-46fa-bd41-01a743369106 tempest-VolumeDependencyTests-1052055728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.128s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:19:58 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-bbc323d0-828d-4530-bb72-405140bc6af0 tempest-CreateVolumesFromSnapshotTest-1784307287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.671s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:19:58 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-bbc323d0-828d-4530-bb72-405140bc6af0 tempest-CreateVolumesFromSnapshotTest-1784307287 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f252bf08b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:19:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-230440589',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e956d633-adf1-42b7-a96e-d913763867ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a18e4377f1c74528bb941686c897075f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:19:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:19:54Z,use_quota=True,user_id='7b4ce4eac6304d9684ac825aeb5fb7a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)}" {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 13:19:58 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-bbc323d0-828d-4530-bb72-405140bc6af0 tempest-CreateVolumesFromSnapshotTest-1784307287 None] Creating volume e956d633-adf1-42b7-a96e-d913763867ce {{(pid=83345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 13:19:58 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-bbc323d0-828d-4530-bb72-405140bc6af0 tempest-CreateVolumesFromSnapshotTest-1784307287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:19:58 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-bbc323d0-828d-4530-bb72-405140bc6af0 tempest-CreateVolumesFromSnapshotTest-1784307287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:19:58 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-bbc323d0-828d-4530-bb72-405140bc6af0 tempest-CreateVolumesFromSnapshotTest-1784307287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:19:58 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-bbc323d0-828d-4530-bb72-405140bc6af0 tempest-CreateVolumesFromSnapshotTest-1784307287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:19:58 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-bbc323d0-828d-4530-bb72-405140bc6af0 tempest-CreateVolumesFromSnapshotTest-1784307287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:19:58 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-bbc323d0-828d-4530-bb72-405140bc6af0 tempest-CreateVolumesFromSnapshotTest-1784307287 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:19:58 devstack cinder-volume[83345]: INFO cinder.volume.drivers.remotefs [None req-bbc323d0-828d-4530-bb72-405140bc6af0 tempest-CreateVolumesFromSnapshotTest-1784307287 None] casted to osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331
Apr 10 13:19:58 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-bbc323d0-828d-4530-bb72-405140bc6af0 tempest-CreateVolumesFromSnapshotTest-1784307287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e956d633-adf1-42b7-a96e-d913763867ce 1073741824 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:19:58 devstack sudo[90898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-864a7f83-e5b2-4dc1-a140-0b41692aa303
Apr 10 13:19:58 devstack sudo[90898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:19:58 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-5827edb6-3885-46fa-bd41-01a743369106 tempest-VolumeDependencyTests-1052055728 None] Create snapshot completed successfully
Apr 10 13:19:58 devstack sudo[90899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e956d633-adf1-42b7-a96e-d913763867ce 1073741824
Apr 10 13:19:58 devstack sudo[90899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:19:58 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-74de3ec5-f1b4-4333-9da9-c81c9e410526 tempest-SnapshotDependencyTests-797137213 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:19:58 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-74de3ec5-f1b4-4333-9da9-c81c9e410526 tempest-SnapshotDependencyTests-797137213 None] Flow 'volume_create_manager' (92281a8b-1878-41a0-b6c1-b083539d32d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:19:58 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-74de3ec5-f1b4-4333-9da9-c81c9e410526 tempest-SnapshotDependencyTests-797137213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c53dc68-281d-4678-aeeb-e29d45420e75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:19:58 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-74de3ec5-f1b4-4333-9da9-c81c9e410526 tempest-SnapshotDependencyTests-797137213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c53dc68-281d-4678-aeeb-e29d45420e75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:19:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1303589828',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=591f6681-dd5b-457f-8c20-9bb6ef7fe4f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0c36428522a4dbab0ad1a1311253752',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:19:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:19:58Z,use_quota=True,user_id='4bba6b35e42b484d83cd02833fa68c27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:19:58 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-74de3ec5-f1b4-4333-9da9-c81c9e410526 tempest-SnapshotDependencyTests-797137213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (929752a0-133c-4c3a-a676-6b8ca9b64caa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:19:58 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-74de3ec5-f1b4-4333-9da9-c81c9e410526 tempest-SnapshotDependencyTests-797137213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (929752a0-133c-4c3a-a676-6b8ca9b64caa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:19:58 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-74de3ec5-f1b4-4333-9da9-c81c9e410526 tempest-SnapshotDependencyTests-797137213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f926bd5-460f-42aa-ae75-38eb546c6da7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:19:58 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-74de3ec5-f1b4-4333-9da9-c81c9e410526 tempest-SnapshotDependencyTests-797137213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f926bd5-460f-42aa-ae75-38eb546c6da7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '591f6681-dd5b-457f-8c20-9bb6ef7fe4f9', 'volume_name': 'volume-591f6681-dd5b-457f-8c20-9bb6ef7fe4f9', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:19:58 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-74de3ec5-f1b4-4333-9da9-c81c9e410526 tempest-SnapshotDependencyTests-797137213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (611357a2-0d0c-4391-be71-992e3a5700c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:19:58 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-74de3ec5-f1b4-4333-9da9-c81c9e410526 tempest-SnapshotDependencyTests-797137213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (611357a2-0d0c-4391-be71-992e3a5700c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:19:58 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-74de3ec5-f1b4-4333-9da9-c81c9e410526 tempest-SnapshotDependencyTests-797137213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21e54454-459c-4a06-aae3-e81883ee7ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:19:58 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-74de3ec5-f1b4-4333-9da9-c81c9e410526 tempest-SnapshotDependencyTests-797137213 None] Volume 591f6681-dd5b-457f-8c20-9bb6ef7fe4f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-591f6681-dd5b-457f-8c20-9bb6ef7fe4f9', 'volume_size': 1}
Apr 10 13:19:58 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-74de3ec5-f1b4-4333-9da9-c81c9e410526 tempest-SnapshotDependencyTests-797137213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:19:58 devstack sudo[90898]: pam_unix(sudo:session): session closed for user root
Apr 10 13:19:58 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-af788040-b239-4657-999b-2f88901fad59 tempest-CreateVolumesFromImageTest-885723365 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-864a7f83-e5b2-4dc1-a140-0b41692aa303" returned: 0 in 0.561s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:19:58 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-af788040-b239-4657-999b-2f88901fad59 tempest-CreateVolumesFromImageTest-885723365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-864a7f83-e5b2-4dc1-a140-0b41692aa303 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:19:58 devstack sudo[90908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-864a7f83-e5b2-4dc1-a140-0b41692aa303
Apr 10 13:19:58 devstack sudo[90908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:19:58 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6e64043-68b7-4434-8f5c-c22cb37903e9 tempest-VolumeDependencyTests-1052055728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:19:58 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-c6e64043-68b7-4434-8f5c-c22cb37903e9 tempest-VolumeDependencyTests-1052055728 None] Flow 'volume_create_manager' (add81b5e-b1f3-4c49-8d60-9a90722b8147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:19:58 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-c6e64043-68b7-4434-8f5c-c22cb37903e9 tempest-VolumeDependencyTests-1052055728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (902d4b96-3f83-4a82-bf41-fc55dcfe624c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:19:58 devstack sudo[90899]: pam_unix(sudo:session): session closed for user root
Apr 10 13:19:58 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-c6e64043-68b7-4434-8f5c-c22cb37903e9 tempest-VolumeDependencyTests-1052055728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (902d4b96-3f83-4a82-bf41-fc55dcfe624c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:19:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2051148876',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c018ce6-b114-4814-98e4-4a13612f79b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b860b753090645ad91f52b3e138634de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:19:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=bc0ca10d-6198-4514-86c2-f56b6ab7dcf1,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:19:59Z,use_quota=True,user_id='866c4ed007134f509b6d0152fa189d0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:19:58 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-c6e64043-68b7-4434-8f5c-c22cb37903e9 tempest-VolumeDependencyTests-1052055728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a01a01d-3e15-4b90-9af6-049bc037a7cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:19:58 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-c6e64043-68b7-4434-8f5c-c22cb37903e9 tempest-VolumeDependencyTests-1052055728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a01a01d-3e15-4b90-9af6-049bc037a7cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:19:58 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-c6e64043-68b7-4434-8f5c-c22cb37903e9 tempest-VolumeDependencyTests-1052055728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (551ecd42-9de2-46f0-b68f-02c55b653a16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:19:58 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-c6e64043-68b7-4434-8f5c-c22cb37903e9 tempest-VolumeDependencyTests-1052055728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (551ecd42-9de2-46f0-b68f-02c55b653a16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9c018ce6-b114-4814-98e4-4a13612f79b8', 'volume_name': 'volume-9c018ce6-b114-4814-98e4-4a13612f79b8', 'volume_size': 1, 'snapshot_id': 'bc0ca10d-6198-4514-86c2-f56b6ab7dcf1'}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:19:58 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-c6e64043-68b7-4434-8f5c-c22cb37903e9 tempest-VolumeDependencyTests-1052055728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8778b06-6dc2-4e6d-b2fe-c727609fb10a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:19:58 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-c6e64043-68b7-4434-8f5c-c22cb37903e9 tempest-VolumeDependencyTests-1052055728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8778b06-6dc2-4e6d-b2fe-c727609fb10a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:19:58 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-c6e64043-68b7-4434-8f5c-c22cb37903e9 tempest-VolumeDependencyTests-1052055728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdfcb7a6-2a36-4000-99c7-5ee532ebbf6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:19:58 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-c6e64043-68b7-4434-8f5c-c22cb37903e9 tempest-VolumeDependencyTests-1052055728 None] Volume 9c018ce6-b114-4814-98e4-4a13612f79b8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9c018ce6-b114-4814-98e4-4a13612f79b8', 'volume_size': 1, 'snapshot_id': 'bc0ca10d-6198-4514-86c2-f56b6ab7dcf1'}
Apr 10 13:19:58 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-bbc323d0-828d-4530-bb72-405140bc6af0 tempest-CreateVolumesFromSnapshotTest-1784307287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e956d633-adf1-42b7-a96e-d913763867ce 1073741824" returned: 0 in 0.642s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:19:58 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-c6e64043-68b7-4434-8f5c-c22cb37903e9 tempest-VolumeDependencyTests-1052055728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:19:58 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-bbc323d0-828d-4530-bb72-405140bc6af0 tempest-CreateVolumesFromSnapshotTest-1784307287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e956d633-adf1-42b7-a96e-d913763867ce {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:19:58 devstack sudo[90910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e956d633-adf1-42b7-a96e-d913763867ce
Apr 10 13:19:58 devstack sudo[90910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:19:59 devstack sudo[90908]: pam_unix(sudo:session): session closed for user root
Apr 10 13:19:59 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-af788040-b239-4657-999b-2f88901fad59 tempest-CreateVolumesFromImageTest-885723365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-864a7f83-e5b2-4dc1-a140-0b41692aa303" returned: 0 in 0.423s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:19:59 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-af788040-b239-4657-999b-2f88901fad59 tempest-CreateVolumesFromImageTest-885723365 None] Lock "cinder-quobyte-864a7f83-e5b2-4dc1-a140-0b41692aa303" released by "delete_volume" :: held 1.006s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:19:59 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-af788040-b239-4657-999b-2f88901fad59 tempest-CreateVolumesFromImageTest-885723365 None] Created reservations ['d2e3acf4-6141-4254-8351-66457ba07dfb', '5a27f742-fce5-44a5-a5c7-e0b322a32fa3', 'daf462b2-f2f1-4dce-b493-0628a81064d4', '25b643b7-d442-4a3a-ad80-27ca49d1da6c'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:19:59 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-af788040-b239-4657-999b-2f88901fad59 tempest-CreateVolumesFromImageTest-885723365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:19:59 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-af788040-b239-4657-999b-2f88901fad59 tempest-CreateVolumesFromImageTest-885723365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:19:59 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-af788040-b239-4657-999b-2f88901fad59 tempest-CreateVolumesFromImageTest-885723365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:19:59 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-af788040-b239-4657-999b-2f88901fad59 tempest-CreateVolumesFromImageTest-885723365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:19:59 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-af788040-b239-4657-999b-2f88901fad59 tempest-CreateVolumesFromImageTest-885723365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:19:59 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-af788040-b239-4657-999b-2f88901fad59 tempest-CreateVolumesFromImageTest-885723365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:19:59 devstack sudo[90913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:19:59 devstack sudo[90913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:19:59 devstack sudo[90910]: pam_unix(sudo:session): session closed for user root
Apr 10 13:19:59 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-bbc323d0-828d-4530-bb72-405140bc6af0 tempest-CreateVolumesFromSnapshotTest-1784307287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e956d633-adf1-42b7-a96e-d913763867ce" returned: 0 in 0.425s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:19:59 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-bbc323d0-828d-4530-bb72-405140bc6af0 tempest-CreateVolumesFromSnapshotTest-1784307287 None] <== create_volume: return (1090ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'} {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 13:19:59 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-bbc323d0-828d-4530-bb72-405140bc6af0 tempest-CreateVolumesFromSnapshotTest-1784307287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.093s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:19:59 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-5c973681-826f-4770-9238-b3780c62dedb tempest-CreateVolumesFromSnapshotTest-1784307287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.384s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:19:59 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-5c973681-826f-4770-9238-b3780c62dedb tempest-CreateVolumesFromSnapshotTest-1784307287 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f252bf08b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:19:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-786332143',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f2f63fa-9bbd-4196-bdbe-aac49a2382b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a18e4377f1c74528bb941686c897075f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:19:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:19:55Z,use_quota=True,user_id='7b4ce4eac6304d9684ac825aeb5fb7a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)}" {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 13:19:59 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-5c973681-826f-4770-9238-b3780c62dedb tempest-CreateVolumesFromSnapshotTest-1784307287 None] Creating volume 4f2f63fa-9bbd-4196-bdbe-aac49a2382b6 {{(pid=83345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 13:19:59 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-5c973681-826f-4770-9238-b3780c62dedb tempest-CreateVolumesFromSnapshotTest-1784307287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:19:59 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-5c973681-826f-4770-9238-b3780c62dedb tempest-CreateVolumesFromSnapshotTest-1784307287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:19:59 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-5c973681-826f-4770-9238-b3780c62dedb tempest-CreateVolumesFromSnapshotTest-1784307287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:19:59 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-5c973681-826f-4770-9238-b3780c62dedb tempest-CreateVolumesFromSnapshotTest-1784307287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:19:59 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-5c973681-826f-4770-9238-b3780c62dedb tempest-CreateVolumesFromSnapshotTest-1784307287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:19:59 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-5c973681-826f-4770-9238-b3780c62dedb tempest-CreateVolumesFromSnapshotTest-1784307287 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:19:59 devstack cinder-volume[83345]: INFO cinder.volume.drivers.remotefs [None req-5c973681-826f-4770-9238-b3780c62dedb tempest-CreateVolumesFromSnapshotTest-1784307287 None] casted to osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331
Apr 10 13:19:59 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-5c973681-826f-4770-9238-b3780c62dedb tempest-CreateVolumesFromSnapshotTest-1784307287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f2f63fa-9bbd-4196-bdbe-aac49a2382b6 1073741824 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:19:59 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-bbc323d0-828d-4530-bb72-405140bc6af0 tempest-CreateVolumesFromSnapshotTest-1784307287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ba68ba1-6d41-4f85-9e46-3eee6c3903ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e956d633-adf1-42b7-a96e-d913763867ce', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:19:59 devstack sudo[90916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f2f63fa-9bbd-4196-bdbe-aac49a2382b6 1073741824
Apr 10 13:19:59 devstack sudo[90916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:19:59 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-bbc323d0-828d-4530-bb72-405140bc6af0 tempest-CreateVolumesFromSnapshotTest-1784307287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7144af32-dc7b-4135-8e7a-4c0ecf7193e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:19:59 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-bbc323d0-828d-4530-bb72-405140bc6af0 tempest-CreateVolumesFromSnapshotTest-1784307287 None] Volume volume-e956d633-adf1-42b7-a96e-d913763867ce (e956d633-adf1-42b7-a96e-d913763867ce): created successfully
Apr 10 13:19:59 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-bbc323d0-828d-4530-bb72-405140bc6af0 tempest-CreateVolumesFromSnapshotTest-1784307287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7144af32-dc7b-4135-8e7a-4c0ecf7193e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:19:59 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-bbc323d0-828d-4530-bb72-405140bc6af0 tempest-CreateVolumesFromSnapshotTest-1784307287 None] Flow 'volume_create_manager' (8127be80-1a2a-4027-bea4-93bce8e10b2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:19:59 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-bbc323d0-828d-4530-bb72-405140bc6af0 tempest-CreateVolumesFromSnapshotTest-1784307287 None] Created volume successfully.
Apr 10 13:19:59 devstack sudo[90913]: pam_unix(sudo:session): session closed for user root
Apr 10 13:19:59 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-af788040-b239-4657-999b-2f88901fad59 tempest-CreateVolumesFromImageTest-885723365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.405s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:19:59 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-af788040-b239-4657-999b-2f88901fad59 tempest-CreateVolumesFromImageTest-885723365 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:19:59 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-af788040-b239-4657-999b-2f88901fad59 tempest-CreateVolumesFromImageTest-885723365 None] Deleted volume successfully.
Apr 10 13:19:59 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-af788040-b239-4657-999b-2f88901fad59 tempest-CreateVolumesFromImageTest-885723365 None] Lock "cinder-864a7f83-e5b2-4dc1-a140-0b41692aa303-delete_volume" released by "delete_volume" :: held 1.555s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:19:59 devstack sudo[90916]: pam_unix(sudo:session): session closed for user root
Apr 10 13:19:59 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-5c973681-826f-4770-9238-b3780c62dedb tempest-CreateVolumesFromSnapshotTest-1784307287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f2f63fa-9bbd-4196-bdbe-aac49a2382b6 1073741824" returned: 0 in 0.468s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:19:59 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-5c973681-826f-4770-9238-b3780c62dedb tempest-CreateVolumesFromSnapshotTest-1784307287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f2f63fa-9bbd-4196-bdbe-aac49a2382b6 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:19:59 devstack sudo[90922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f2f63fa-9bbd-4196-bdbe-aac49a2382b6
Apr 10 13:19:59 devstack sudo[90922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:00 devstack sudo[90922]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:00 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-5c973681-826f-4770-9238-b3780c62dedb tempest-CreateVolumesFromSnapshotTest-1784307287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f2f63fa-9bbd-4196-bdbe-aac49a2382b6" returned: 0 in 0.410s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:00 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-5c973681-826f-4770-9238-b3780c62dedb tempest-CreateVolumesFromSnapshotTest-1784307287 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'} {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 13:20:00 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-5c973681-826f-4770-9238-b3780c62dedb tempest-CreateVolumesFromSnapshotTest-1784307287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:20:00 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-c6e91123-046d-4503-9ab5-f3300aad6fcc tempest-CreateVolumesFromSnapshotTest-1784307287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.068s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:20:00 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-c6e91123-046d-4503-9ab5-f3300aad6fcc tempest-CreateVolumesFromSnapshotTest-1784307287 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f252bf08b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:19:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1101286447',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=384950bf-fdaa-4b43-8bbf-231096f646f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a18e4377f1c74528bb941686c897075f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:19:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:19:55Z,use_quota=True,user_id='7b4ce4eac6304d9684ac825aeb5fb7a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)}" {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 13:20:00 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-c6e91123-046d-4503-9ab5-f3300aad6fcc tempest-CreateVolumesFromSnapshotTest-1784307287 None] Creating volume 384950bf-fdaa-4b43-8bbf-231096f646f7 {{(pid=83345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 13:20:00 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-c6e91123-046d-4503-9ab5-f3300aad6fcc tempest-CreateVolumesFromSnapshotTest-1784307287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:20:00 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-c6e91123-046d-4503-9ab5-f3300aad6fcc tempest-CreateVolumesFromSnapshotTest-1784307287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:20:00 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-c6e91123-046d-4503-9ab5-f3300aad6fcc tempest-CreateVolumesFromSnapshotTest-1784307287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:20:00 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-c6e91123-046d-4503-9ab5-f3300aad6fcc tempest-CreateVolumesFromSnapshotTest-1784307287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:20:00 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-c6e91123-046d-4503-9ab5-f3300aad6fcc tempest-CreateVolumesFromSnapshotTest-1784307287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:20:00 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-c6e91123-046d-4503-9ab5-f3300aad6fcc tempest-CreateVolumesFromSnapshotTest-1784307287 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:20:00 devstack cinder-volume[83345]: INFO cinder.volume.drivers.remotefs [None req-c6e91123-046d-4503-9ab5-f3300aad6fcc tempest-CreateVolumesFromSnapshotTest-1784307287 None] casted to osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331
Apr 10 13:20:00 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-c6e91123-046d-4503-9ab5-f3300aad6fcc tempest-CreateVolumesFromSnapshotTest-1784307287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-384950bf-fdaa-4b43-8bbf-231096f646f7 1073741824 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:00 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-5c973681-826f-4770-9238-b3780c62dedb tempest-CreateVolumesFromSnapshotTest-1784307287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5727be05-c589-46ed-ab1b-2cc184edb601) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f2f63fa-9bbd-4196-bdbe-aac49a2382b6', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:20:00 devstack sudo[90925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-384950bf-fdaa-4b43-8bbf-231096f646f7 1073741824
Apr 10 13:20:00 devstack sudo[90925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:00 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-5c973681-826f-4770-9238-b3780c62dedb tempest-CreateVolumesFromSnapshotTest-1784307287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dffc96d-93c9-4349-9315-e27c0a356df6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:20:00 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-237abccd-d893-4ebf-a425-fb4187f0d80b tempest-CreateVolumesFromImageTest-885723365 None] Acquiring lock "cinder-c22068b8-c3fd-44af-bb88-ab44c3ec5a3a-delete_volume" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:20:00 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-5c973681-826f-4770-9238-b3780c62dedb tempest-CreateVolumesFromSnapshotTest-1784307287 None] Volume volume-4f2f63fa-9bbd-4196-bdbe-aac49a2382b6 (4f2f63fa-9bbd-4196-bdbe-aac49a2382b6): created successfully
Apr 10 13:20:00 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-5c973681-826f-4770-9238-b3780c62dedb tempest-CreateVolumesFromSnapshotTest-1784307287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dffc96d-93c9-4349-9315-e27c0a356df6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:20:00 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-5c973681-826f-4770-9238-b3780c62dedb tempest-CreateVolumesFromSnapshotTest-1784307287 None] Flow 'volume_create_manager' (f9adf894-3596-47dc-ac50-56deee7d3fa5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:20:00 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-5c973681-826f-4770-9238-b3780c62dedb tempest-CreateVolumesFromSnapshotTest-1784307287 None] Created volume successfully.
Apr 10 13:20:00 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-237abccd-d893-4ebf-a425-fb4187f0d80b tempest-CreateVolumesFromImageTest-885723365 None] Lock "cinder-c22068b8-c3fd-44af-bb88-ab44c3ec5a3a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:20:00 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-237abccd-d893-4ebf-a425-fb4187f0d80b tempest-CreateVolumesFromImageTest-885723365 None] Acquiring lock "cinder-quobyte-c22068b8-c3fd-44af-bb88-ab44c3ec5a3a" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:20:00 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-237abccd-d893-4ebf-a425-fb4187f0d80b tempest-CreateVolumesFromImageTest-885723365 None] Lock "cinder-quobyte-c22068b8-c3fd-44af-bb88-ab44c3ec5a3a" acquired by "delete_volume" :: waited 0.011s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:20:00 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c2d429d-d568-4e59-b4c0-0e0cd89186b1]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:20:00 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-237abccd-d893-4ebf-a425-fb4187f0d80b tempest-CreateVolumesFromImageTest-885723365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-c22068b8-c3fd-44af-bb88-ab44c3ec5a3a {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:00 devstack sudo[90927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-c22068b8-c3fd-44af-bb88-ab44c3ec5a3a
Apr 10 13:20:00 devstack sudo[90927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:00 devstack sudo[90925]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:00 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-c6e91123-046d-4503-9ab5-f3300aad6fcc tempest-CreateVolumesFromSnapshotTest-1784307287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-384950bf-fdaa-4b43-8bbf-231096f646f7 1073741824" returned: 0 in 0.489s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:00 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-c6e91123-046d-4503-9ab5-f3300aad6fcc tempest-CreateVolumesFromSnapshotTest-1784307287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-384950bf-fdaa-4b43-8bbf-231096f646f7 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:00 devstack sudo[90932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-384950bf-fdaa-4b43-8bbf-231096f646f7
Apr 10 13:20:00 devstack sudo[90932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:00 devstack sudo[90927]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:00 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-237abccd-d893-4ebf-a425-fb4187f0d80b tempest-CreateVolumesFromImageTest-885723365 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-c22068b8-c3fd-44af-bb88-ab44c3ec5a3a" returned: 0 in 0.535s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:00 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-237abccd-d893-4ebf-a425-fb4187f0d80b tempest-CreateVolumesFromImageTest-885723365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-c22068b8-c3fd-44af-bb88-ab44c3ec5a3a {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:00 devstack sudo[90937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-c22068b8-c3fd-44af-bb88-ab44c3ec5a3a
Apr 10 13:20:00 devstack sudo[90937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:01 devstack sudo[90932]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:01 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-c6e91123-046d-4503-9ab5-f3300aad6fcc tempest-CreateVolumesFromSnapshotTest-1784307287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-384950bf-fdaa-4b43-8bbf-231096f646f7" returned: 0 in 0.414s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:01 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-c6e91123-046d-4503-9ab5-f3300aad6fcc tempest-CreateVolumesFromSnapshotTest-1784307287 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'} {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 13:20:01 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-c6e91123-046d-4503-9ab5-f3300aad6fcc tempest-CreateVolumesFromSnapshotTest-1784307287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:20:01 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-9d54c8c8-ebd5-4bc9-911d-eeccb7ec1b6c tempest-CreateVolumesFromSnapshotTest-1784307287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.676s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:20:01 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-9d54c8c8-ebd5-4bc9-911d-eeccb7ec1b6c tempest-CreateVolumesFromSnapshotTest-1784307287 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f252bf08b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:19:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2087359845',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b9cbc12-e90f-4320-b23e-cc5516c1a2b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a18e4377f1c74528bb941686c897075f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:19:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:19:55Z,use_quota=True,user_id='7b4ce4eac6304d9684ac825aeb5fb7a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)}" {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 13:20:01 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-9d54c8c8-ebd5-4bc9-911d-eeccb7ec1b6c tempest-CreateVolumesFromSnapshotTest-1784307287 None] Creating volume 2b9cbc12-e90f-4320-b23e-cc5516c1a2b2 {{(pid=83345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 13:20:01 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-9d54c8c8-ebd5-4bc9-911d-eeccb7ec1b6c tempest-CreateVolumesFromSnapshotTest-1784307287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:20:01 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-9d54c8c8-ebd5-4bc9-911d-eeccb7ec1b6c tempest-CreateVolumesFromSnapshotTest-1784307287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:20:01 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-9d54c8c8-ebd5-4bc9-911d-eeccb7ec1b6c tempest-CreateVolumesFromSnapshotTest-1784307287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:20:01 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-9d54c8c8-ebd5-4bc9-911d-eeccb7ec1b6c tempest-CreateVolumesFromSnapshotTest-1784307287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:20:01 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-9d54c8c8-ebd5-4bc9-911d-eeccb7ec1b6c tempest-CreateVolumesFromSnapshotTest-1784307287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:20:01 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-9d54c8c8-ebd5-4bc9-911d-eeccb7ec1b6c tempest-CreateVolumesFromSnapshotTest-1784307287 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:20:01 devstack cinder-volume[83345]: INFO cinder.volume.drivers.remotefs [None req-9d54c8c8-ebd5-4bc9-911d-eeccb7ec1b6c tempest-CreateVolumesFromSnapshotTest-1784307287 None] casted to osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331
Apr 10 13:20:01 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-9d54c8c8-ebd5-4bc9-911d-eeccb7ec1b6c tempest-CreateVolumesFromSnapshotTest-1784307287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-2b9cbc12-e90f-4320-b23e-cc5516c1a2b2 1073741824 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:01 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-c6e91123-046d-4503-9ab5-f3300aad6fcc tempest-CreateVolumesFromSnapshotTest-1784307287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b716d8d5-ed17-47b0-831b-520d3a774fed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-384950bf-fdaa-4b43-8bbf-231096f646f7', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:20:01 devstack sudo[90940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-2b9cbc12-e90f-4320-b23e-cc5516c1a2b2 1073741824
Apr 10 13:20:01 devstack sudo[90940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:01 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-c6e91123-046d-4503-9ab5-f3300aad6fcc tempest-CreateVolumesFromSnapshotTest-1784307287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5b4dea1-107e-428a-8ce9-5e1826386994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:20:01 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-c6e91123-046d-4503-9ab5-f3300aad6fcc tempest-CreateVolumesFromSnapshotTest-1784307287 None] Volume volume-384950bf-fdaa-4b43-8bbf-231096f646f7 (384950bf-fdaa-4b43-8bbf-231096f646f7): created successfully
Apr 10 13:20:01 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-c6e91123-046d-4503-9ab5-f3300aad6fcc tempest-CreateVolumesFromSnapshotTest-1784307287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5b4dea1-107e-428a-8ce9-5e1826386994) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:20:01 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-c6e91123-046d-4503-9ab5-f3300aad6fcc tempest-CreateVolumesFromSnapshotTest-1784307287 None] Flow 'volume_create_manager' (0323045a-2205-4f68-9735-30f05d27c066) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:20:01 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-c6e91123-046d-4503-9ab5-f3300aad6fcc tempest-CreateVolumesFromSnapshotTest-1784307287 None] Created volume successfully.
Apr 10 13:20:01 devstack sudo[90937]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:01 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-237abccd-d893-4ebf-a425-fb4187f0d80b tempest-CreateVolumesFromImageTest-885723365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-c22068b8-c3fd-44af-bb88-ab44c3ec5a3a" returned: 0 in 0.448s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:01 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-237abccd-d893-4ebf-a425-fb4187f0d80b tempest-CreateVolumesFromImageTest-885723365 None] Lock "cinder-quobyte-c22068b8-c3fd-44af-bb88-ab44c3ec5a3a" released by "delete_volume" :: held 1.008s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:20:01 devstack cinder-volume[83345]: DEBUG dbcounter [-] [83345] Writing DB stats cinder:SELECT=108,cinder:INSERT=38,cinder:UPDATE=168,cinder:DELETE=11 {{(pid=83345) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 10 13:20:01 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-237abccd-d893-4ebf-a425-fb4187f0d80b tempest-CreateVolumesFromImageTest-885723365 None] Created reservations ['50801adf-647e-481a-b858-b6e39cd3b74b', '179bddea-dd01-4e45-8f4e-a6b22cbd5652', '09620238-6dd7-477c-b83c-dcd88e4c2795', '17b3acf7-afed-4f1e-940d-b1292bc3b411'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:20:01 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-237abccd-d893-4ebf-a425-fb4187f0d80b tempest-CreateVolumesFromImageTest-885723365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:20:01 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-237abccd-d893-4ebf-a425-fb4187f0d80b tempest-CreateVolumesFromImageTest-885723365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:20:01 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-237abccd-d893-4ebf-a425-fb4187f0d80b tempest-CreateVolumesFromImageTest-885723365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:20:01 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-237abccd-d893-4ebf-a425-fb4187f0d80b tempest-CreateVolumesFromImageTest-885723365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:20:01 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-237abccd-d893-4ebf-a425-fb4187f0d80b tempest-CreateVolumesFromImageTest-885723365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:20:01 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-237abccd-d893-4ebf-a425-fb4187f0d80b tempest-CreateVolumesFromImageTest-885723365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:01 devstack sudo[90943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:20:01 devstack sudo[90943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:01 devstack sudo[90940]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:01 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-9d54c8c8-ebd5-4bc9-911d-eeccb7ec1b6c tempest-CreateVolumesFromSnapshotTest-1784307287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-2b9cbc12-e90f-4320-b23e-cc5516c1a2b2 1073741824" returned: 0 in 0.485s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:01 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-9d54c8c8-ebd5-4bc9-911d-eeccb7ec1b6c tempest-CreateVolumesFromSnapshotTest-1784307287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-2b9cbc12-e90f-4320-b23e-cc5516c1a2b2 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:01 devstack sudo[90949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-2b9cbc12-e90f-4320-b23e-cc5516c1a2b2
Apr 10 13:20:01 devstack sudo[90949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:01 devstack sudo[90943]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:01 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-237abccd-d893-4ebf-a425-fb4187f0d80b tempest-CreateVolumesFromImageTest-885723365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.464s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:01 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-237abccd-d893-4ebf-a425-fb4187f0d80b tempest-CreateVolumesFromImageTest-885723365 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:20:01 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-237abccd-d893-4ebf-a425-fb4187f0d80b tempest-CreateVolumesFromImageTest-885723365 None] Deleted volume successfully.
Apr 10 13:20:01 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-237abccd-d893-4ebf-a425-fb4187f0d80b tempest-CreateVolumesFromImageTest-885723365 None] Lock "cinder-c22068b8-c3fd-44af-bb88-ab44c3ec5a3a-delete_volume" released by "delete_volume" :: held 1.651s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:20:01 devstack sudo[90949]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:01 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-9d54c8c8-ebd5-4bc9-911d-eeccb7ec1b6c tempest-CreateVolumesFromSnapshotTest-1784307287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-2b9cbc12-e90f-4320-b23e-cc5516c1a2b2" returned: 0 in 0.423s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:01 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-9d54c8c8-ebd5-4bc9-911d-eeccb7ec1b6c tempest-CreateVolumesFromSnapshotTest-1784307287 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'} {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 13:20:01 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-9d54c8c8-ebd5-4bc9-911d-eeccb7ec1b6c tempest-CreateVolumesFromSnapshotTest-1784307287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:20:01 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-2be49fa8-8b2e-4ff6-8e3b-f74fe28684c4 tempest-CreateVolumesFromSnapshotTest-1784307287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.364s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:20:01 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-2be49fa8-8b2e-4ff6-8e3b-f74fe28684c4 tempest-CreateVolumesFromSnapshotTest-1784307287 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f252bf08b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:19:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-155597474',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d51372a-ead7-45c9-8ee1-7a28ab8d1e9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a18e4377f1c74528bb941686c897075f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:19:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:19:56Z,use_quota=True,user_id='7b4ce4eac6304d9684ac825aeb5fb7a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)}" {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 13:20:01 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-2be49fa8-8b2e-4ff6-8e3b-f74fe28684c4 tempest-CreateVolumesFromSnapshotTest-1784307287 None] Creating volume 1d51372a-ead7-45c9-8ee1-7a28ab8d1e9d {{(pid=83345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 13:20:01 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-2be49fa8-8b2e-4ff6-8e3b-f74fe28684c4 tempest-CreateVolumesFromSnapshotTest-1784307287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:20:01 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-2be49fa8-8b2e-4ff6-8e3b-f74fe28684c4 tempest-CreateVolumesFromSnapshotTest-1784307287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:20:02 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-2be49fa8-8b2e-4ff6-8e3b-f74fe28684c4 tempest-CreateVolumesFromSnapshotTest-1784307287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:20:02 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-2be49fa8-8b2e-4ff6-8e3b-f74fe28684c4 tempest-CreateVolumesFromSnapshotTest-1784307287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:20:02 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-2be49fa8-8b2e-4ff6-8e3b-f74fe28684c4 tempest-CreateVolumesFromSnapshotTest-1784307287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:20:02 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-2be49fa8-8b2e-4ff6-8e3b-f74fe28684c4 tempest-CreateVolumesFromSnapshotTest-1784307287 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:20:02 devstack cinder-volume[83345]: INFO cinder.volume.drivers.remotefs [None req-2be49fa8-8b2e-4ff6-8e3b-f74fe28684c4 tempest-CreateVolumesFromSnapshotTest-1784307287 None] casted to osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331
Apr 10 13:20:02 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-2be49fa8-8b2e-4ff6-8e3b-f74fe28684c4 tempest-CreateVolumesFromSnapshotTest-1784307287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-1d51372a-ead7-45c9-8ee1-7a28ab8d1e9d 1073741824 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:02 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-9d54c8c8-ebd5-4bc9-911d-eeccb7ec1b6c tempest-CreateVolumesFromSnapshotTest-1784307287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (345c06ff-acaf-4cfb-8b3b-f95c2c668e46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b9cbc12-e90f-4320-b23e-cc5516c1a2b2', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:20:02 devstack sudo[90953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-1d51372a-ead7-45c9-8ee1-7a28ab8d1e9d 1073741824
Apr 10 13:20:02 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-9d54c8c8-ebd5-4bc9-911d-eeccb7ec1b6c tempest-CreateVolumesFromSnapshotTest-1784307287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87b7293a-9684-4d41-84bc-d29163c3147e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:20:02 devstack sudo[90953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:02 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-9d54c8c8-ebd5-4bc9-911d-eeccb7ec1b6c tempest-CreateVolumesFromSnapshotTest-1784307287 None] Volume volume-2b9cbc12-e90f-4320-b23e-cc5516c1a2b2 (2b9cbc12-e90f-4320-b23e-cc5516c1a2b2): created successfully
Apr 10 13:20:02 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-9d54c8c8-ebd5-4bc9-911d-eeccb7ec1b6c tempest-CreateVolumesFromSnapshotTest-1784307287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87b7293a-9684-4d41-84bc-d29163c3147e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:20:02 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-9d54c8c8-ebd5-4bc9-911d-eeccb7ec1b6c tempest-CreateVolumesFromSnapshotTest-1784307287 None] Flow 'volume_create_manager' (5dd97dab-9fca-4683-b253-97d0f66a03a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:20:02 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-9d54c8c8-ebd5-4bc9-911d-eeccb7ec1b6c tempest-CreateVolumesFromSnapshotTest-1784307287 None] Created volume successfully.
Apr 10 13:20:02 devstack sudo[90953]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:02 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-2be49fa8-8b2e-4ff6-8e3b-f74fe28684c4 tempest-CreateVolumesFromSnapshotTest-1784307287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-1d51372a-ead7-45c9-8ee1-7a28ab8d1e9d 1073741824" returned: 0 in 0.549s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:02 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-2be49fa8-8b2e-4ff6-8e3b-f74fe28684c4 tempest-CreateVolumesFromSnapshotTest-1784307287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-1d51372a-ead7-45c9-8ee1-7a28ab8d1e9d {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:02 devstack sudo[90958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-1d51372a-ead7-45c9-8ee1-7a28ab8d1e9d
Apr 10 13:20:02 devstack sudo[90958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:03 devstack sudo[90958]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:03 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-2be49fa8-8b2e-4ff6-8e3b-f74fe28684c4 tempest-CreateVolumesFromSnapshotTest-1784307287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-1d51372a-ead7-45c9-8ee1-7a28ab8d1e9d" returned: 0 in 0.505s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:03 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-2be49fa8-8b2e-4ff6-8e3b-f74fe28684c4 tempest-CreateVolumesFromSnapshotTest-1784307287 None] <== create_volume: return (1080ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'} {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 13:20:03 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-2be49fa8-8b2e-4ff6-8e3b-f74fe28684c4 tempest-CreateVolumesFromSnapshotTest-1784307287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.085s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:20:03 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-74de3ec5-f1b4-4333-9da9-c81c9e410526 tempest-SnapshotDependencyTests-797137213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.830s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:20:03 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-74de3ec5-f1b4-4333-9da9-c81c9e410526 tempest-SnapshotDependencyTests-797137213 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f252bf08b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:19:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1303589828',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=591f6681-dd5b-457f-8c20-9bb6ef7fe4f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0c36428522a4dbab0ad1a1311253752',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:19:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:19:58Z,use_quota=True,user_id='4bba6b35e42b484d83cd02833fa68c27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)}" {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 13:20:03 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-74de3ec5-f1b4-4333-9da9-c81c9e410526 tempest-SnapshotDependencyTests-797137213 None] Creating volume 591f6681-dd5b-457f-8c20-9bb6ef7fe4f9 {{(pid=83345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 13:20:03 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-74de3ec5-f1b4-4333-9da9-c81c9e410526 tempest-SnapshotDependencyTests-797137213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:20:03 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-74de3ec5-f1b4-4333-9da9-c81c9e410526 tempest-SnapshotDependencyTests-797137213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:20:03 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-74de3ec5-f1b4-4333-9da9-c81c9e410526 tempest-SnapshotDependencyTests-797137213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:20:03 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-74de3ec5-f1b4-4333-9da9-c81c9e410526 tempest-SnapshotDependencyTests-797137213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:20:03 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-74de3ec5-f1b4-4333-9da9-c81c9e410526 tempest-SnapshotDependencyTests-797137213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:20:03 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-74de3ec5-f1b4-4333-9da9-c81c9e410526 tempest-SnapshotDependencyTests-797137213 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:20:03 devstack cinder-volume[83345]: INFO cinder.volume.drivers.remotefs [None req-74de3ec5-f1b4-4333-9da9-c81c9e410526 tempest-SnapshotDependencyTests-797137213 None] casted to osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331
Apr 10 13:20:03 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-74de3ec5-f1b4-4333-9da9-c81c9e410526 tempest-SnapshotDependencyTests-797137213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-591f6681-dd5b-457f-8c20-9bb6ef7fe4f9 1073741824 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:03 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-2be49fa8-8b2e-4ff6-8e3b-f74fe28684c4 tempest-CreateVolumesFromSnapshotTest-1784307287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fc78357-01ca-4762-ab84-19bab2613bca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d51372a-ead7-45c9-8ee1-7a28ab8d1e9d', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:20:03 devstack sudo[90961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-591f6681-dd5b-457f-8c20-9bb6ef7fe4f9 1073741824
Apr 10 13:20:03 devstack sudo[90961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:03 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-2be49fa8-8b2e-4ff6-8e3b-f74fe28684c4 tempest-CreateVolumesFromSnapshotTest-1784307287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29ef97ae-47c4-4b15-8dfd-996833ea204e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:20:03 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-2be49fa8-8b2e-4ff6-8e3b-f74fe28684c4 tempest-CreateVolumesFromSnapshotTest-1784307287 None] Volume volume-1d51372a-ead7-45c9-8ee1-7a28ab8d1e9d (1d51372a-ead7-45c9-8ee1-7a28ab8d1e9d): created successfully
Apr 10 13:20:03 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-2be49fa8-8b2e-4ff6-8e3b-f74fe28684c4 tempest-CreateVolumesFromSnapshotTest-1784307287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29ef97ae-47c4-4b15-8dfd-996833ea204e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:20:03 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-2be49fa8-8b2e-4ff6-8e3b-f74fe28684c4 tempest-CreateVolumesFromSnapshotTest-1784307287 None] Flow 'volume_create_manager' (57684e45-0cbe-440d-ab8b-2ab7dee52687) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:20:03 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-2be49fa8-8b2e-4ff6-8e3b-f74fe28684c4 tempest-CreateVolumesFromSnapshotTest-1784307287 None] Created volume successfully.
Apr 10 13:20:03 devstack sudo[90961]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:03 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-74de3ec5-f1b4-4333-9da9-c81c9e410526 tempest-SnapshotDependencyTests-797137213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-591f6681-dd5b-457f-8c20-9bb6ef7fe4f9 1073741824" returned: 0 in 0.592s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:03 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-74de3ec5-f1b4-4333-9da9-c81c9e410526 tempest-SnapshotDependencyTests-797137213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-591f6681-dd5b-457f-8c20-9bb6ef7fe4f9 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:03 devstack sudo[90966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-591f6681-dd5b-457f-8c20-9bb6ef7fe4f9
Apr 10 13:20:03 devstack sudo[90966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:04 devstack sudo[90966]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:04 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-74de3ec5-f1b4-4333-9da9-c81c9e410526 tempest-SnapshotDependencyTests-797137213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-591f6681-dd5b-457f-8c20-9bb6ef7fe4f9" returned: 0 in 0.449s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:04 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-74de3ec5-f1b4-4333-9da9-c81c9e410526 tempest-SnapshotDependencyTests-797137213 None] <== create_volume: return (1073ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'} {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 13:20:04 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-74de3ec5-f1b4-4333-9da9-c81c9e410526 tempest-SnapshotDependencyTests-797137213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.076s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:20:04 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-c6e64043-68b7-4434-8f5c-c22cb37903e9 tempest-VolumeDependencyTests-1052055728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 5.396s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:20:04 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-c6e64043-68b7-4434-8f5c-c22cb37903e9 tempest-VolumeDependencyTests-1052055728 None] Acquiring lock "cinder-quobyte-bc0ca10d-6198-4514-86c2-f56b6ab7dcf1-9c018ce6-b114-4814-98e4-4a13612f79b8" by "_create_volume_from_snapshot" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:20:04 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-74de3ec5-f1b4-4333-9da9-c81c9e410526 tempest-SnapshotDependencyTests-797137213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21e54454-459c-4a06-aae3-e81883ee7ef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-591f6681-dd5b-457f-8c20-9bb6ef7fe4f9', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:20:04 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-74de3ec5-f1b4-4333-9da9-c81c9e410526 tempest-SnapshotDependencyTests-797137213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e2a6862-0253-4e9d-8b10-85258cdb23f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:20:04 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-c6e64043-68b7-4434-8f5c-c22cb37903e9 tempest-VolumeDependencyTests-1052055728 None] Lock "cinder-quobyte-bc0ca10d-6198-4514-86c2-f56b6ab7dcf1-9c018ce6-b114-4814-98e4-4a13612f79b8" acquired by "_create_volume_from_snapshot" :: waited 0.027s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:20:04 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-c6e64043-68b7-4434-8f5c-c22cb37903e9 tempest-VolumeDependencyTests-1052055728 None] Creating volume 9c018ce6-b114-4814-98e4-4a13612f79b8 from snapshot bc0ca10d-6198-4514-86c2-f56b6ab7dcf1 {{(pid=83345) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 10 13:20:04 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-c6e64043-68b7-4434-8f5c-c22cb37903e9 tempest-VolumeDependencyTests-1052055728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:20:04 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-c6e64043-68b7-4434-8f5c-c22cb37903e9 tempest-VolumeDependencyTests-1052055728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:20:04 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-c6e64043-68b7-4434-8f5c-c22cb37903e9 tempest-VolumeDependencyTests-1052055728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:20:04 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-c6e64043-68b7-4434-8f5c-c22cb37903e9 tempest-VolumeDependencyTests-1052055728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:20:04 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-c6e64043-68b7-4434-8f5c-c22cb37903e9 tempest-VolumeDependencyTests-1052055728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:20:04 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-c6e64043-68b7-4434-8f5c-c22cb37903e9 tempest-VolumeDependencyTests-1052055728 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:20:04 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-c6e64043-68b7-4434-8f5c-c22cb37903e9 tempest-VolumeDependencyTests-1052055728 None] Acquiring lock "cinder-quobyte-9c018ce6-b114-4814-98e4-4a13612f79b8" by "_copy_volume_from_snapshot" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:20:04 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a30e83d-0a63-4e20-b5f8-06bd032dc24c tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:20:04 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-2a30e83d-0a63-4e20-b5f8-06bd032dc24c tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Flow 'volume_create_manager' (41a99116-f484-474e-86c3-17eca2734483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:20:04 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-2a30e83d-0a63-4e20-b5f8-06bd032dc24c tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0376ae5-6365-4563-a367-6fd0d55fabb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:20:04 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-74de3ec5-f1b4-4333-9da9-c81c9e410526 tempest-SnapshotDependencyTests-797137213 None] Volume volume-591f6681-dd5b-457f-8c20-9bb6ef7fe4f9 (591f6681-dd5b-457f-8c20-9bb6ef7fe4f9): created successfully
Apr 10 13:20:04 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-74de3ec5-f1b4-4333-9da9-c81c9e410526 tempest-SnapshotDependencyTests-797137213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e2a6862-0253-4e9d-8b10-85258cdb23f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:20:04 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-74de3ec5-f1b4-4333-9da9-c81c9e410526 tempest-SnapshotDependencyTests-797137213 None] Flow 'volume_create_manager' (92281a8b-1878-41a0-b6c1-b083539d32d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:20:04 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-c6e64043-68b7-4434-8f5c-c22cb37903e9 tempest-VolumeDependencyTests-1052055728 None] Lock "cinder-quobyte-9c018ce6-b114-4814-98e4-4a13612f79b8" acquired by "_copy_volume_from_snapshot" :: waited 0.056s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:20:04 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-c6e64043-68b7-4434-8f5c-c22cb37903e9 tempest-VolumeDependencyTests-1052055728 None] snapshot: bc0ca10d-6198-4514-86c2-f56b6ab7dcf1, volume: 9c018ce6-b114-4814-98e4-4a13612f79b8,  {{(pid=83345) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 10 13:20:04 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-74de3ec5-f1b4-4333-9da9-c81c9e410526 tempest-SnapshotDependencyTests-797137213 None] Created volume successfully.
Apr 10 13:20:04 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-eea82539-3d51-4302-b8c9-51dd618c38dc tempest-CreateVolumesFromSnapshotTest-1784307287 None] Acquiring lock "cinder-1d51372a-ead7-45c9-8ee1-7a28ab8d1e9d-delete_volume" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:20:04 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-2a30e83d-0a63-4e20-b5f8-06bd032dc24c tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0376ae5-6365-4563-a367-6fd0d55fabb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:20:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-341492958',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ed9cc08-88fa-43c1-98dc-39e577c29bed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='521367798dea42daa421e9d13e571519',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:20:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:20:04Z,use_quota=True,user_id='73b1138ddd354343ae538b7a065f87cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:20:04 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-2a30e83d-0a63-4e20-b5f8-06bd032dc24c tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a71a346c-01ce-4dcd-bafd-eb4674c27f49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:20:04 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-2a30e83d-0a63-4e20-b5f8-06bd032dc24c tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a71a346c-01ce-4dcd-bafd-eb4674c27f49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:20:04 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-2a30e83d-0a63-4e20-b5f8-06bd032dc24c tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88639208-b68c-406b-a365-79efc4a34f59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:20:04 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-2a30e83d-0a63-4e20-b5f8-06bd032dc24c tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88639208-b68c-406b-a365-79efc4a34f59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ed9cc08-88fa-43c1-98dc-39e577c29bed', 'volume_name': 'volume-6ed9cc08-88fa-43c1-98dc-39e577c29bed', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:20:04 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-2a30e83d-0a63-4e20-b5f8-06bd032dc24c tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f73c42d-c74f-41f6-bab9-46846971fe56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:20:04 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-2a30e83d-0a63-4e20-b5f8-06bd032dc24c tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f73c42d-c74f-41f6-bab9-46846971fe56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:20:04 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-2a30e83d-0a63-4e20-b5f8-06bd032dc24c tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a84c1948-c0bf-45f4-83bd-997ff540f96f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:20:04 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-2a30e83d-0a63-4e20-b5f8-06bd032dc24c tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Volume 6ed9cc08-88fa-43c1-98dc-39e577c29bed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ed9cc08-88fa-43c1-98dc-39e577c29bed', 'volume_size': 1}
Apr 10 13:20:04 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-2a30e83d-0a63-4e20-b5f8-06bd032dc24c tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:20:04 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-c6e64043-68b7-4434-8f5c-c22cb37903e9 tempest-VolumeDependencyTests-1052055728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:20:04 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-c6e64043-68b7-4434-8f5c-c22cb37903e9 tempest-VolumeDependencyTests-1052055728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:20:04 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-c6e64043-68b7-4434-8f5c-c22cb37903e9 tempest-VolumeDependencyTests-1052055728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:20:04 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-c6e64043-68b7-4434-8f5c-c22cb37903e9 tempest-VolumeDependencyTests-1052055728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:20:04 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-c6e64043-68b7-4434-8f5c-c22cb37903e9 tempest-VolumeDependencyTests-1052055728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:20:04 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7855855-4749-4a9d-a99b-b6c746486542]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:20:04 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-c6e64043-68b7-4434-8f5c-c22cb37903e9 tempest-VolumeDependencyTests-1052055728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-51731cea-d883-4a30-a10a-53c990e379c4.bc0ca10d-6198-4514-86c2-f56b6ab7dcf1 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:04 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-eea82539-3d51-4302-b8c9-51dd618c38dc tempest-CreateVolumesFromSnapshotTest-1784307287 None] Lock "cinder-1d51372a-ead7-45c9-8ee1-7a28ab8d1e9d-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:20:04 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-eea82539-3d51-4302-b8c9-51dd618c38dc tempest-CreateVolumesFromSnapshotTest-1784307287 None] Acquiring lock "cinder-quobyte-1d51372a-ead7-45c9-8ee1-7a28ab8d1e9d" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:20:04 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-eea82539-3d51-4302-b8c9-51dd618c38dc tempest-CreateVolumesFromSnapshotTest-1784307287 None] Lock "cinder-quobyte-1d51372a-ead7-45c9-8ee1-7a28ab8d1e9d" acquired by "delete_volume" :: waited 0.007s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:20:04 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4bc5c7a-d579-4f88-9c1c-2c8b0d2a99a3]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:20:04 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-eea82539-3d51-4302-b8c9-51dd618c38dc tempest-CreateVolumesFromSnapshotTest-1784307287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-1d51372a-ead7-45c9-8ee1-7a28ab8d1e9d {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:04 devstack sudo[90969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-51731cea-d883-4a30-a10a-53c990e379c4.bc0ca10d-6198-4514-86c2-f56b6ab7dcf1
Apr 10 13:20:04 devstack sudo[90969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:04 devstack sudo[90970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-1d51372a-ead7-45c9-8ee1-7a28ab8d1e9d
Apr 10 13:20:04 devstack sudo[90970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:04 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-9efa3d2f-d800-4bf4-9705-d0d820197f21 tempest-SnapshotDependencyTests-797137213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:20:04 devstack sudo[90969]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:04 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-c6e64043-68b7-4434-8f5c-c22cb37903e9 tempest-VolumeDependencyTests-1052055728 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-51731cea-d883-4a30-a10a-53c990e379c4.bc0ca10d-6198-4514-86c2-f56b6ab7dcf1" returned: 0 in 0.530s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:04 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-c6e64043-68b7-4434-8f5c-c22cb37903e9 tempest-VolumeDependencyTests-1052055728 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-51731cea-d883-4a30-a10a-53c990e379c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 13:20:04 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-c6e64043-68b7-4434-8f5c-c22cb37903e9 tempest-VolumeDependencyTests-1052055728 None] will copy from snapshot at /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-51731cea-d883-4a30-a10a-53c990e379c4 {{(pid=83345) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 10 13:20:04 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-c6e64043-68b7-4434-8f5c-c22cb37903e9 tempest-VolumeDependencyTests-1052055728 None] Creating direct copy from snapshot {{(pid=83345) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 10 13:20:04 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[20903ca6-86f6-4cdd-8bda-dd77ce31fcea]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:20:04 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-c6e64043-68b7-4434-8f5c-c22cb37903e9 tempest-VolumeDependencyTests-1052055728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-51731cea-d883-4a30-a10a-53c990e379c4 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:04 devstack sudo[90970]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:04 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-eea82539-3d51-4302-b8c9-51dd618c38dc tempest-CreateVolumesFromSnapshotTest-1784307287 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-1d51372a-ead7-45c9-8ee1-7a28ab8d1e9d" returned: 0 in 0.509s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:04 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-eea82539-3d51-4302-b8c9-51dd618c38dc tempest-CreateVolumesFromSnapshotTest-1784307287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-1d51372a-ead7-45c9-8ee1-7a28ab8d1e9d {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:04 devstack sudo[90980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-1d51372a-ead7-45c9-8ee1-7a28ab8d1e9d
Apr 10 13:20:04 devstack sudo[90980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:04 devstack sudo[90979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-51731cea-d883-4a30-a10a-53c990e379c4
Apr 10 13:20:04 devstack sudo[90979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:05 devstack sudo[90979]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:05 devstack sudo[90980]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:05 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-c6e64043-68b7-4434-8f5c-c22cb37903e9 tempest-VolumeDependencyTests-1052055728 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-51731cea-d883-4a30-a10a-53c990e379c4" returned: 0 in 0.455s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:05 devstack cinder-volume[83345]: DEBUG cinder.utils [None req-c6e64043-68b7-4434-8f5c-c22cb37903e9 tempest-VolumeDependencyTests-1052055728 None] Path /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-9c018ce6-b114-4814-98e4-4a13612f79b8 not found in is_blk_device check {{(pid=83345) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 10 13:20:05 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-c6e64043-68b7-4434-8f5c-c22cb37903e9 tempest-VolumeDependencyTests-1052055728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-51731cea-d883-4a30-a10a-53c990e379c4 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-9c018ce6-b114-4814-98e4-4a13612f79b8 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:05 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-eea82539-3d51-4302-b8c9-51dd618c38dc tempest-CreateVolumesFromSnapshotTest-1784307287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-1d51372a-ead7-45c9-8ee1-7a28ab8d1e9d" returned: 0 in 0.433s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:05 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-eea82539-3d51-4302-b8c9-51dd618c38dc tempest-CreateVolumesFromSnapshotTest-1784307287 None] Lock "cinder-quobyte-1d51372a-ead7-45c9-8ee1-7a28ab8d1e9d" released by "delete_volume" :: held 0.969s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:20:05 devstack sudo[90987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-51731cea-d883-4a30-a10a-53c990e379c4 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-9c018ce6-b114-4814-98e4-4a13612f79b8
Apr 10 13:20:05 devstack sudo[90987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:05 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-eea82539-3d51-4302-b8c9-51dd618c38dc tempest-CreateVolumesFromSnapshotTest-1784307287 None] Created reservations ['d03a8e0d-c705-49cf-8f0f-56f470e98365', 'ab26ca1c-1ba1-4caa-9093-dab44ab71b53', '7a00490d-aa52-428e-ba7d-968dfe6826ae', '0ed9632a-bdf0-4445-b575-1cd093c2b020'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:20:05 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-eea82539-3d51-4302-b8c9-51dd618c38dc tempest-CreateVolumesFromSnapshotTest-1784307287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:20:05 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-eea82539-3d51-4302-b8c9-51dd618c38dc tempest-CreateVolumesFromSnapshotTest-1784307287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:20:05 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-eea82539-3d51-4302-b8c9-51dd618c38dc tempest-CreateVolumesFromSnapshotTest-1784307287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:20:05 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-eea82539-3d51-4302-b8c9-51dd618c38dc tempest-CreateVolumesFromSnapshotTest-1784307287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:20:05 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-eea82539-3d51-4302-b8c9-51dd618c38dc tempest-CreateVolumesFromSnapshotTest-1784307287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:20:05 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-eea82539-3d51-4302-b8c9-51dd618c38dc tempest-CreateVolumesFromSnapshotTest-1784307287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:05 devstack sudo[90989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:20:05 devstack sudo[90989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:05 devstack sudo[90989]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:05 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-eea82539-3d51-4302-b8c9-51dd618c38dc tempest-CreateVolumesFromSnapshotTest-1784307287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.516s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:05 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-eea82539-3d51-4302-b8c9-51dd618c38dc tempest-CreateVolumesFromSnapshotTest-1784307287 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:20:05 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-eea82539-3d51-4302-b8c9-51dd618c38dc tempest-CreateVolumesFromSnapshotTest-1784307287 None] Deleted volume successfully.
Apr 10 13:20:06 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-eea82539-3d51-4302-b8c9-51dd618c38dc tempest-CreateVolumesFromSnapshotTest-1784307287 None] Lock "cinder-1d51372a-ead7-45c9-8ee1-7a28ab8d1e9d-delete_volume" released by "delete_volume" :: held 1.695s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:20:06 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-30e6aea6-e0b4-481e-823d-8c64be881f4d tempest-CreateVolumesFromSnapshotTest-1784307287 None] Acquiring lock "cinder-2b9cbc12-e90f-4320-b23e-cc5516c1a2b2-delete_volume" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:20:06 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-30e6aea6-e0b4-481e-823d-8c64be881f4d tempest-CreateVolumesFromSnapshotTest-1784307287 None] Lock "cinder-2b9cbc12-e90f-4320-b23e-cc5516c1a2b2-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:20:06 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-30e6aea6-e0b4-481e-823d-8c64be881f4d tempest-CreateVolumesFromSnapshotTest-1784307287 None] Acquiring lock "cinder-quobyte-2b9cbc12-e90f-4320-b23e-cc5516c1a2b2" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:20:06 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-30e6aea6-e0b4-481e-823d-8c64be881f4d tempest-CreateVolumesFromSnapshotTest-1784307287 None] Lock "cinder-quobyte-2b9cbc12-e90f-4320-b23e-cc5516c1a2b2" acquired by "delete_volume" :: waited 0.019s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:20:06 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[99d58e96-332e-44e3-acd1-851d5aacfd86]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:20:06 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-30e6aea6-e0b4-481e-823d-8c64be881f4d tempest-CreateVolumesFromSnapshotTest-1784307287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-2b9cbc12-e90f-4320-b23e-cc5516c1a2b2 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:06 devstack sudo[91002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-2b9cbc12-e90f-4320-b23e-cc5516c1a2b2
Apr 10 13:20:06 devstack sudo[91002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:07 devstack sudo[90987]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:07 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-c6e64043-68b7-4434-8f5c-c22cb37903e9 tempest-VolumeDependencyTests-1052055728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-51731cea-d883-4a30-a10a-53c990e379c4 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-9c018ce6-b114-4814-98e4-4a13612f79b8" returned: 0 in 2.109s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:07 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[703faa9f-5d19-471d-b426-9e8968bcdd95]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:20:07 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-c6e64043-68b7-4434-8f5c-c22cb37903e9 tempest-VolumeDependencyTests-1052055728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-51731cea-d883-4a30-a10a-53c990e379c4 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:07 devstack sudo[91002]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:07 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-30e6aea6-e0b4-481e-823d-8c64be881f4d tempest-CreateVolumesFromSnapshotTest-1784307287 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-2b9cbc12-e90f-4320-b23e-cc5516c1a2b2" returned: 0 in 0.818s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:07 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-30e6aea6-e0b4-481e-823d-8c64be881f4d tempest-CreateVolumesFromSnapshotTest-1784307287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-2b9cbc12-e90f-4320-b23e-cc5516c1a2b2 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:07 devstack sudo[91008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-2b9cbc12-e90f-4320-b23e-cc5516c1a2b2
Apr 10 13:20:07 devstack sudo[91008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:07 devstack sudo[91007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-51731cea-d883-4a30-a10a-53c990e379c4
Apr 10 13:20:07 devstack sudo[91007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:07 devstack sudo[91008]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:07 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-30e6aea6-e0b4-481e-823d-8c64be881f4d tempest-CreateVolumesFromSnapshotTest-1784307287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-2b9cbc12-e90f-4320-b23e-cc5516c1a2b2" returned: 0 in 0.402s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:07 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-30e6aea6-e0b4-481e-823d-8c64be881f4d tempest-CreateVolumesFromSnapshotTest-1784307287 None] Lock "cinder-quobyte-2b9cbc12-e90f-4320-b23e-cc5516c1a2b2" released by "delete_volume" :: held 1.256s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:20:07 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-30e6aea6-e0b4-481e-823d-8c64be881f4d tempest-CreateVolumesFromSnapshotTest-1784307287 None] Created reservations ['f55e9673-7713-49f5-8615-6b5cfcd02bab', 'db5d666b-c60e-4a49-b0fc-7e629b004452', '8ef8851d-f3c8-4744-bbeb-cd873c9c244e', '9e8156b4-8bc3-41b0-9535-7eb55ac08f25'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:20:07 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-30e6aea6-e0b4-481e-823d-8c64be881f4d tempest-CreateVolumesFromSnapshotTest-1784307287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:20:07 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-30e6aea6-e0b4-481e-823d-8c64be881f4d tempest-CreateVolumesFromSnapshotTest-1784307287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:20:07 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-30e6aea6-e0b4-481e-823d-8c64be881f4d tempest-CreateVolumesFromSnapshotTest-1784307287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:20:07 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-30e6aea6-e0b4-481e-823d-8c64be881f4d tempest-CreateVolumesFromSnapshotTest-1784307287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:20:07 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-30e6aea6-e0b4-481e-823d-8c64be881f4d tempest-CreateVolumesFromSnapshotTest-1784307287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:20:07 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-30e6aea6-e0b4-481e-823d-8c64be881f4d tempest-CreateVolumesFromSnapshotTest-1784307287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:07 devstack sudo[91015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:20:07 devstack sudo[91015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:08 devstack sudo[91007]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:08 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-c6e64043-68b7-4434-8f5c-c22cb37903e9 tempest-VolumeDependencyTests-1052055728 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-51731cea-d883-4a30-a10a-53c990e379c4" returned: 0 in 0.585s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:08 devstack cinder-volume[83345]: DEBUG cinder.image.image_utils [None req-c6e64043-68b7-4434-8f5c-c22cb37903e9 tempest-VolumeDependencyTests-1052055728 None] Image conversion details: src /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-51731cea-d883-4a30-a10a-53c990e379c4, size 1024.00 MB, duration 2.11 sec, destination /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-9c018ce6-b114-4814-98e4-4a13612f79b8 {{(pid=83345) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 10 13:20:08 devstack cinder-volume[83345]: INFO cinder.image.image_utils [None req-c6e64043-68b7-4434-8f5c-c22cb37903e9 tempest-VolumeDependencyTests-1052055728 None] Converted 1024.00 MB image at 485.27 MB/s
Apr 10 13:20:08 devstack cinder-volume[83345]: WARNING cinder.volume.drivers.remotefs [None req-c6e64043-68b7-4434-8f5c-c22cb37903e9 tempest-VolumeDependencyTests-1052055728 None] /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-9c018ce6-b114-4814-98e4-4a13612f79b8 is being set with open permissions: ugo+rw
Apr 10 13:20:08 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-c6e64043-68b7-4434-8f5c-c22cb37903e9 tempest-VolumeDependencyTests-1052055728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-9c018ce6-b114-4814-98e4-4a13612f79b8 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:08 devstack sudo[91017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-9c018ce6-b114-4814-98e4-4a13612f79b8
Apr 10 13:20:08 devstack sudo[91017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:08 devstack sudo[91015]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:08 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-30e6aea6-e0b4-481e-823d-8c64be881f4d tempest-CreateVolumesFromSnapshotTest-1784307287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.418s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:08 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-30e6aea6-e0b4-481e-823d-8c64be881f4d tempest-CreateVolumesFromSnapshotTest-1784307287 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:20:08 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-30e6aea6-e0b4-481e-823d-8c64be881f4d tempest-CreateVolumesFromSnapshotTest-1784307287 None] Deleted volume successfully.
Apr 10 13:20:08 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-30e6aea6-e0b4-481e-823d-8c64be881f4d tempest-CreateVolumesFromSnapshotTest-1784307287 None] Lock "cinder-2b9cbc12-e90f-4320-b23e-cc5516c1a2b2-delete_volume" released by "delete_volume" :: held 1.840s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:20:08 devstack sudo[91017]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:08 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-c6e64043-68b7-4434-8f5c-c22cb37903e9 tempest-VolumeDependencyTests-1052055728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-9c018ce6-b114-4814-98e4-4a13612f79b8" returned: 0 in 0.418s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:08 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-c6e64043-68b7-4434-8f5c-c22cb37903e9 tempest-VolumeDependencyTests-1052055728 None] Lock "cinder-quobyte-9c018ce6-b114-4814-98e4-4a13612f79b8" released by "_copy_volume_from_snapshot" :: held 4.204s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:20:08 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-c6e64043-68b7-4434-8f5c-c22cb37903e9 tempest-VolumeDependencyTests-1052055728 None] Lock "cinder-quobyte-bc0ca10d-6198-4514-86c2-f56b6ab7dcf1-9c018ce6-b114-4814-98e4-4a13612f79b8" released by "_create_volume_from_snapshot" :: held 4.268s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:20:08 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-c6e64043-68b7-4434-8f5c-c22cb37903e9 tempest-VolumeDependencyTests-1052055728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.296s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:20:08 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-2a30e83d-0a63-4e20-b5f8-06bd032dc24c tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.159s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:20:08 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-2a30e83d-0a63-4e20-b5f8-06bd032dc24c tempest-CreateVolumesFromSourceVolumeTest-218806783 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f252bf08b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:20:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-341492958',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ed9cc08-88fa-43c1-98dc-39e577c29bed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='521367798dea42daa421e9d13e571519',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:20:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:20:04Z,use_quota=True,user_id='73b1138ddd354343ae538b7a065f87cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)}" {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 13:20:08 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-2a30e83d-0a63-4e20-b5f8-06bd032dc24c tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Creating volume 6ed9cc08-88fa-43c1-98dc-39e577c29bed {{(pid=83345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 13:20:08 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-2a30e83d-0a63-4e20-b5f8-06bd032dc24c tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:20:08 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-2a30e83d-0a63-4e20-b5f8-06bd032dc24c tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:20:08 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-2a30e83d-0a63-4e20-b5f8-06bd032dc24c tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:20:08 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-2a30e83d-0a63-4e20-b5f8-06bd032dc24c tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:20:08 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-2a30e83d-0a63-4e20-b5f8-06bd032dc24c tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:20:08 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-2a30e83d-0a63-4e20-b5f8-06bd032dc24c tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:20:08 devstack cinder-volume[83345]: INFO cinder.volume.drivers.remotefs [None req-2a30e83d-0a63-4e20-b5f8-06bd032dc24c tempest-CreateVolumesFromSourceVolumeTest-218806783 None] casted to osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331
Apr 10 13:20:08 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-2a30e83d-0a63-4e20-b5f8-06bd032dc24c tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-6ed9cc08-88fa-43c1-98dc-39e577c29bed 1073741824 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:08 devstack sudo[91021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-6ed9cc08-88fa-43c1-98dc-39e577c29bed 1073741824
Apr 10 13:20:08 devstack sudo[91021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:08 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-c6e64043-68b7-4434-8f5c-c22cb37903e9 tempest-VolumeDependencyTests-1052055728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdfcb7a6-2a36-4000-99c7-5ee532ebbf6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c018ce6-b114-4814-98e4-4a13612f79b8', 'volume_size': 1, 'snapshot_id': 'bc0ca10d-6198-4514-86c2-f56b6ab7dcf1'}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:20:08 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-c6e64043-68b7-4434-8f5c-c22cb37903e9 tempest-VolumeDependencyTests-1052055728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9002590-9334-45fc-9121-67f99782ded6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:20:08 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-c6e64043-68b7-4434-8f5c-c22cb37903e9 tempest-VolumeDependencyTests-1052055728 None] Volume volume-9c018ce6-b114-4814-98e4-4a13612f79b8 (9c018ce6-b114-4814-98e4-4a13612f79b8): created successfully
Apr 10 13:20:08 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-c6e64043-68b7-4434-8f5c-c22cb37903e9 tempest-VolumeDependencyTests-1052055728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9002590-9334-45fc-9121-67f99782ded6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:20:08 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-c6e64043-68b7-4434-8f5c-c22cb37903e9 tempest-VolumeDependencyTests-1052055728 None] Flow 'volume_create_manager' (add81b5e-b1f3-4c49-8d60-9a90722b8147) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:20:08 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-c6e64043-68b7-4434-8f5c-c22cb37903e9 tempest-VolumeDependencyTests-1052055728 None] Created volume successfully.
Apr 10 13:20:08 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-8619df99-2290-420f-8ef2-dad3129d4f06 tempest-CreateVolumesFromSnapshotTest-1784307287 None] Acquiring lock "cinder-384950bf-fdaa-4b43-8bbf-231096f646f7-delete_volume" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:20:08 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-8619df99-2290-420f-8ef2-dad3129d4f06 tempest-CreateVolumesFromSnapshotTest-1784307287 None] Lock "cinder-384950bf-fdaa-4b43-8bbf-231096f646f7-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:20:08 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-8619df99-2290-420f-8ef2-dad3129d4f06 tempest-CreateVolumesFromSnapshotTest-1784307287 None] Acquiring lock "cinder-quobyte-384950bf-fdaa-4b43-8bbf-231096f646f7" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:20:08 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-8619df99-2290-420f-8ef2-dad3129d4f06 tempest-CreateVolumesFromSnapshotTest-1784307287 None] Lock "cinder-quobyte-384950bf-fdaa-4b43-8bbf-231096f646f7" acquired by "delete_volume" :: waited 0.012s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:20:08 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c2b4e7f-f68a-4abc-8315-63eba540737b]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:20:08 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-8619df99-2290-420f-8ef2-dad3129d4f06 tempest-CreateVolumesFromSnapshotTest-1784307287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-384950bf-fdaa-4b43-8bbf-231096f646f7 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:08 devstack sudo[91021]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:08 devstack sudo[91026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-384950bf-fdaa-4b43-8bbf-231096f646f7
Apr 10 13:20:08 devstack sudo[91026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:08 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-2a30e83d-0a63-4e20-b5f8-06bd032dc24c tempest-CreateVolumesFromSourceVolumeTest-218806783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-6ed9cc08-88fa-43c1-98dc-39e577c29bed 1073741824" returned: 0 in 0.519s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:09 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-2a30e83d-0a63-4e20-b5f8-06bd032dc24c tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-6ed9cc08-88fa-43c1-98dc-39e577c29bed {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:09 devstack sudo[91028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-6ed9cc08-88fa-43c1-98dc-39e577c29bed
Apr 10 13:20:09 devstack sudo[91028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:09 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-93e36791-b634-4cdc-bbc3-7443fb534d89 tempest-VolumeDependencyTests-1052055728 None] Acquiring lock "cinder-bc0ca10d-6198-4514-86c2-f56b6ab7dcf1-delete_snapshot" by "delete_snapshot" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:20:09 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-93e36791-b634-4cdc-bbc3-7443fb534d89 tempest-VolumeDependencyTests-1052055728 None] Lock "cinder-bc0ca10d-6198-4514-86c2-f56b6ab7dcf1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:20:09 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-93e36791-b634-4cdc-bbc3-7443fb534d89 tempest-VolumeDependencyTests-1052055728 None] Acquiring lock "cinder-quobyte-51731cea-d883-4a30-a10a-53c990e379c4" by "delete_snapshot" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:20:09 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-93e36791-b634-4cdc-bbc3-7443fb534d89 tempest-VolumeDependencyTests-1052055728 None] Lock "cinder-quobyte-51731cea-d883-4a30-a10a-53c990e379c4" acquired by "delete_snapshot" :: waited 0.006s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:20:09 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-93e36791-b634-4cdc-bbc3-7443fb534d89 tempest-VolumeDependencyTests-1052055728 None] Acquiring lock "cinder-quobyte-bc0ca10d-6198-4514-86c2-f56b6ab7dcf1" by "_delete_snapshot" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:20:09 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-93e36791-b634-4cdc-bbc3-7443fb534d89 tempest-VolumeDependencyTests-1052055728 None] Lock "cinder-quobyte-bc0ca10d-6198-4514-86c2-f56b6ab7dcf1" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:20:09 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-93e36791-b634-4cdc-bbc3-7443fb534d89 tempest-VolumeDependencyTests-1052055728 None] Deleting offline snapshot bc0ca10d-6198-4514-86c2-f56b6ab7dcf1 of volume 51731cea-d883-4a30-a10a-53c990e379c4 {{(pid=83345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 10 13:20:09 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-93e36791-b634-4cdc-bbc3-7443fb534d89 tempest-VolumeDependencyTests-1052055728 None] snapshot_file for this snap is: volume-51731cea-d883-4a30-a10a-53c990e379c4.bc0ca10d-6198-4514-86c2-f56b6ab7dcf1 {{(pid=83345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 10 13:20:09 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2e3f204-8174-432b-804a-7bbb80789e1d]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:20:09 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-93e36791-b634-4cdc-bbc3-7443fb534d89 tempest-VolumeDependencyTests-1052055728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-51731cea-d883-4a30-a10a-53c990e379c4.bc0ca10d-6198-4514-86c2-f56b6ab7dcf1 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:09 devstack sudo[91031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-51731cea-d883-4a30-a10a-53c990e379c4.bc0ca10d-6198-4514-86c2-f56b6ab7dcf1
Apr 10 13:20:09 devstack sudo[91031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:09 devstack sudo[91026]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:09 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-8619df99-2290-420f-8ef2-dad3129d4f06 tempest-CreateVolumesFromSnapshotTest-1784307287 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-384950bf-fdaa-4b43-8bbf-231096f646f7" returned: 0 in 0.491s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:09 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-8619df99-2290-420f-8ef2-dad3129d4f06 tempest-CreateVolumesFromSnapshotTest-1784307287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-384950bf-fdaa-4b43-8bbf-231096f646f7 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:09 devstack sudo[91036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-384950bf-fdaa-4b43-8bbf-231096f646f7
Apr 10 13:20:09 devstack sudo[91036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:09 devstack sudo[91028]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:09 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-2a30e83d-0a63-4e20-b5f8-06bd032dc24c tempest-CreateVolumesFromSourceVolumeTest-218806783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-6ed9cc08-88fa-43c1-98dc-39e577c29bed" returned: 0 in 0.440s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:09 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-2a30e83d-0a63-4e20-b5f8-06bd032dc24c tempest-CreateVolumesFromSourceVolumeTest-218806783 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'} {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 13:20:09 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-2a30e83d-0a63-4e20-b5f8-06bd032dc24c tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.987s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:20:09 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-9efa3d2f-d800-4bf4-9705-d0d820197f21 tempest-SnapshotDependencyTests-797137213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.772s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:20:09 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-2a30e83d-0a63-4e20-b5f8-06bd032dc24c tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a84c1948-c0bf-45f4-83bd-997ff540f96f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ed9cc08-88fa-43c1-98dc-39e577c29bed', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:20:09 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-2a30e83d-0a63-4e20-b5f8-06bd032dc24c tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95f62f41-e91d-49a0-8b7a-2179e8fa0be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:20:09 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-9efa3d2f-d800-4bf4-9705-d0d820197f21 tempest-SnapshotDependencyTests-797137213 None] Creating offline snapshot 6922111d-0450-4d51-9371-e876e978d866 of volume 591f6681-dd5b-457f-8c20-9bb6ef7fe4f9 {{(pid=83345) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 10 13:20:09 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-2a30e83d-0a63-4e20-b5f8-06bd032dc24c tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Volume volume-6ed9cc08-88fa-43c1-98dc-39e577c29bed (6ed9cc08-88fa-43c1-98dc-39e577c29bed): created successfully
Apr 10 13:20:09 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-2a30e83d-0a63-4e20-b5f8-06bd032dc24c tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95f62f41-e91d-49a0-8b7a-2179e8fa0be5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:20:09 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-2a30e83d-0a63-4e20-b5f8-06bd032dc24c tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Flow 'volume_create_manager' (41a99116-f484-474e-86c3-17eca2734483) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:20:09 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[c962b717-4dd4-4689-b14f-ac39884bb6f7]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:20:09 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-9efa3d2f-d800-4bf4-9705-d0d820197f21 tempest-SnapshotDependencyTests-797137213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-591f6681-dd5b-457f-8c20-9bb6ef7fe4f9 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:09 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-2a30e83d-0a63-4e20-b5f8-06bd032dc24c tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Created volume successfully.
Apr 10 13:20:09 devstack sudo[91038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-591f6681-dd5b-457f-8c20-9bb6ef7fe4f9
Apr 10 13:20:09 devstack sudo[91038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:09 devstack sudo[91031]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:09 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-93e36791-b634-4cdc-bbc3-7443fb534d89 tempest-VolumeDependencyTests-1052055728 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-51731cea-d883-4a30-a10a-53c990e379c4.bc0ca10d-6198-4514-86c2-f56b6ab7dcf1" returned: 0 in 0.488s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:09 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-93e36791-b634-4cdc-bbc3-7443fb534d89 tempest-VolumeDependencyTests-1052055728 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-51731cea-d883-4a30-a10a-53c990e379c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 13:20:09 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eb4abef-d920-41a9-8fe1-e0eb6e9382b7]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:20:09 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-93e36791-b634-4cdc-bbc3-7443fb534d89 tempest-VolumeDependencyTests-1052055728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-51731cea-d883-4a30-a10a-53c990e379c4 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:09 devstack sudo[91036]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:09 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-8619df99-2290-420f-8ef2-dad3129d4f06 tempest-CreateVolumesFromSnapshotTest-1784307287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-384950bf-fdaa-4b43-8bbf-231096f646f7" returned: 0 in 0.414s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:09 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-8619df99-2290-420f-8ef2-dad3129d4f06 tempest-CreateVolumesFromSnapshotTest-1784307287 None] Lock "cinder-quobyte-384950bf-fdaa-4b43-8bbf-231096f646f7" released by "delete_volume" :: held 0.941s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:20:09 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-8619df99-2290-420f-8ef2-dad3129d4f06 tempest-CreateVolumesFromSnapshotTest-1784307287 None] Created reservations ['449bef14-e803-47d2-8398-f39a55b196a4', '979b89cb-c84c-45a3-88fb-c2cc89ac44d7', '395ca796-99c3-42f1-a440-3a659daf584f', 'caf31c5d-8cec-4317-804e-ef105f6d832d'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:20:09 devstack sudo[91044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-51731cea-d883-4a30-a10a-53c990e379c4
Apr 10 13:20:09 devstack sudo[91044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:09 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-8619df99-2290-420f-8ef2-dad3129d4f06 tempest-CreateVolumesFromSnapshotTest-1784307287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:20:09 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-8619df99-2290-420f-8ef2-dad3129d4f06 tempest-CreateVolumesFromSnapshotTest-1784307287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:20:09 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-8619df99-2290-420f-8ef2-dad3129d4f06 tempest-CreateVolumesFromSnapshotTest-1784307287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:20:09 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-8619df99-2290-420f-8ef2-dad3129d4f06 tempest-CreateVolumesFromSnapshotTest-1784307287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:20:09 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-8619df99-2290-420f-8ef2-dad3129d4f06 tempest-CreateVolumesFromSnapshotTest-1784307287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:20:09 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-8619df99-2290-420f-8ef2-dad3129d4f06 tempest-CreateVolumesFromSnapshotTest-1784307287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:09 devstack sudo[91049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:20:09 devstack sudo[91049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:09 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-00e7538a-9430-4870-a5d2-53eaaa6e3a2f tempest-CreateVolumesFromSnapshotTest-1784307287 None] Acquiring lock "cinder-4f2f63fa-9bbd-4196-bdbe-aac49a2382b6-delete_volume" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:20:09 devstack sudo[91038]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:10 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-9efa3d2f-d800-4bf4-9705-d0d820197f21 tempest-SnapshotDependencyTests-797137213 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-591f6681-dd5b-457f-8c20-9bb6ef7fe4f9" returned: 0 in 0.502s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:10 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-9efa3d2f-d800-4bf4-9705-d0d820197f21 tempest-SnapshotDependencyTests-797137213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-591f6681-dd5b-457f-8c20-9bb6ef7fe4f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-591f6681-dd5b-457f-8c20-9bb6ef7fe4f9.6922111d-0450-4d51-9371-e876e978d866 1G {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:10 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-00e7538a-9430-4870-a5d2-53eaaa6e3a2f tempest-CreateVolumesFromSnapshotTest-1784307287 None] Lock "cinder-4f2f63fa-9bbd-4196-bdbe-aac49a2382b6-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:20:10 devstack sudo[91051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-591f6681-dd5b-457f-8c20-9bb6ef7fe4f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-591f6681-dd5b-457f-8c20-9bb6ef7fe4f9.6922111d-0450-4d51-9371-e876e978d866 1G
Apr 10 13:20:10 devstack sudo[91051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:10 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-00e7538a-9430-4870-a5d2-53eaaa6e3a2f tempest-CreateVolumesFromSnapshotTest-1784307287 None] Acquiring lock "cinder-quobyte-4f2f63fa-9bbd-4196-bdbe-aac49a2382b6" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:20:10 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-00e7538a-9430-4870-a5d2-53eaaa6e3a2f tempest-CreateVolumesFromSnapshotTest-1784307287 None] Lock "cinder-quobyte-4f2f63fa-9bbd-4196-bdbe-aac49a2382b6" acquired by "delete_volume" :: waited 0.009s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:20:10 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c601bd8-a295-426d-ba05-a712e6f99c84]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:20:10 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-00e7538a-9430-4870-a5d2-53eaaa6e3a2f tempest-CreateVolumesFromSnapshotTest-1784307287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f2f63fa-9bbd-4196-bdbe-aac49a2382b6 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:10 devstack sudo[91053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f2f63fa-9bbd-4196-bdbe-aac49a2382b6
Apr 10 13:20:10 devstack sudo[91053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:10 devstack sudo[91044]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:10 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-93e36791-b634-4cdc-bbc3-7443fb534d89 tempest-VolumeDependencyTests-1052055728 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-51731cea-d883-4a30-a10a-53c990e379c4" returned: 0 in 0.502s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:10 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-93e36791-b634-4cdc-bbc3-7443fb534d89 tempest-VolumeDependencyTests-1052055728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-51731cea-d883-4a30-a10a-53c990e379c4.bc0ca10d-6198-4514-86c2-f56b6ab7dcf1 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:10 devstack sudo[91059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-51731cea-d883-4a30-a10a-53c990e379c4.bc0ca10d-6198-4514-86c2-f56b6ab7dcf1
Apr 10 13:20:10 devstack sudo[91059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:10 devstack sudo[91049]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:10 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-8619df99-2290-420f-8ef2-dad3129d4f06 tempest-CreateVolumesFromSnapshotTest-1784307287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.479s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:10 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-8619df99-2290-420f-8ef2-dad3129d4f06 tempest-CreateVolumesFromSnapshotTest-1784307287 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:20:10 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-8619df99-2290-420f-8ef2-dad3129d4f06 tempest-CreateVolumesFromSnapshotTest-1784307287 None] Deleted volume successfully.
Apr 10 13:20:10 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-8619df99-2290-420f-8ef2-dad3129d4f06 tempest-CreateVolumesFromSnapshotTest-1784307287 None] Lock "cinder-384950bf-fdaa-4b43-8bbf-231096f646f7-delete_volume" released by "delete_volume" :: held 1.595s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:20:10 devstack sudo[91051]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:10 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-9efa3d2f-d800-4bf4-9705-d0d820197f21 tempest-SnapshotDependencyTests-797137213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-591f6681-dd5b-457f-8c20-9bb6ef7fe4f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-591f6681-dd5b-457f-8c20-9bb6ef7fe4f9.6922111d-0450-4d51-9371-e876e978d866 1G" returned: 0 in 0.547s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:10 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-9efa3d2f-d800-4bf4-9705-d0d820197f21 tempest-SnapshotDependencyTests-797137213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-591f6681-dd5b-457f-8c20-9bb6ef7fe4f9 -F qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-591f6681-dd5b-457f-8c20-9bb6ef7fe4f9.6922111d-0450-4d51-9371-e876e978d866 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:10 devstack sudo[91067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-591f6681-dd5b-457f-8c20-9bb6ef7fe4f9 -F qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-591f6681-dd5b-457f-8c20-9bb6ef7fe4f9.6922111d-0450-4d51-9371-e876e978d866
Apr 10 13:20:10 devstack sudo[91067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:10 devstack sudo[91053]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:10 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-00e7538a-9430-4870-a5d2-53eaaa6e3a2f tempest-CreateVolumesFromSnapshotTest-1784307287 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f2f63fa-9bbd-4196-bdbe-aac49a2382b6" returned: 0 in 0.569s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:10 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-00e7538a-9430-4870-a5d2-53eaaa6e3a2f tempest-CreateVolumesFromSnapshotTest-1784307287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f2f63fa-9bbd-4196-bdbe-aac49a2382b6 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:10 devstack sudo[91069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f2f63fa-9bbd-4196-bdbe-aac49a2382b6
Apr 10 13:20:10 devstack sudo[91069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:10 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-87816e19-9697-4526-ae88-7e9bc7e4ff26 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:20:10 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-87816e19-9697-4526-ae88-7e9bc7e4ff26 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Flow 'volume_create_manager' (69de324c-5e15-4190-bc51-0b30b28697ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:20:10 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-87816e19-9697-4526-ae88-7e9bc7e4ff26 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f1212ff-62f8-4d22-911d-9d5d77cd9341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:20:10 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-87816e19-9697-4526-ae88-7e9bc7e4ff26 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f1212ff-62f8-4d22-911d-9d5d77cd9341) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:20:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-469019787',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=288a4151-f9a5-484b-8dc0-478dcc49e642,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='521367798dea42daa421e9d13e571519',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:20:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:20:11Z,use_quota=True,user_id='73b1138ddd354343ae538b7a065f87cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:20:10 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-87816e19-9697-4526-ae88-7e9bc7e4ff26 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcbbfd00-ecd7-4bb9-8cdf-972dd5654abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:20:10 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-87816e19-9697-4526-ae88-7e9bc7e4ff26 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcbbfd00-ecd7-4bb9-8cdf-972dd5654abe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:20:10 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-87816e19-9697-4526-ae88-7e9bc7e4ff26 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a064909-795b-42f0-b1a3-3a5f1b9fa655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:20:10 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-87816e19-9697-4526-ae88-7e9bc7e4ff26 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a064909-795b-42f0-b1a3-3a5f1b9fa655) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '288a4151-f9a5-484b-8dc0-478dcc49e642', 'volume_name': 'volume-288a4151-f9a5-484b-8dc0-478dcc49e642', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:20:10 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-87816e19-9697-4526-ae88-7e9bc7e4ff26 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5287fbb0-3de9-4963-ba9e-76208d05b733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:20:10 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-87816e19-9697-4526-ae88-7e9bc7e4ff26 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5287fbb0-3de9-4963-ba9e-76208d05b733) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:20:10 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-87816e19-9697-4526-ae88-7e9bc7e4ff26 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3601be4-30a7-4283-87dc-b0cf7721c640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:20:10 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-87816e19-9697-4526-ae88-7e9bc7e4ff26 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Volume 288a4151-f9a5-484b-8dc0-478dcc49e642: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-288a4151-f9a5-484b-8dc0-478dcc49e642', 'volume_size': 1}
Apr 10 13:20:10 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-87816e19-9697-4526-ae88-7e9bc7e4ff26 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:20:10 devstack sudo[91059]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:10 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-93e36791-b634-4cdc-bbc3-7443fb534d89 tempest-VolumeDependencyTests-1052055728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-51731cea-d883-4a30-a10a-53c990e379c4.bc0ca10d-6198-4514-86c2-f56b6ab7dcf1" returned: 0 in 0.677s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:10 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-93e36791-b634-4cdc-bbc3-7443fb534d89 tempest-VolumeDependencyTests-1052055728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-51731cea-d883-4a30-a10a-53c990e379c4.bc0ca10d-6198-4514-86c2-f56b6ab7dcf1 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:11 devstack sudo[91078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-51731cea-d883-4a30-a10a-53c990e379c4.bc0ca10d-6198-4514-86c2-f56b6ab7dcf1
Apr 10 13:20:11 devstack sudo[91078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:11 devstack sudo[91067]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:11 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-9efa3d2f-d800-4bf4-9705-d0d820197f21 tempest-SnapshotDependencyTests-797137213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-591f6681-dd5b-457f-8c20-9bb6ef7fe4f9 -F qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-591f6681-dd5b-457f-8c20-9bb6ef7fe4f9.6922111d-0450-4d51-9371-e876e978d866" returned: 0 in 0.522s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:11 devstack cinder-volume[83345]: WARNING cinder.volume.drivers.remotefs [None req-9efa3d2f-d800-4bf4-9705-d0d820197f21 tempest-SnapshotDependencyTests-797137213 None] /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-591f6681-dd5b-457f-8c20-9bb6ef7fe4f9.6922111d-0450-4d51-9371-e876e978d866 is being set with open permissions: ugo+rw
Apr 10 13:20:11 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-9efa3d2f-d800-4bf4-9705-d0d820197f21 tempest-SnapshotDependencyTests-797137213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-591f6681-dd5b-457f-8c20-9bb6ef7fe4f9.6922111d-0450-4d51-9371-e876e978d866 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:11 devstack sudo[91080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-591f6681-dd5b-457f-8c20-9bb6ef7fe4f9.6922111d-0450-4d51-9371-e876e978d866
Apr 10 13:20:11 devstack sudo[91080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:11 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-46cab360-a00a-4abb-8681-803cabd852b9 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:20:11 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-46cab360-a00a-4abb-8681-803cabd852b9 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Flow 'volume_create_manager' (d7549125-c58e-4dfe-b4b5-2708d09fe5e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:20:11 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-46cab360-a00a-4abb-8681-803cabd852b9 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a77bacb-c7ed-4737-b0ef-7d2db8da3efd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:20:11 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-46cab360-a00a-4abb-8681-803cabd852b9 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a77bacb-c7ed-4737-b0ef-7d2db8da3efd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:20:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-147472382',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e95469fe-2dca-407e-a3b3-edbdf5ac5dfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='521367798dea42daa421e9d13e571519',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:20:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:20:11Z,use_quota=True,user_id='73b1138ddd354343ae538b7a065f87cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:20:11 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-46cab360-a00a-4abb-8681-803cabd852b9 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (925148a0-2e37-4c64-9937-eedca87ce93b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:20:11 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-46cab360-a00a-4abb-8681-803cabd852b9 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (925148a0-2e37-4c64-9937-eedca87ce93b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:20:11 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-46cab360-a00a-4abb-8681-803cabd852b9 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cff80834-d14d-43cc-9793-cd482bf9cb24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:20:11 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-46cab360-a00a-4abb-8681-803cabd852b9 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cff80834-d14d-43cc-9793-cd482bf9cb24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e95469fe-2dca-407e-a3b3-edbdf5ac5dfb', 'volume_name': 'volume-e95469fe-2dca-407e-a3b3-edbdf5ac5dfb', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:20:11 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-46cab360-a00a-4abb-8681-803cabd852b9 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f97302ba-e2ba-4dc2-9641-15ea63a1a0d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:20:11 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-46cab360-a00a-4abb-8681-803cabd852b9 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f97302ba-e2ba-4dc2-9641-15ea63a1a0d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:20:11 devstack sudo[91069]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:11 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-46cab360-a00a-4abb-8681-803cabd852b9 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff7b00c5-7017-4f0c-8280-c47b19064772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:20:11 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-46cab360-a00a-4abb-8681-803cabd852b9 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Volume e95469fe-2dca-407e-a3b3-edbdf5ac5dfb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e95469fe-2dca-407e-a3b3-edbdf5ac5dfb', 'volume_size': 1}
Apr 10 13:20:11 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-46cab360-a00a-4abb-8681-803cabd852b9 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:20:11 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-00e7538a-9430-4870-a5d2-53eaaa6e3a2f tempest-CreateVolumesFromSnapshotTest-1784307287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-4f2f63fa-9bbd-4196-bdbe-aac49a2382b6" returned: 0 in 0.596s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:11 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-00e7538a-9430-4870-a5d2-53eaaa6e3a2f tempest-CreateVolumesFromSnapshotTest-1784307287 None] Lock "cinder-quobyte-4f2f63fa-9bbd-4196-bdbe-aac49a2382b6" released by "delete_volume" :: held 1.185s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:20:11 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-00e7538a-9430-4870-a5d2-53eaaa6e3a2f tempest-CreateVolumesFromSnapshotTest-1784307287 None] Created reservations ['fd1a5d60-fbcd-405a-ac03-bb14facf3aa7', '6d299f08-8806-4e6e-a770-88f21214522f', 'b1c8c330-c429-411a-983f-84d03e4f0f1a', 'a5101af6-4e52-42b1-bf9e-49a13b443206'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:20:11 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-00e7538a-9430-4870-a5d2-53eaaa6e3a2f tempest-CreateVolumesFromSnapshotTest-1784307287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:20:11 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-00e7538a-9430-4870-a5d2-53eaaa6e3a2f tempest-CreateVolumesFromSnapshotTest-1784307287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:20:11 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-00e7538a-9430-4870-a5d2-53eaaa6e3a2f tempest-CreateVolumesFromSnapshotTest-1784307287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:20:11 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-00e7538a-9430-4870-a5d2-53eaaa6e3a2f tempest-CreateVolumesFromSnapshotTest-1784307287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:20:11 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-00e7538a-9430-4870-a5d2-53eaaa6e3a2f tempest-CreateVolumesFromSnapshotTest-1784307287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:20:11 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-00e7538a-9430-4870-a5d2-53eaaa6e3a2f tempest-CreateVolumesFromSnapshotTest-1784307287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:11 devstack sudo[91083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:20:11 devstack sudo[91083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:11 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-18b711a1-b4a9-420c-92b5-28d6d1deb123 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:20:11 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-18b711a1-b4a9-420c-92b5-28d6d1deb123 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Flow 'volume_create_manager' (205dedec-d5b3-463d-9b5a-783b1f462fdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:20:11 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-18b711a1-b4a9-420c-92b5-28d6d1deb123 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbf8d22a-7312-43a7-b2ab-0316089f1771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:20:11 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-18b711a1-b4a9-420c-92b5-28d6d1deb123 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbf8d22a-7312-43a7-b2ab-0316089f1771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:20:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1165861864',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=437e3fe8-b0d8-48f5-a19b-65adc8a52edb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='521367798dea42daa421e9d13e571519',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:20:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:20:11Z,use_quota=True,user_id='73b1138ddd354343ae538b7a065f87cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:20:11 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-18b711a1-b4a9-420c-92b5-28d6d1deb123 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63ef1f17-57cb-4e9b-9afd-590a031aa150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:20:11 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-18b711a1-b4a9-420c-92b5-28d6d1deb123 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63ef1f17-57cb-4e9b-9afd-590a031aa150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:20:11 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-18b711a1-b4a9-420c-92b5-28d6d1deb123 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3eadaee3-5603-4d94-89b1-d47ae8a6f5b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:20:11 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-18b711a1-b4a9-420c-92b5-28d6d1deb123 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3eadaee3-5603-4d94-89b1-d47ae8a6f5b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '437e3fe8-b0d8-48f5-a19b-65adc8a52edb', 'volume_name': 'volume-437e3fe8-b0d8-48f5-a19b-65adc8a52edb', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:20:11 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-18b711a1-b4a9-420c-92b5-28d6d1deb123 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad1917eb-5de9-4431-9e91-050d7328a7f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:20:11 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-18b711a1-b4a9-420c-92b5-28d6d1deb123 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad1917eb-5de9-4431-9e91-050d7328a7f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:20:11 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-18b711a1-b4a9-420c-92b5-28d6d1deb123 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3816227-6bd9-4b59-8c57-3396dd72ba60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:20:11 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-18b711a1-b4a9-420c-92b5-28d6d1deb123 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Volume 437e3fe8-b0d8-48f5-a19b-65adc8a52edb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-437e3fe8-b0d8-48f5-a19b-65adc8a52edb', 'volume_size': 1}
Apr 10 13:20:11 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-18b711a1-b4a9-420c-92b5-28d6d1deb123 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:20:11 devstack sudo[91078]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:11 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-93e36791-b634-4cdc-bbc3-7443fb534d89 tempest-VolumeDependencyTests-1052055728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-51731cea-d883-4a30-a10a-53c990e379c4.bc0ca10d-6198-4514-86c2-f56b6ab7dcf1" returned: 0 in 0.571s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:11 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-93e36791-b634-4cdc-bbc3-7443fb534d89 tempest-VolumeDependencyTests-1052055728 None] Lock "cinder-quobyte-bc0ca10d-6198-4514-86c2-f56b6ab7dcf1" released by "_delete_snapshot" :: held 2.288s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:20:11 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-93e36791-b634-4cdc-bbc3-7443fb534d89 tempest-VolumeDependencyTests-1052055728 None] Lock "cinder-quobyte-51731cea-d883-4a30-a10a-53c990e379c4" released by "delete_snapshot" :: held 2.300s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:20:11 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-93e36791-b634-4cdc-bbc3-7443fb534d89 tempest-VolumeDependencyTests-1052055728 None] Created reservations ['c1f6dd1c-8e36-4449-8f74-95d8b442782b', '2c992db5-9a9a-432d-9c56-a91c172c6254', '1d7c6a38-e8b7-4f0f-9eae-4568b0cf8eae', 'e87ba828-bf40-4c11-a610-6339c7cf8b78'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:20:11 devstack sudo[91080]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:11 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-93e36791-b634-4cdc-bbc3-7443fb534d89 tempest-VolumeDependencyTests-1052055728 None] Delete snapshot completed successfully.
Apr 10 13:20:11 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-9efa3d2f-d800-4bf4-9705-d0d820197f21 tempest-SnapshotDependencyTests-797137213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-591f6681-dd5b-457f-8c20-9bb6ef7fe4f9.6922111d-0450-4d51-9371-e876e978d866" returned: 0 in 0.634s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:11 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-93e36791-b634-4cdc-bbc3-7443fb534d89 tempest-VolumeDependencyTests-1052055728 None] Lock "cinder-bc0ca10d-6198-4514-86c2-f56b6ab7dcf1-delete_snapshot" released by "delete_snapshot" :: held 2.438s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:20:11 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1eda1dc-1645-4d9d-a805-925184a00616 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:20:11 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-e1eda1dc-1645-4d9d-a805-925184a00616 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Flow 'volume_create_manager' (7482dcee-aadb-4ea3-810d-0994170c0b25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:20:11 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-e1eda1dc-1645-4d9d-a805-925184a00616 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7b542dc-1e9c-4378-a3aa-43ce4c170058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:20:11 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-9efa3d2f-d800-4bf4-9705-d0d820197f21 tempest-SnapshotDependencyTests-797137213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-591f6681-dd5b-457f-8c20-9bb6ef7fe4f9.info {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:11 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-e1eda1dc-1645-4d9d-a805-925184a00616 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7b542dc-1e9c-4378-a3aa-43ce4c170058) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:20:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1422488954',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7919532b-9016-4e5a-b1fa-3d5c45a94cc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='521367798dea42daa421e9d13e571519',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:20:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:20:12Z,use_quota=True,user_id='73b1138ddd354343ae538b7a065f87cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:20:11 devstack sudo[91088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-591f6681-dd5b-457f-8c20-9bb6ef7fe4f9.info
Apr 10 13:20:11 devstack sudo[91088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:11 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-e1eda1dc-1645-4d9d-a805-925184a00616 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88774f07-be28-4585-b401-53b1eb13f464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:20:11 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-e1eda1dc-1645-4d9d-a805-925184a00616 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88774f07-be28-4585-b401-53b1eb13f464) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:20:11 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-e1eda1dc-1645-4d9d-a805-925184a00616 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (544124ac-740f-441b-a8ea-bba41db3060a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:20:11 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-e1eda1dc-1645-4d9d-a805-925184a00616 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (544124ac-740f-441b-a8ea-bba41db3060a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7919532b-9016-4e5a-b1fa-3d5c45a94cc7', 'volume_name': 'volume-7919532b-9016-4e5a-b1fa-3d5c45a94cc7', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:20:11 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-e1eda1dc-1645-4d9d-a805-925184a00616 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9cae8f3-8c8a-45a6-8546-257f64fbec0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:20:11 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-e1eda1dc-1645-4d9d-a805-925184a00616 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9cae8f3-8c8a-45a6-8546-257f64fbec0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:20:11 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-e1eda1dc-1645-4d9d-a805-925184a00616 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85aa40c8-1cc3-4526-adbb-5f261e2a6bbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:20:11 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-e1eda1dc-1645-4d9d-a805-925184a00616 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Volume 7919532b-9016-4e5a-b1fa-3d5c45a94cc7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7919532b-9016-4e5a-b1fa-3d5c45a94cc7', 'volume_size': 1}
Apr 10 13:20:11 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-e1eda1dc-1645-4d9d-a805-925184a00616 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:20:11 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e19cbaf-1704-4f17-ba7f-6b06414e9f3f tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:20:11 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-7e19cbaf-1704-4f17-ba7f-6b06414e9f3f tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Flow 'volume_create_manager' (ada07a3e-9044-48e4-817e-cad0cba99911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:20:11 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-7e19cbaf-1704-4f17-ba7f-6b06414e9f3f tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2bbf8bd-3deb-4829-b0b2-1ae71268b5d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:20:11 devstack sudo[91083]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:11 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-00e7538a-9430-4870-a5d2-53eaaa6e3a2f tempest-CreateVolumesFromSnapshotTest-1784307287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.545s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:11 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-00e7538a-9430-4870-a5d2-53eaaa6e3a2f tempest-CreateVolumesFromSnapshotTest-1784307287 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:20:11 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-00e7538a-9430-4870-a5d2-53eaaa6e3a2f tempest-CreateVolumesFromSnapshotTest-1784307287 None] Deleted volume successfully.
Apr 10 13:20:11 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-7e19cbaf-1704-4f17-ba7f-6b06414e9f3f tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2bbf8bd-3deb-4829-b0b2-1ae71268b5d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:20:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-613495984',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88413f28-fbec-426e-a343-0ed2e3ce0364,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='521367798dea42daa421e9d13e571519',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:20:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:20:12Z,use_quota=True,user_id='73b1138ddd354343ae538b7a065f87cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:20:11 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-7e19cbaf-1704-4f17-ba7f-6b06414e9f3f tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7b8a34e-cad9-4bab-86e9-df28926ff2ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:20:11 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-7e19cbaf-1704-4f17-ba7f-6b06414e9f3f tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7b8a34e-cad9-4bab-86e9-df28926ff2ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:20:11 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-7e19cbaf-1704-4f17-ba7f-6b06414e9f3f tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13714869-2c77-464e-abfa-ae5e0157bd59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:20:11 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-7e19cbaf-1704-4f17-ba7f-6b06414e9f3f tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13714869-2c77-464e-abfa-ae5e0157bd59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88413f28-fbec-426e-a343-0ed2e3ce0364', 'volume_name': 'volume-88413f28-fbec-426e-a343-0ed2e3ce0364', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:20:11 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-7e19cbaf-1704-4f17-ba7f-6b06414e9f3f tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d1be2d8-d0cd-49ae-9bc0-35c8ba6cf9f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:20:11 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-7e19cbaf-1704-4f17-ba7f-6b06414e9f3f tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d1be2d8-d0cd-49ae-9bc0-35c8ba6cf9f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:20:11 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-7e19cbaf-1704-4f17-ba7f-6b06414e9f3f tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b437576d-e219-4c2c-bfe9-eaaa3c0b12d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:20:11 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-7e19cbaf-1704-4f17-ba7f-6b06414e9f3f tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Volume 88413f28-fbec-426e-a343-0ed2e3ce0364: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88413f28-fbec-426e-a343-0ed2e3ce0364', 'volume_size': 1}
Apr 10 13:20:11 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-7e19cbaf-1704-4f17-ba7f-6b06414e9f3f tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:20:11 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-00e7538a-9430-4870-a5d2-53eaaa6e3a2f tempest-CreateVolumesFromSnapshotTest-1784307287 None] Lock "cinder-4f2f63fa-9bbd-4196-bdbe-aac49a2382b6-delete_volume" released by "delete_volume" :: held 1.953s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:20:12 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-ec8f63a9-ab33-41eb-9d5a-9c449252061b tempest-CreateVolumesFromSnapshotTest-1784307287 None] Acquiring lock "cinder-e956d633-adf1-42b7-a96e-d913763867ce-delete_volume" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:20:12 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-ec8f63a9-ab33-41eb-9d5a-9c449252061b tempest-CreateVolumesFromSnapshotTest-1784307287 None] Lock "cinder-e956d633-adf1-42b7-a96e-d913763867ce-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:20:12 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-ec8f63a9-ab33-41eb-9d5a-9c449252061b tempest-CreateVolumesFromSnapshotTest-1784307287 None] Acquiring lock "cinder-quobyte-e956d633-adf1-42b7-a96e-d913763867ce" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:20:12 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-ec8f63a9-ab33-41eb-9d5a-9c449252061b tempest-CreateVolumesFromSnapshotTest-1784307287 None] Lock "cinder-quobyte-e956d633-adf1-42b7-a96e-d913763867ce" acquired by "delete_volume" :: waited 0.015s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:20:12 devstack sudo[91088]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:12 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-9efa3d2f-d800-4bf4-9705-d0d820197f21 tempest-SnapshotDependencyTests-797137213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-591f6681-dd5b-457f-8c20-9bb6ef7fe4f9.info" returned: 0 in 0.504s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:12 devstack cinder-volume[83345]: WARNING cinder.volume.drivers.remotefs [None req-9efa3d2f-d800-4bf4-9705-d0d820197f21 tempest-SnapshotDependencyTests-797137213 None] /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-591f6681-dd5b-457f-8c20-9bb6ef7fe4f9.info is being set with open permissions: ugo+rw
Apr 10 13:20:12 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-9efa3d2f-d800-4bf4-9705-d0d820197f21 tempest-SnapshotDependencyTests-797137213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-591f6681-dd5b-457f-8c20-9bb6ef7fe4f9.info {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:12 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[89cf17a2-0b7f-4a0f-87d3-cc6bdd1fa1a9]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:20:12 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ec8f63a9-ab33-41eb-9d5a-9c449252061b tempest-CreateVolumesFromSnapshotTest-1784307287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e956d633-adf1-42b7-a96e-d913763867ce {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:12 devstack sudo[91092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-591f6681-dd5b-457f-8c20-9bb6ef7fe4f9.info
Apr 10 13:20:12 devstack sudo[91092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:12 devstack sudo[91093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e956d633-adf1-42b7-a96e-d913763867ce
Apr 10 13:20:12 devstack sudo[91093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:12 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-5a2765ff-e9b2-4f65-a2f7-fcb9568177db tempest-VolumeDependencyTests-1052055728 None] Acquiring lock "cinder-51731cea-d883-4a30-a10a-53c990e379c4-delete_volume" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:20:12 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-5a2765ff-e9b2-4f65-a2f7-fcb9568177db tempest-VolumeDependencyTests-1052055728 None] Lock "cinder-51731cea-d883-4a30-a10a-53c990e379c4-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:20:12 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-5a2765ff-e9b2-4f65-a2f7-fcb9568177db tempest-VolumeDependencyTests-1052055728 None] Acquiring lock "cinder-quobyte-51731cea-d883-4a30-a10a-53c990e379c4" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:20:12 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-5a2765ff-e9b2-4f65-a2f7-fcb9568177db tempest-VolumeDependencyTests-1052055728 None] Lock "cinder-quobyte-51731cea-d883-4a30-a10a-53c990e379c4" acquired by "delete_volume" :: waited 0.009s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:20:12 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[89dcc2db-ae21-487c-abe1-d376f5c86ec1]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:20:12 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-5a2765ff-e9b2-4f65-a2f7-fcb9568177db tempest-VolumeDependencyTests-1052055728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-51731cea-d883-4a30-a10a-53c990e379c4 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:12 devstack sudo[91096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-51731cea-d883-4a30-a10a-53c990e379c4
Apr 10 13:20:12 devstack sudo[91096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:12 devstack sudo[91092]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:12 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-9efa3d2f-d800-4bf4-9705-d0d820197f21 tempest-SnapshotDependencyTests-797137213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-591f6681-dd5b-457f-8c20-9bb6ef7fe4f9.info" returned: 0 in 0.420s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:12 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-9efa3d2f-d800-4bf4-9705-d0d820197f21 tempest-SnapshotDependencyTests-797137213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.244s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:20:12 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-87816e19-9697-4526-ae88-7e9bc7e4ff26 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.771s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:20:12 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-87816e19-9697-4526-ae88-7e9bc7e4ff26 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f252bf08b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:20:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-469019787',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=288a4151-f9a5-484b-8dc0-478dcc49e642,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='521367798dea42daa421e9d13e571519',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:20:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:20:11Z,use_quota=True,user_id='73b1138ddd354343ae538b7a065f87cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)}" {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 13:20:12 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-87816e19-9697-4526-ae88-7e9bc7e4ff26 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Creating volume 288a4151-f9a5-484b-8dc0-478dcc49e642 {{(pid=83345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 13:20:12 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-87816e19-9697-4526-ae88-7e9bc7e4ff26 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:20:12 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-87816e19-9697-4526-ae88-7e9bc7e4ff26 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:20:12 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-87816e19-9697-4526-ae88-7e9bc7e4ff26 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:20:12 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-87816e19-9697-4526-ae88-7e9bc7e4ff26 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:20:12 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-87816e19-9697-4526-ae88-7e9bc7e4ff26 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:20:12 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-87816e19-9697-4526-ae88-7e9bc7e4ff26 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:20:12 devstack cinder-volume[83345]: INFO cinder.volume.drivers.remotefs [None req-87816e19-9697-4526-ae88-7e9bc7e4ff26 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] casted to osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331
Apr 10 13:20:12 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-87816e19-9697-4526-ae88-7e9bc7e4ff26 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-288a4151-f9a5-484b-8dc0-478dcc49e642 1073741824 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:12 devstack sudo[91102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-288a4151-f9a5-484b-8dc0-478dcc49e642 1073741824
Apr 10 13:20:12 devstack sudo[91102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:12 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-9efa3d2f-d800-4bf4-9705-d0d820197f21 tempest-SnapshotDependencyTests-797137213 None] Create snapshot completed successfully
Apr 10 13:20:12 devstack sudo[91093]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:12 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ec8f63a9-ab33-41eb-9d5a-9c449252061b tempest-CreateVolumesFromSnapshotTest-1784307287 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e956d633-adf1-42b7-a96e-d913763867ce" returned: 0 in 0.527s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:12 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ec8f63a9-ab33-41eb-9d5a-9c449252061b tempest-CreateVolumesFromSnapshotTest-1784307287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e956d633-adf1-42b7-a96e-d913763867ce {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:12 devstack sudo[91104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e956d633-adf1-42b7-a96e-d913763867ce
Apr 10 13:20:12 devstack sudo[91104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:13 devstack sudo[91096]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:13 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-5a2765ff-e9b2-4f65-a2f7-fcb9568177db tempest-VolumeDependencyTests-1052055728 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-51731cea-d883-4a30-a10a-53c990e379c4" returned: 0 in 0.569s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:13 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-5a2765ff-e9b2-4f65-a2f7-fcb9568177db tempest-VolumeDependencyTests-1052055728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-51731cea-d883-4a30-a10a-53c990e379c4 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:13 devstack sudo[91112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-51731cea-d883-4a30-a10a-53c990e379c4
Apr 10 13:20:13 devstack sudo[91112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:13 devstack sudo[91102]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:13 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-87816e19-9697-4526-ae88-7e9bc7e4ff26 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-288a4151-f9a5-484b-8dc0-478dcc49e642 1073741824" returned: 0 in 0.504s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:13 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-87816e19-9697-4526-ae88-7e9bc7e4ff26 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-288a4151-f9a5-484b-8dc0-478dcc49e642 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:13 devstack sudo[91115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-288a4151-f9a5-484b-8dc0-478dcc49e642
Apr 10 13:20:13 devstack sudo[91115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:13 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-f90af487-abe5-422b-b1aa-e0fddb488184 tempest-SnapshotDependencyTests-797137213 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:20:13 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-f90af487-abe5-422b-b1aa-e0fddb488184 tempest-SnapshotDependencyTests-797137213 None] Flow 'volume_create_manager' (3bab4e84-3094-4614-bc17-1dec6693bf0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:20:13 devstack sudo[91104]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:13 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-f90af487-abe5-422b-b1aa-e0fddb488184 tempest-SnapshotDependencyTests-797137213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f530ad9-910c-4d46-8e7e-84a9e212e122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:20:13 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ec8f63a9-ab33-41eb-9d5a-9c449252061b tempest-CreateVolumesFromSnapshotTest-1784307287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e956d633-adf1-42b7-a96e-d913763867ce" returned: 0 in 0.581s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:13 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-f90af487-abe5-422b-b1aa-e0fddb488184 tempest-SnapshotDependencyTests-797137213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f530ad9-910c-4d46-8e7e-84a9e212e122) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:20:13Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b0e240c-897c-43cb-8e50-7218c4554f06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0c36428522a4dbab0ad1a1311253752',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:20:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=6922111d-0450-4d51-9371-e876e978d866,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:20:13Z,use_quota=True,user_id='4bba6b35e42b484d83cd02833fa68c27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:20:13 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-f90af487-abe5-422b-b1aa-e0fddb488184 tempest-SnapshotDependencyTests-797137213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68850db5-e55a-4376-b212-470315b69604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:20:13 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-f90af487-abe5-422b-b1aa-e0fddb488184 tempest-SnapshotDependencyTests-797137213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68850db5-e55a-4376-b212-470315b69604) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:20:13 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-f90af487-abe5-422b-b1aa-e0fddb488184 tempest-SnapshotDependencyTests-797137213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87e1e383-0bdc-452c-8df7-dbeec2bbe7be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:20:13 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-f90af487-abe5-422b-b1aa-e0fddb488184 tempest-SnapshotDependencyTests-797137213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87e1e383-0bdc-452c-8df7-dbeec2bbe7be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5b0e240c-897c-43cb-8e50-7218c4554f06', 'volume_name': 'volume-5b0e240c-897c-43cb-8e50-7218c4554f06', 'volume_size': 1, 'snapshot_id': '6922111d-0450-4d51-9371-e876e978d866'}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:20:13 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-f90af487-abe5-422b-b1aa-e0fddb488184 tempest-SnapshotDependencyTests-797137213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c34289a-e0cb-47d0-845e-d6a16b32a47f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:20:13 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-f90af487-abe5-422b-b1aa-e0fddb488184 tempest-SnapshotDependencyTests-797137213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c34289a-e0cb-47d0-845e-d6a16b32a47f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:20:13 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-f90af487-abe5-422b-b1aa-e0fddb488184 tempest-SnapshotDependencyTests-797137213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4977e749-6696-4e6d-92ee-3c8cc07632c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:20:13 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-f90af487-abe5-422b-b1aa-e0fddb488184 tempest-SnapshotDependencyTests-797137213 None] Volume 5b0e240c-897c-43cb-8e50-7218c4554f06: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5b0e240c-897c-43cb-8e50-7218c4554f06', 'volume_size': 1, 'snapshot_id': '6922111d-0450-4d51-9371-e876e978d866'}
Apr 10 13:20:13 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-ec8f63a9-ab33-41eb-9d5a-9c449252061b tempest-CreateVolumesFromSnapshotTest-1784307287 None] Lock "cinder-quobyte-e956d633-adf1-42b7-a96e-d913763867ce" released by "delete_volume" :: held 1.186s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:20:13 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-f90af487-abe5-422b-b1aa-e0fddb488184 tempest-SnapshotDependencyTests-797137213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:20:13 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-ec8f63a9-ab33-41eb-9d5a-9c449252061b tempest-CreateVolumesFromSnapshotTest-1784307287 None] Created reservations ['1f77a9c7-74ad-459a-be8f-8a011edde80e', '66cf44bd-fc62-40ba-a1b4-94b4ddd8c4d5', '5a9420ac-f305-4fd1-81fa-9d2c02eaa7c4', '5eae15e7-2143-46db-b408-20f90d92f8dc'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:20:13 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-ec8f63a9-ab33-41eb-9d5a-9c449252061b tempest-CreateVolumesFromSnapshotTest-1784307287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:20:13 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-ec8f63a9-ab33-41eb-9d5a-9c449252061b tempest-CreateVolumesFromSnapshotTest-1784307287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:20:13 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-ec8f63a9-ab33-41eb-9d5a-9c449252061b tempest-CreateVolumesFromSnapshotTest-1784307287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:20:13 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-ec8f63a9-ab33-41eb-9d5a-9c449252061b tempest-CreateVolumesFromSnapshotTest-1784307287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:20:13 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-ec8f63a9-ab33-41eb-9d5a-9c449252061b tempest-CreateVolumesFromSnapshotTest-1784307287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:20:13 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ec8f63a9-ab33-41eb-9d5a-9c449252061b tempest-CreateVolumesFromSnapshotTest-1784307287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:13 devstack sudo[91117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:20:13 devstack sudo[91117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:13 devstack sudo[91112]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:13 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-5a2765ff-e9b2-4f65-a2f7-fcb9568177db tempest-VolumeDependencyTests-1052055728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-51731cea-d883-4a30-a10a-53c990e379c4" returned: 0 in 0.515s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:13 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-5a2765ff-e9b2-4f65-a2f7-fcb9568177db tempest-VolumeDependencyTests-1052055728 None] Lock "cinder-quobyte-51731cea-d883-4a30-a10a-53c990e379c4" released by "delete_volume" :: held 1.112s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:20:13 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-5a2765ff-e9b2-4f65-a2f7-fcb9568177db tempest-VolumeDependencyTests-1052055728 None] Created reservations ['d674b7e9-a6d8-4e2b-b4d1-c4eaa3f4504d', '82ff7713-4466-482d-bd8c-8b27c47d8aa0', 'c1d874b0-438c-4146-b32c-1f54db2f640a', 'a3242bbc-6309-458e-a72e-67380c701dc6'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:20:13 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-5a2765ff-e9b2-4f65-a2f7-fcb9568177db tempest-VolumeDependencyTests-1052055728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:20:13 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-5a2765ff-e9b2-4f65-a2f7-fcb9568177db tempest-VolumeDependencyTests-1052055728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:20:13 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-5a2765ff-e9b2-4f65-a2f7-fcb9568177db tempest-VolumeDependencyTests-1052055728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:20:13 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-5a2765ff-e9b2-4f65-a2f7-fcb9568177db tempest-VolumeDependencyTests-1052055728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:20:13 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-5a2765ff-e9b2-4f65-a2f7-fcb9568177db tempest-VolumeDependencyTests-1052055728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:20:13 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-5a2765ff-e9b2-4f65-a2f7-fcb9568177db tempest-VolumeDependencyTests-1052055728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:13 devstack sudo[91121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:20:13 devstack sudo[91121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:13 devstack sudo[91115]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:13 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-87816e19-9697-4526-ae88-7e9bc7e4ff26 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-288a4151-f9a5-484b-8dc0-478dcc49e642" returned: 0 in 0.459s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:13 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-87816e19-9697-4526-ae88-7e9bc7e4ff26 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] <== create_volume: return (1019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'} {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 13:20:13 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-87816e19-9697-4526-ae88-7e9bc7e4ff26 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.022s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:20:13 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-46cab360-a00a-4abb-8681-803cabd852b9 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.490s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:20:13 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-46cab360-a00a-4abb-8681-803cabd852b9 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f252bf08b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:20:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-147472382',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e95469fe-2dca-407e-a3b3-edbdf5ac5dfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='521367798dea42daa421e9d13e571519',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:20:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:20:11Z,use_quota=True,user_id='73b1138ddd354343ae538b7a065f87cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)}" {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 13:20:13 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-46cab360-a00a-4abb-8681-803cabd852b9 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Creating volume e95469fe-2dca-407e-a3b3-edbdf5ac5dfb {{(pid=83345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 13:20:13 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-46cab360-a00a-4abb-8681-803cabd852b9 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:20:13 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-46cab360-a00a-4abb-8681-803cabd852b9 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:20:13 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-46cab360-a00a-4abb-8681-803cabd852b9 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:20:13 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-46cab360-a00a-4abb-8681-803cabd852b9 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:20:13 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-46cab360-a00a-4abb-8681-803cabd852b9 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:20:13 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-46cab360-a00a-4abb-8681-803cabd852b9 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:20:13 devstack cinder-volume[83345]: INFO cinder.volume.drivers.remotefs [None req-46cab360-a00a-4abb-8681-803cabd852b9 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] casted to osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331
Apr 10 13:20:13 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-46cab360-a00a-4abb-8681-803cabd852b9 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e95469fe-2dca-407e-a3b3-edbdf5ac5dfb 1073741824 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:13 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-87816e19-9697-4526-ae88-7e9bc7e4ff26 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3601be4-30a7-4283-87dc-b0cf7721c640) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-288a4151-f9a5-484b-8dc0-478dcc49e642', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:20:13 devstack sudo[91123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e95469fe-2dca-407e-a3b3-edbdf5ac5dfb 1073741824
Apr 10 13:20:13 devstack sudo[91123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:13 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-87816e19-9697-4526-ae88-7e9bc7e4ff26 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd95439e-f5ff-45f3-a3c5-75f51335114d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:20:13 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-87816e19-9697-4526-ae88-7e9bc7e4ff26 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Volume volume-288a4151-f9a5-484b-8dc0-478dcc49e642 (288a4151-f9a5-484b-8dc0-478dcc49e642): created successfully
Apr 10 13:20:13 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-87816e19-9697-4526-ae88-7e9bc7e4ff26 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd95439e-f5ff-45f3-a3c5-75f51335114d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:20:13 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-87816e19-9697-4526-ae88-7e9bc7e4ff26 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Flow 'volume_create_manager' (69de324c-5e15-4190-bc51-0b30b28697ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:20:13 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-87816e19-9697-4526-ae88-7e9bc7e4ff26 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Created volume successfully.
Apr 10 13:20:14 devstack sudo[91117]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:14 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ec8f63a9-ab33-41eb-9d5a-9c449252061b tempest-CreateVolumesFromSnapshotTest-1784307287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.520s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:14 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-ec8f63a9-ab33-41eb-9d5a-9c449252061b tempest-CreateVolumesFromSnapshotTest-1784307287 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:20:14 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-ec8f63a9-ab33-41eb-9d5a-9c449252061b tempest-CreateVolumesFromSnapshotTest-1784307287 None] Deleted volume successfully.
Apr 10 13:20:14 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-ec8f63a9-ab33-41eb-9d5a-9c449252061b tempest-CreateVolumesFromSnapshotTest-1784307287 None] Lock "cinder-e956d633-adf1-42b7-a96e-d913763867ce-delete_volume" released by "delete_volume" :: held 1.835s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:20:14 devstack sudo[91121]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:14 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-5a2765ff-e9b2-4f65-a2f7-fcb9568177db tempest-VolumeDependencyTests-1052055728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.455s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:14 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-5a2765ff-e9b2-4f65-a2f7-fcb9568177db tempest-VolumeDependencyTests-1052055728 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:20:14 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-5a2765ff-e9b2-4f65-a2f7-fcb9568177db tempest-VolumeDependencyTests-1052055728 None] Deleted volume successfully.
Apr 10 13:20:14 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-5a2765ff-e9b2-4f65-a2f7-fcb9568177db tempest-VolumeDependencyTests-1052055728 None] Lock "cinder-51731cea-d883-4a30-a10a-53c990e379c4-delete_volume" released by "delete_volume" :: held 1.702s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:20:14 devstack sudo[91123]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:14 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-46cab360-a00a-4abb-8681-803cabd852b9 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e95469fe-2dca-407e-a3b3-edbdf5ac5dfb 1073741824" returned: 0 in 0.517s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:14 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-46cab360-a00a-4abb-8681-803cabd852b9 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e95469fe-2dca-407e-a3b3-edbdf5ac5dfb {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:14 devstack sudo[91130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e95469fe-2dca-407e-a3b3-edbdf5ac5dfb
Apr 10 13:20:14 devstack sudo[91130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:14 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-4033ffaf-af25-4333-a1bd-ba33b2832695 tempest-CreateVolumesFromSnapshotTest-1784307287 None] Acquiring lock "cinder-407c027b-0bad-4410-9258-7f7b4f74bcd3-delete_snapshot" by "delete_snapshot" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:20:14 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-4033ffaf-af25-4333-a1bd-ba33b2832695 tempest-CreateVolumesFromSnapshotTest-1784307287 None] Lock "cinder-407c027b-0bad-4410-9258-7f7b4f74bcd3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:20:14 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-4033ffaf-af25-4333-a1bd-ba33b2832695 tempest-CreateVolumesFromSnapshotTest-1784307287 None] Acquiring lock "cinder-quobyte-2529db32-32c8-4010-a67c-17c41254c290" by "delete_snapshot" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:20:14 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-4033ffaf-af25-4333-a1bd-ba33b2832695 tempest-CreateVolumesFromSnapshotTest-1784307287 None] Lock "cinder-quobyte-2529db32-32c8-4010-a67c-17c41254c290" acquired by "delete_snapshot" :: waited 0.007s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:20:14 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-4033ffaf-af25-4333-a1bd-ba33b2832695 tempest-CreateVolumesFromSnapshotTest-1784307287 None] Acquiring lock "cinder-quobyte-407c027b-0bad-4410-9258-7f7b4f74bcd3" by "_delete_snapshot" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:20:14 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-4033ffaf-af25-4333-a1bd-ba33b2832695 tempest-CreateVolumesFromSnapshotTest-1784307287 None] Lock "cinder-quobyte-407c027b-0bad-4410-9258-7f7b4f74bcd3" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:20:14 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-4033ffaf-af25-4333-a1bd-ba33b2832695 tempest-CreateVolumesFromSnapshotTest-1784307287 None] Deleting offline snapshot 407c027b-0bad-4410-9258-7f7b4f74bcd3 of volume 2529db32-32c8-4010-a67c-17c41254c290 {{(pid=83345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 10 13:20:14 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-4033ffaf-af25-4333-a1bd-ba33b2832695 tempest-CreateVolumesFromSnapshotTest-1784307287 None] snapshot_file for this snap is: volume-2529db32-32c8-4010-a67c-17c41254c290.407c027b-0bad-4410-9258-7f7b4f74bcd3 {{(pid=83345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 10 13:20:14 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[c439462f-6ad8-49ba-abea-353be1d29950]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:20:14 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-4033ffaf-af25-4333-a1bd-ba33b2832695 tempest-CreateVolumesFromSnapshotTest-1784307287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-2529db32-32c8-4010-a67c-17c41254c290.407c027b-0bad-4410-9258-7f7b4f74bcd3 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:14 devstack sudo[91132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-2529db32-32c8-4010-a67c-17c41254c290.407c027b-0bad-4410-9258-7f7b4f74bcd3
Apr 10 13:20:14 devstack sudo[91132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:14 devstack sudo[91130]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:14 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-46cab360-a00a-4abb-8681-803cabd852b9 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e95469fe-2dca-407e-a3b3-edbdf5ac5dfb" returned: 0 in 0.427s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:14 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-46cab360-a00a-4abb-8681-803cabd852b9 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] <== create_volume: return (968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'} {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 13:20:14 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-46cab360-a00a-4abb-8681-803cabd852b9 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.972s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:20:14 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-18b711a1-b4a9-420c-92b5-28d6d1deb123 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.183s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:20:14 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-18b711a1-b4a9-420c-92b5-28d6d1deb123 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f252bf08b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:20:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1165861864',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=437e3fe8-b0d8-48f5-a19b-65adc8a52edb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='521367798dea42daa421e9d13e571519',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:20:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:20:11Z,use_quota=True,user_id='73b1138ddd354343ae538b7a065f87cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)}" {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 13:20:14 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-18b711a1-b4a9-420c-92b5-28d6d1deb123 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Creating volume 437e3fe8-b0d8-48f5-a19b-65adc8a52edb {{(pid=83345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 13:20:14 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-18b711a1-b4a9-420c-92b5-28d6d1deb123 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:20:14 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-18b711a1-b4a9-420c-92b5-28d6d1deb123 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:20:14 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-18b711a1-b4a9-420c-92b5-28d6d1deb123 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:20:14 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-18b711a1-b4a9-420c-92b5-28d6d1deb123 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:20:14 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-18b711a1-b4a9-420c-92b5-28d6d1deb123 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:20:14 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-18b711a1-b4a9-420c-92b5-28d6d1deb123 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:20:14 devstack cinder-volume[83345]: INFO cinder.volume.drivers.remotefs [None req-18b711a1-b4a9-420c-92b5-28d6d1deb123 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] casted to osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331
Apr 10 13:20:14 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-18b711a1-b4a9-420c-92b5-28d6d1deb123 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-437e3fe8-b0d8-48f5-a19b-65adc8a52edb 1073741824 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:14 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-46cab360-a00a-4abb-8681-803cabd852b9 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff7b00c5-7017-4f0c-8280-c47b19064772) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e95469fe-2dca-407e-a3b3-edbdf5ac5dfb', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:20:14 devstack sudo[91135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-437e3fe8-b0d8-48f5-a19b-65adc8a52edb 1073741824
Apr 10 13:20:14 devstack sudo[91135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:14 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-46cab360-a00a-4abb-8681-803cabd852b9 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00bdeb3a-4b2f-4da0-8ea2-59e215fcf81e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:20:14 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-46cab360-a00a-4abb-8681-803cabd852b9 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Volume volume-e95469fe-2dca-407e-a3b3-edbdf5ac5dfb (e95469fe-2dca-407e-a3b3-edbdf5ac5dfb): created successfully
Apr 10 13:20:14 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-46cab360-a00a-4abb-8681-803cabd852b9 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00bdeb3a-4b2f-4da0-8ea2-59e215fcf81e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:20:14 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-46cab360-a00a-4abb-8681-803cabd852b9 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Flow 'volume_create_manager' (d7549125-c58e-4dfe-b4b5-2708d09fe5e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:20:14 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-46cab360-a00a-4abb-8681-803cabd852b9 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Created volume successfully.
Apr 10 13:20:14 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-da110d11-3335-463b-8101-fd336a9350de tempest-VolumeDependencyTests-1052055728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:20:14 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-da110d11-3335-463b-8101-fd336a9350de tempest-VolumeDependencyTests-1052055728 None] Flow 'volume_create_manager' (95033646-9052-488e-99a0-f6757b4bd2b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:20:14 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-da110d11-3335-463b-8101-fd336a9350de tempest-VolumeDependencyTests-1052055728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad3ad14a-f098-405a-ae91-d1ba921f7c3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:20:14 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-da110d11-3335-463b-8101-fd336a9350de tempest-VolumeDependencyTests-1052055728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad3ad14a-f098-405a-ae91-d1ba921f7c3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:20:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-331300883',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5686dcff-f611-4b23-9d50-7f6a8d858c55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b860b753090645ad91f52b3e138634de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:20:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:20:15Z,use_quota=True,user_id='866c4ed007134f509b6d0152fa189d0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:20:14 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-da110d11-3335-463b-8101-fd336a9350de tempest-VolumeDependencyTests-1052055728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dfce2d9-3cd4-45ac-95e6-f3df5f53b8e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:20:14 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-da110d11-3335-463b-8101-fd336a9350de tempest-VolumeDependencyTests-1052055728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dfce2d9-3cd4-45ac-95e6-f3df5f53b8e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:20:14 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-da110d11-3335-463b-8101-fd336a9350de tempest-VolumeDependencyTests-1052055728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c8a0fbd-fa77-44a4-8e67-d39771c46aea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:20:14 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-da110d11-3335-463b-8101-fd336a9350de tempest-VolumeDependencyTests-1052055728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c8a0fbd-fa77-44a4-8e67-d39771c46aea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5686dcff-f611-4b23-9d50-7f6a8d858c55', 'volume_name': 'volume-5686dcff-f611-4b23-9d50-7f6a8d858c55', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:20:14 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-da110d11-3335-463b-8101-fd336a9350de tempest-VolumeDependencyTests-1052055728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c66b5909-be0d-4047-94c0-f6fb6d455aea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:20:14 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-da110d11-3335-463b-8101-fd336a9350de tempest-VolumeDependencyTests-1052055728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c66b5909-be0d-4047-94c0-f6fb6d455aea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:20:14 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-da110d11-3335-463b-8101-fd336a9350de tempest-VolumeDependencyTests-1052055728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46d0be0b-1657-41b0-97ae-c2636b2a2006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:20:14 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-da110d11-3335-463b-8101-fd336a9350de tempest-VolumeDependencyTests-1052055728 None] Volume 5686dcff-f611-4b23-9d50-7f6a8d858c55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5686dcff-f611-4b23-9d50-7f6a8d858c55', 'volume_size': 1}
Apr 10 13:20:14 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-da110d11-3335-463b-8101-fd336a9350de tempest-VolumeDependencyTests-1052055728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:20:15 devstack sudo[91132]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:15 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-4033ffaf-af25-4333-a1bd-ba33b2832695 tempest-CreateVolumesFromSnapshotTest-1784307287 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-2529db32-32c8-4010-a67c-17c41254c290.407c027b-0bad-4410-9258-7f7b4f74bcd3" returned: 0 in 0.554s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:15 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-4033ffaf-af25-4333-a1bd-ba33b2832695 tempest-CreateVolumesFromSnapshotTest-1784307287 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2529db32-32c8-4010-a67c-17c41254c290(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 13:20:15 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bbe8afd-98ba-4f23-bbb3-c3fa70ab5123]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:20:15 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-4033ffaf-af25-4333-a1bd-ba33b2832695 tempest-CreateVolumesFromSnapshotTest-1784307287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-2529db32-32c8-4010-a67c-17c41254c290 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:15 devstack sudo[91140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-2529db32-32c8-4010-a67c-17c41254c290
Apr 10 13:20:15 devstack sudo[91140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:15 devstack sudo[91135]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:15 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-18b711a1-b4a9-420c-92b5-28d6d1deb123 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-437e3fe8-b0d8-48f5-a19b-65adc8a52edb 1073741824" returned: 0 in 0.536s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:15 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-18b711a1-b4a9-420c-92b5-28d6d1deb123 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-437e3fe8-b0d8-48f5-a19b-65adc8a52edb {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:15 devstack sudo[91145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-437e3fe8-b0d8-48f5-a19b-65adc8a52edb
Apr 10 13:20:15 devstack sudo[91145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:15 devstack sudo[91140]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:15 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-4033ffaf-af25-4333-a1bd-ba33b2832695 tempest-CreateVolumesFromSnapshotTest-1784307287 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-2529db32-32c8-4010-a67c-17c41254c290" returned: 0 in 0.483s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:15 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-4033ffaf-af25-4333-a1bd-ba33b2832695 tempest-CreateVolumesFromSnapshotTest-1784307287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-2529db32-32c8-4010-a67c-17c41254c290.407c027b-0bad-4410-9258-7f7b4f74bcd3 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:15 devstack sudo[91150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-2529db32-32c8-4010-a67c-17c41254c290.407c027b-0bad-4410-9258-7f7b4f74bcd3
Apr 10 13:20:15 devstack sudo[91150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:15 devstack sudo[91145]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:15 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-18b711a1-b4a9-420c-92b5-28d6d1deb123 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-437e3fe8-b0d8-48f5-a19b-65adc8a52edb" returned: 0 in 0.436s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:15 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-18b711a1-b4a9-420c-92b5-28d6d1deb123 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] <== create_volume: return (999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'} {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 13:20:15 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-18b711a1-b4a9-420c-92b5-28d6d1deb123 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:20:15 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-e1eda1dc-1645-4d9d-a805-925184a00616 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.915s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:20:15 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-e1eda1dc-1645-4d9d-a805-925184a00616 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f252bf08b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:20:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1422488954',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7919532b-9016-4e5a-b1fa-3d5c45a94cc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='521367798dea42daa421e9d13e571519',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:20:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:20:12Z,use_quota=True,user_id='73b1138ddd354343ae538b7a065f87cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)}" {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 13:20:15 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-e1eda1dc-1645-4d9d-a805-925184a00616 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Creating volume 7919532b-9016-4e5a-b1fa-3d5c45a94cc7 {{(pid=83345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 13:20:15 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-e1eda1dc-1645-4d9d-a805-925184a00616 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:20:15 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-e1eda1dc-1645-4d9d-a805-925184a00616 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:20:15 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-e1eda1dc-1645-4d9d-a805-925184a00616 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:20:15 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-e1eda1dc-1645-4d9d-a805-925184a00616 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:20:15 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-e1eda1dc-1645-4d9d-a805-925184a00616 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:20:15 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-e1eda1dc-1645-4d9d-a805-925184a00616 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:20:15 devstack cinder-volume[83345]: INFO cinder.volume.drivers.remotefs [None req-e1eda1dc-1645-4d9d-a805-925184a00616 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] casted to osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331
Apr 10 13:20:15 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-e1eda1dc-1645-4d9d-a805-925184a00616 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7919532b-9016-4e5a-b1fa-3d5c45a94cc7 1073741824 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:15 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-18b711a1-b4a9-420c-92b5-28d6d1deb123 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3816227-6bd9-4b59-8c57-3396dd72ba60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-437e3fe8-b0d8-48f5-a19b-65adc8a52edb', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:20:15 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-18b711a1-b4a9-420c-92b5-28d6d1deb123 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (421a5b17-e4c3-46ab-8eeb-ab4d1c81c6e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:20:15 devstack sudo[91153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7919532b-9016-4e5a-b1fa-3d5c45a94cc7 1073741824
Apr 10 13:20:15 devstack sudo[91153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:15 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-18b711a1-b4a9-420c-92b5-28d6d1deb123 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Volume volume-437e3fe8-b0d8-48f5-a19b-65adc8a52edb (437e3fe8-b0d8-48f5-a19b-65adc8a52edb): created successfully
Apr 10 13:20:15 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-18b711a1-b4a9-420c-92b5-28d6d1deb123 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (421a5b17-e4c3-46ab-8eeb-ab4d1c81c6e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:20:15 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-18b711a1-b4a9-420c-92b5-28d6d1deb123 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Flow 'volume_create_manager' (205dedec-d5b3-463d-9b5a-783b1f462fdd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:20:15 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-18b711a1-b4a9-420c-92b5-28d6d1deb123 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Created volume successfully.
Apr 10 13:20:16 devstack sudo[91150]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:16 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-4033ffaf-af25-4333-a1bd-ba33b2832695 tempest-CreateVolumesFromSnapshotTest-1784307287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-2529db32-32c8-4010-a67c-17c41254c290.407c027b-0bad-4410-9258-7f7b4f74bcd3" returned: 0 in 0.473s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:16 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-4033ffaf-af25-4333-a1bd-ba33b2832695 tempest-CreateVolumesFromSnapshotTest-1784307287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-2529db32-32c8-4010-a67c-17c41254c290.407c027b-0bad-4410-9258-7f7b4f74bcd3 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:16 devstack sudo[91158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-2529db32-32c8-4010-a67c-17c41254c290.407c027b-0bad-4410-9258-7f7b4f74bcd3
Apr 10 13:20:16 devstack sudo[91158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:16 devstack sudo[91153]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:16 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-e1eda1dc-1645-4d9d-a805-925184a00616 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7919532b-9016-4e5a-b1fa-3d5c45a94cc7 1073741824" returned: 0 in 0.545s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:16 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-e1eda1dc-1645-4d9d-a805-925184a00616 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7919532b-9016-4e5a-b1fa-3d5c45a94cc7 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:16 devstack sudo[91163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7919532b-9016-4e5a-b1fa-3d5c45a94cc7
Apr 10 13:20:16 devstack sudo[91163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:16 devstack sudo[91158]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:16 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-4033ffaf-af25-4333-a1bd-ba33b2832695 tempest-CreateVolumesFromSnapshotTest-1784307287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-2529db32-32c8-4010-a67c-17c41254c290.407c027b-0bad-4410-9258-7f7b4f74bcd3" returned: 0 in 0.457s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:16 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-4033ffaf-af25-4333-a1bd-ba33b2832695 tempest-CreateVolumesFromSnapshotTest-1784307287 None] Lock "cinder-quobyte-407c027b-0bad-4410-9258-7f7b4f74bcd3" released by "_delete_snapshot" :: held 2.058s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:20:16 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-4033ffaf-af25-4333-a1bd-ba33b2832695 tempest-CreateVolumesFromSnapshotTest-1784307287 None] Lock "cinder-quobyte-2529db32-32c8-4010-a67c-17c41254c290" released by "delete_snapshot" :: held 2.072s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:20:16 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-4033ffaf-af25-4333-a1bd-ba33b2832695 tempest-CreateVolumesFromSnapshotTest-1784307287 None] Created reservations ['f39f0338-4a7b-4d96-b5fe-b91ac5745723', '7898c4c1-496b-4db3-b427-2c46dadd0afe', '8c3ab7b5-8219-4fad-aede-ef258bfdde31', '9d967ba4-3225-4984-9ca5-b26c37f99534'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:20:16 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-4033ffaf-af25-4333-a1bd-ba33b2832695 tempest-CreateVolumesFromSnapshotTest-1784307287 None] Delete snapshot completed successfully.
Apr 10 13:20:16 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-4033ffaf-af25-4333-a1bd-ba33b2832695 tempest-CreateVolumesFromSnapshotTest-1784307287 None] Lock "cinder-407c027b-0bad-4410-9258-7f7b4f74bcd3-delete_snapshot" released by "delete_snapshot" :: held 2.151s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:20:16 devstack sudo[91163]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:16 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-e1eda1dc-1645-4d9d-a805-925184a00616 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7919532b-9016-4e5a-b1fa-3d5c45a94cc7" returned: 0 in 0.429s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:16 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-e1eda1dc-1645-4d9d-a805-925184a00616 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'} {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 13:20:16 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-e1eda1dc-1645-4d9d-a805-925184a00616 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.999s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:20:16 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-7e19cbaf-1704-4f17-ba7f-6b06414e9f3f tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.767s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:20:16 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-7e19cbaf-1704-4f17-ba7f-6b06414e9f3f tempest-CreateVolumesFromSourceVolumeTest-218806783 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f252bf08b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:20:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-613495984',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88413f28-fbec-426e-a343-0ed2e3ce0364,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='521367798dea42daa421e9d13e571519',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:20:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:20:12Z,use_quota=True,user_id='73b1138ddd354343ae538b7a065f87cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)}" {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 13:20:16 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-7e19cbaf-1704-4f17-ba7f-6b06414e9f3f tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Creating volume 88413f28-fbec-426e-a343-0ed2e3ce0364 {{(pid=83345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 13:20:16 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-7e19cbaf-1704-4f17-ba7f-6b06414e9f3f tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:20:16 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-7e19cbaf-1704-4f17-ba7f-6b06414e9f3f tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:20:16 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-7e19cbaf-1704-4f17-ba7f-6b06414e9f3f tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:20:16 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-7e19cbaf-1704-4f17-ba7f-6b06414e9f3f tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:20:16 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-7e19cbaf-1704-4f17-ba7f-6b06414e9f3f tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:20:16 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-7e19cbaf-1704-4f17-ba7f-6b06414e9f3f tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:20:16 devstack cinder-volume[83345]: INFO cinder.volume.drivers.remotefs [None req-7e19cbaf-1704-4f17-ba7f-6b06414e9f3f tempest-CreateVolumesFromSourceVolumeTest-218806783 None] casted to osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331
Apr 10 13:20:16 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-7e19cbaf-1704-4f17-ba7f-6b06414e9f3f tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-88413f28-fbec-426e-a343-0ed2e3ce0364 1073741824 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:16 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-e1eda1dc-1645-4d9d-a805-925184a00616 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85aa40c8-1cc3-4526-adbb-5f261e2a6bbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7919532b-9016-4e5a-b1fa-3d5c45a94cc7', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:20:16 devstack sudo[91167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-88413f28-fbec-426e-a343-0ed2e3ce0364 1073741824
Apr 10 13:20:16 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-e1eda1dc-1645-4d9d-a805-925184a00616 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b45ef19e-106b-4ca6-8375-c65ace103128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:20:16 devstack sudo[91167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:16 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-e1eda1dc-1645-4d9d-a805-925184a00616 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Volume volume-7919532b-9016-4e5a-b1fa-3d5c45a94cc7 (7919532b-9016-4e5a-b1fa-3d5c45a94cc7): created successfully
Apr 10 13:20:16 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-e1eda1dc-1645-4d9d-a805-925184a00616 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b45ef19e-106b-4ca6-8375-c65ace103128) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:20:16 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-e1eda1dc-1645-4d9d-a805-925184a00616 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Flow 'volume_create_manager' (7482dcee-aadb-4ea3-810d-0994170c0b25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:20:16 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-e1eda1dc-1645-4d9d-a805-925184a00616 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Created volume successfully.
Apr 10 13:20:17 devstack sudo[91167]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:17 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-7e19cbaf-1704-4f17-ba7f-6b06414e9f3f tempest-CreateVolumesFromSourceVolumeTest-218806783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-88413f28-fbec-426e-a343-0ed2e3ce0364 1073741824" returned: 0 in 0.480s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:17 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-7e19cbaf-1704-4f17-ba7f-6b06414e9f3f tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-88413f28-fbec-426e-a343-0ed2e3ce0364 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:17 devstack sudo[91172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-88413f28-fbec-426e-a343-0ed2e3ce0364
Apr 10 13:20:17 devstack sudo[91172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:17 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-abad4fb2-7db5-4f28-afaa-7e560241f228 tempest-CreateVolumesFromSnapshotTest-1784307287 None] Acquiring lock "cinder-2529db32-32c8-4010-a67c-17c41254c290-delete_volume" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:20:17 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-abad4fb2-7db5-4f28-afaa-7e560241f228 tempest-CreateVolumesFromSnapshotTest-1784307287 None] Lock "cinder-2529db32-32c8-4010-a67c-17c41254c290-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:20:17 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-abad4fb2-7db5-4f28-afaa-7e560241f228 tempest-CreateVolumesFromSnapshotTest-1784307287 None] Acquiring lock "cinder-quobyte-2529db32-32c8-4010-a67c-17c41254c290" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:20:17 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-abad4fb2-7db5-4f28-afaa-7e560241f228 tempest-CreateVolumesFromSnapshotTest-1784307287 None] Lock "cinder-quobyte-2529db32-32c8-4010-a67c-17c41254c290" acquired by "delete_volume" :: waited 0.017s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:20:17 devstack sudo[91172]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:17 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-7e19cbaf-1704-4f17-ba7f-6b06414e9f3f tempest-CreateVolumesFromSourceVolumeTest-218806783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-88413f28-fbec-426e-a343-0ed2e3ce0364" returned: 0 in 0.421s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:17 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-7e19cbaf-1704-4f17-ba7f-6b06414e9f3f tempest-CreateVolumesFromSourceVolumeTest-218806783 None] <== create_volume: return (925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'} {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 13:20:17 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-7e19cbaf-1704-4f17-ba7f-6b06414e9f3f tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.928s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:20:17 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[978abe34-1da7-44ed-9d90-a58fc546ce80]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:20:17 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-f90af487-abe5-422b-b1aa-e0fddb488184 tempest-SnapshotDependencyTests-797137213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 4.216s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:20:17 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-f90af487-abe5-422b-b1aa-e0fddb488184 tempest-SnapshotDependencyTests-797137213 None] Acquiring lock "cinder-quobyte-6922111d-0450-4d51-9371-e876e978d866-5b0e240c-897c-43cb-8e50-7218c4554f06" by "_create_volume_from_snapshot" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:20:17 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-abad4fb2-7db5-4f28-afaa-7e560241f228 tempest-CreateVolumesFromSnapshotTest-1784307287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-2529db32-32c8-4010-a67c-17c41254c290 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:17 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-7e19cbaf-1704-4f17-ba7f-6b06414e9f3f tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b437576d-e219-4c2c-bfe9-eaaa3c0b12d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88413f28-fbec-426e-a343-0ed2e3ce0364', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:20:17 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-7e19cbaf-1704-4f17-ba7f-6b06414e9f3f tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc0dad03-202d-47fb-b733-d3a484a44da0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:20:17 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-f90af487-abe5-422b-b1aa-e0fddb488184 tempest-SnapshotDependencyTests-797137213 None] Lock "cinder-quobyte-6922111d-0450-4d51-9371-e876e978d866-5b0e240c-897c-43cb-8e50-7218c4554f06" acquired by "_create_volume_from_snapshot" :: waited 0.038s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:20:17 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-f90af487-abe5-422b-b1aa-e0fddb488184 tempest-SnapshotDependencyTests-797137213 None] Creating volume 5b0e240c-897c-43cb-8e50-7218c4554f06 from snapshot 6922111d-0450-4d51-9371-e876e978d866 {{(pid=83345) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 10 13:20:17 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-f90af487-abe5-422b-b1aa-e0fddb488184 tempest-SnapshotDependencyTests-797137213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:20:17 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-f90af487-abe5-422b-b1aa-e0fddb488184 tempest-SnapshotDependencyTests-797137213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:20:17 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-f90af487-abe5-422b-b1aa-e0fddb488184 tempest-SnapshotDependencyTests-797137213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:20:17 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-f90af487-abe5-422b-b1aa-e0fddb488184 tempest-SnapshotDependencyTests-797137213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:20:17 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-f90af487-abe5-422b-b1aa-e0fddb488184 tempest-SnapshotDependencyTests-797137213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:20:17 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-f90af487-abe5-422b-b1aa-e0fddb488184 tempest-SnapshotDependencyTests-797137213 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:20:17 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-f90af487-abe5-422b-b1aa-e0fddb488184 tempest-SnapshotDependencyTests-797137213 None] Acquiring lock "cinder-quobyte-5b0e240c-897c-43cb-8e50-7218c4554f06" by "_copy_volume_from_snapshot" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:20:17 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-7e19cbaf-1704-4f17-ba7f-6b06414e9f3f tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Volume volume-88413f28-fbec-426e-a343-0ed2e3ce0364 (88413f28-fbec-426e-a343-0ed2e3ce0364): created successfully
Apr 10 13:20:17 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-7e19cbaf-1704-4f17-ba7f-6b06414e9f3f tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc0dad03-202d-47fb-b733-d3a484a44da0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:20:17 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-7e19cbaf-1704-4f17-ba7f-6b06414e9f3f tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Flow 'volume_create_manager' (ada07a3e-9044-48e4-817e-cad0cba99911) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:20:17 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-f90af487-abe5-422b-b1aa-e0fddb488184 tempest-SnapshotDependencyTests-797137213 None] Lock "cinder-quobyte-5b0e240c-897c-43cb-8e50-7218c4554f06" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:20:17 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-f90af487-abe5-422b-b1aa-e0fddb488184 tempest-SnapshotDependencyTests-797137213 None] snapshot: 6922111d-0450-4d51-9371-e876e978d866, volume: 5b0e240c-897c-43cb-8e50-7218c4554f06,  {{(pid=83345) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 10 13:20:17 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-7e19cbaf-1704-4f17-ba7f-6b06414e9f3f tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Created volume successfully.
Apr 10 13:20:17 devstack sudo[91175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-2529db32-32c8-4010-a67c-17c41254c290
Apr 10 13:20:17 devstack sudo[91175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:17 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-f90af487-abe5-422b-b1aa-e0fddb488184 tempest-SnapshotDependencyTests-797137213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:20:17 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-f90af487-abe5-422b-b1aa-e0fddb488184 tempest-SnapshotDependencyTests-797137213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:20:17 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-f90af487-abe5-422b-b1aa-e0fddb488184 tempest-SnapshotDependencyTests-797137213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:20:17 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-f90af487-abe5-422b-b1aa-e0fddb488184 tempest-SnapshotDependencyTests-797137213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:20:17 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-f90af487-abe5-422b-b1aa-e0fddb488184 tempest-SnapshotDependencyTests-797137213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:20:17 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[a11d76f6-a651-4cfe-9572-947d3e1b1414]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:20:17 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-f90af487-abe5-422b-b1aa-e0fddb488184 tempest-SnapshotDependencyTests-797137213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-591f6681-dd5b-457f-8c20-9bb6ef7fe4f9.6922111d-0450-4d51-9371-e876e978d866 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:17 devstack sudo[91177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-591f6681-dd5b-457f-8c20-9bb6ef7fe4f9.6922111d-0450-4d51-9371-e876e978d866
Apr 10 13:20:17 devstack sudo[91177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:18 devstack sudo[91175]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:18 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-abad4fb2-7db5-4f28-afaa-7e560241f228 tempest-CreateVolumesFromSnapshotTest-1784307287 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-2529db32-32c8-4010-a67c-17c41254c290" returned: 0 in 0.474s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:18 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-abad4fb2-7db5-4f28-afaa-7e560241f228 tempest-CreateVolumesFromSnapshotTest-1784307287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-2529db32-32c8-4010-a67c-17c41254c290 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:18 devstack sudo[91183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-2529db32-32c8-4010-a67c-17c41254c290
Apr 10 13:20:18 devstack sudo[91183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:18 devstack sudo[91177]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:18 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-f90af487-abe5-422b-b1aa-e0fddb488184 tempest-SnapshotDependencyTests-797137213 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-591f6681-dd5b-457f-8c20-9bb6ef7fe4f9.6922111d-0450-4d51-9371-e876e978d866" returned: 0 in 0.473s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:18 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-f90af487-abe5-422b-b1aa-e0fddb488184 tempest-SnapshotDependencyTests-797137213 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-591f6681-dd5b-457f-8c20-9bb6ef7fe4f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 13:20:18 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-f90af487-abe5-422b-b1aa-e0fddb488184 tempest-SnapshotDependencyTests-797137213 None] will copy from snapshot at /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-591f6681-dd5b-457f-8c20-9bb6ef7fe4f9 {{(pid=83345) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 10 13:20:18 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-f90af487-abe5-422b-b1aa-e0fddb488184 tempest-SnapshotDependencyTests-797137213 None] Creating direct copy from snapshot {{(pid=83345) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 10 13:20:18 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f892e22-2438-4b35-97f6-8024cb9ecc1f]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:20:18 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-f90af487-abe5-422b-b1aa-e0fddb488184 tempest-SnapshotDependencyTests-797137213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-591f6681-dd5b-457f-8c20-9bb6ef7fe4f9 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:18 devstack sudo[91187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-591f6681-dd5b-457f-8c20-9bb6ef7fe4f9
Apr 10 13:20:18 devstack sudo[91187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:18 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-55dc7dd4-81b7-4fff-b69a-478ad6918adf tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Acquiring lock "cinder-88413f28-fbec-426e-a343-0ed2e3ce0364-delete_volume" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:20:18 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-55dc7dd4-81b7-4fff-b69a-478ad6918adf tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Lock "cinder-88413f28-fbec-426e-a343-0ed2e3ce0364-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:20:18 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-55dc7dd4-81b7-4fff-b69a-478ad6918adf tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Acquiring lock "cinder-quobyte-88413f28-fbec-426e-a343-0ed2e3ce0364" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:20:18 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-55dc7dd4-81b7-4fff-b69a-478ad6918adf tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Lock "cinder-quobyte-88413f28-fbec-426e-a343-0ed2e3ce0364" acquired by "delete_volume" :: waited 0.009s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:20:18 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd271148-9cfe-4495-b8df-f8007fb9d444]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:20:18 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-55dc7dd4-81b7-4fff-b69a-478ad6918adf tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-88413f28-fbec-426e-a343-0ed2e3ce0364 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:18 devstack sudo[91189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-88413f28-fbec-426e-a343-0ed2e3ce0364
Apr 10 13:20:18 devstack sudo[91189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:18 devstack sudo[91183]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:18 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-abad4fb2-7db5-4f28-afaa-7e560241f228 tempest-CreateVolumesFromSnapshotTest-1784307287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-2529db32-32c8-4010-a67c-17c41254c290" returned: 0 in 0.451s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:18 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-abad4fb2-7db5-4f28-afaa-7e560241f228 tempest-CreateVolumesFromSnapshotTest-1784307287 None] Lock "cinder-quobyte-2529db32-32c8-4010-a67c-17c41254c290" released by "delete_volume" :: held 0.955s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:20:18 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-abad4fb2-7db5-4f28-afaa-7e560241f228 tempest-CreateVolumesFromSnapshotTest-1784307287 None] Created reservations ['f0e643f1-ed84-41d5-9ec9-e1640dafd5e7', '8fc33323-448c-4adf-a939-121e5a56321d', '46ac8205-bc37-4062-88c9-22916e5fb33a', '35661bf2-727d-44f7-99bd-028625931115'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:20:18 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-abad4fb2-7db5-4f28-afaa-7e560241f228 tempest-CreateVolumesFromSnapshotTest-1784307287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:20:18 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-abad4fb2-7db5-4f28-afaa-7e560241f228 tempest-CreateVolumesFromSnapshotTest-1784307287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:20:18 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-abad4fb2-7db5-4f28-afaa-7e560241f228 tempest-CreateVolumesFromSnapshotTest-1784307287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:20:18 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-abad4fb2-7db5-4f28-afaa-7e560241f228 tempest-CreateVolumesFromSnapshotTest-1784307287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:20:18 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-abad4fb2-7db5-4f28-afaa-7e560241f228 tempest-CreateVolumesFromSnapshotTest-1784307287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:20:18 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-abad4fb2-7db5-4f28-afaa-7e560241f228 tempest-CreateVolumesFromSnapshotTest-1784307287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:18 devstack sudo[91195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:20:18 devstack sudo[91195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:18 devstack sudo[91187]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:18 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-f90af487-abe5-422b-b1aa-e0fddb488184 tempest-SnapshotDependencyTests-797137213 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-591f6681-dd5b-457f-8c20-9bb6ef7fe4f9" returned: 0 in 0.490s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:18 devstack cinder-volume[83345]: DEBUG cinder.utils [None req-f90af487-abe5-422b-b1aa-e0fddb488184 tempest-SnapshotDependencyTests-797137213 None] Path /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-5b0e240c-897c-43cb-8e50-7218c4554f06 not found in is_blk_device check {{(pid=83345) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 10 13:20:18 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-f90af487-abe5-422b-b1aa-e0fddb488184 tempest-SnapshotDependencyTests-797137213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-591f6681-dd5b-457f-8c20-9bb6ef7fe4f9 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-5b0e240c-897c-43cb-8e50-7218c4554f06 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:18 devstack sudo[91197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-591f6681-dd5b-457f-8c20-9bb6ef7fe4f9 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-5b0e240c-897c-43cb-8e50-7218c4554f06
Apr 10 13:20:18 devstack sudo[91197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:19 devstack sudo[91189]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:19 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-55dc7dd4-81b7-4fff-b69a-478ad6918adf tempest-CreateVolumesFromSourceVolumeTest-218806783 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-88413f28-fbec-426e-a343-0ed2e3ce0364" returned: 0 in 0.585s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:19 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-55dc7dd4-81b7-4fff-b69a-478ad6918adf tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-88413f28-fbec-426e-a343-0ed2e3ce0364 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:19 devstack sudo[91208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-88413f28-fbec-426e-a343-0ed2e3ce0364
Apr 10 13:20:19 devstack sudo[91208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:19 devstack sudo[91195]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:19 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-abad4fb2-7db5-4f28-afaa-7e560241f228 tempest-CreateVolumesFromSnapshotTest-1784307287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.510s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:19 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-abad4fb2-7db5-4f28-afaa-7e560241f228 tempest-CreateVolumesFromSnapshotTest-1784307287 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:20:19 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-abad4fb2-7db5-4f28-afaa-7e560241f228 tempest-CreateVolumesFromSnapshotTest-1784307287 None] Deleted volume successfully.
Apr 10 13:20:19 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-abad4fb2-7db5-4f28-afaa-7e560241f228 tempest-CreateVolumesFromSnapshotTest-1784307287 None] Lock "cinder-2529db32-32c8-4010-a67c-17c41254c290-delete_volume" released by "delete_volume" :: held 1.624s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:20:19 devstack sudo[91208]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:19 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-55dc7dd4-81b7-4fff-b69a-478ad6918adf tempest-CreateVolumesFromSourceVolumeTest-218806783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-88413f28-fbec-426e-a343-0ed2e3ce0364" returned: 0 in 0.681s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:19 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-55dc7dd4-81b7-4fff-b69a-478ad6918adf tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Lock "cinder-quobyte-88413f28-fbec-426e-a343-0ed2e3ce0364" released by "delete_volume" :: held 1.301s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:20:19 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-55dc7dd4-81b7-4fff-b69a-478ad6918adf tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Created reservations ['48e839fd-7904-4a3c-8eac-ab5052e3f47f', '169e80f3-f13c-4222-a143-de5e07ba2332', '63dbd42c-e851-4e16-a649-bfcc16689315', '5560590b-2618-47b6-aebd-ab6cae7d1b9e'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:20:19 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-55dc7dd4-81b7-4fff-b69a-478ad6918adf tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:20:19 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-55dc7dd4-81b7-4fff-b69a-478ad6918adf tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:20:19 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-55dc7dd4-81b7-4fff-b69a-478ad6918adf tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:20:19 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-55dc7dd4-81b7-4fff-b69a-478ad6918adf tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:20:19 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-55dc7dd4-81b7-4fff-b69a-478ad6918adf tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:20:19 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-55dc7dd4-81b7-4fff-b69a-478ad6918adf tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:19 devstack sudo[91223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:20:19 devstack sudo[91223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:20 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-2f9594f3-b397-46b8-97d9-be5b4052e566 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Acquiring lock "cinder-7919532b-9016-4e5a-b1fa-3d5c45a94cc7-delete_volume" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:20:20 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-2f9594f3-b397-46b8-97d9-be5b4052e566 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Lock "cinder-7919532b-9016-4e5a-b1fa-3d5c45a94cc7-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:20:20 devstack sudo[91223]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:20 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-55dc7dd4-81b7-4fff-b69a-478ad6918adf tempest-CreateVolumesFromSourceVolumeTest-218806783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.996s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:20 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-55dc7dd4-81b7-4fff-b69a-478ad6918adf tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:20:20 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-55dc7dd4-81b7-4fff-b69a-478ad6918adf tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Deleted volume successfully.
Apr 10 13:20:20 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-2f9594f3-b397-46b8-97d9-be5b4052e566 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Acquiring lock "cinder-quobyte-7919532b-9016-4e5a-b1fa-3d5c45a94cc7" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:20:21 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-55dc7dd4-81b7-4fff-b69a-478ad6918adf tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Lock "cinder-88413f28-fbec-426e-a343-0ed2e3ce0364-delete_volume" released by "delete_volume" :: held 2.627s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:20:21 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-2f9594f3-b397-46b8-97d9-be5b4052e566 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Lock "cinder-quobyte-7919532b-9016-4e5a-b1fa-3d5c45a94cc7" acquired by "delete_volume" :: waited 0.029s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:20:21 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[d32bbe22-461a-43e0-9bd5-8e1ac01e9785]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:20:21 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-2f9594f3-b397-46b8-97d9-be5b4052e566 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7919532b-9016-4e5a-b1fa-3d5c45a94cc7 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:21 devstack sudo[91226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7919532b-9016-4e5a-b1fa-3d5c45a94cc7
Apr 10 13:20:21 devstack sudo[91226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:21 devstack sudo[91197]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:21 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-f90af487-abe5-422b-b1aa-e0fddb488184 tempest-SnapshotDependencyTests-797137213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-591f6681-dd5b-457f-8c20-9bb6ef7fe4f9 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-5b0e240c-897c-43cb-8e50-7218c4554f06" returned: 0 in 2.544s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:21 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b802299-e62b-4e6e-9d20-d0ae90d5116f]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:20:21 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-f90af487-abe5-422b-b1aa-e0fddb488184 tempest-SnapshotDependencyTests-797137213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-591f6681-dd5b-457f-8c20-9bb6ef7fe4f9 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:21 devstack sudo[91228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-591f6681-dd5b-457f-8c20-9bb6ef7fe4f9
Apr 10 13:20:21 devstack sudo[91228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:21 devstack sudo[91226]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:21 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-2f9594f3-b397-46b8-97d9-be5b4052e566 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7919532b-9016-4e5a-b1fa-3d5c45a94cc7" returned: 0 in 0.566s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:21 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-2f9594f3-b397-46b8-97d9-be5b4052e566 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7919532b-9016-4e5a-b1fa-3d5c45a94cc7 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:21 devstack sudo[91234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7919532b-9016-4e5a-b1fa-3d5c45a94cc7
Apr 10 13:20:21 devstack sudo[91234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:21 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-56973308-d0a1-40b4-ac4e-806493d62d78 tempest-CinderUnicodeTest-30520849 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:20:21 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-56973308-d0a1-40b4-ac4e-806493d62d78 tempest-CinderUnicodeTest-30520849 None] Flow 'volume_create_manager' (162b1ead-b0b8-4963-be98-77556dbe9cd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:20:21 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-56973308-d0a1-40b4-ac4e-806493d62d78 tempest-CinderUnicodeTest-30520849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40103f85-853a-49c7-9bdd-b1ec9a2c8e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:20:21 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-56973308-d0a1-40b4-ac4e-806493d62d78 tempest-CinderUnicodeTest-30520849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40103f85-853a-49c7-9bdd-b1ec9a2c8e83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:20:22Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=300bc2c2-6522-4821-8413-42934dc1a554,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e79389e5bc54e33a53249eff3ff2be9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:20:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:20:22Z,use_quota=True,user_id='9f9e7e2ccefa4f8fabe7e3c5e3e91894',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:20:21 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-56973308-d0a1-40b4-ac4e-806493d62d78 tempest-CinderUnicodeTest-30520849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1c6aaee-2df7-435b-b1d2-1bd9b6e62cf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:20:21 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-56973308-d0a1-40b4-ac4e-806493d62d78 tempest-CinderUnicodeTest-30520849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1c6aaee-2df7-435b-b1d2-1bd9b6e62cf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:20:21 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-56973308-d0a1-40b4-ac4e-806493d62d78 tempest-CinderUnicodeTest-30520849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3655800-7fdc-4811-a853-3a23d7b56f9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:20:21 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-56973308-d0a1-40b4-ac4e-806493d62d78 tempest-CinderUnicodeTest-30520849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3655800-7fdc-4811-a853-3a23d7b56f9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '300bc2c2-6522-4821-8413-42934dc1a554', 'volume_name': 'volume-300bc2c2-6522-4821-8413-42934dc1a554', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:20:21 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-56973308-d0a1-40b4-ac4e-806493d62d78 tempest-CinderUnicodeTest-30520849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ffd79da-13f4-4837-9489-7ba734d6f392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:20:21 devstack sudo[91228]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:21 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-56973308-d0a1-40b4-ac4e-806493d62d78 tempest-CinderUnicodeTest-30520849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ffd79da-13f4-4837-9489-7ba734d6f392) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:20:21 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-56973308-d0a1-40b4-ac4e-806493d62d78 tempest-CinderUnicodeTest-30520849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b009b5e-7485-4174-a3e2-90e6a0c34e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:20:21 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-56973308-d0a1-40b4-ac4e-806493d62d78 tempest-CinderUnicodeTest-30520849 None] Volume 300bc2c2-6522-4821-8413-42934dc1a554: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-300bc2c2-6522-4821-8413-42934dc1a554', 'volume_size': 1}
Apr 10 13:20:21 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-56973308-d0a1-40b4-ac4e-806493d62d78 tempest-CinderUnicodeTest-30520849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:20:22 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-f90af487-abe5-422b-b1aa-e0fddb488184 tempest-SnapshotDependencyTests-797137213 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-591f6681-dd5b-457f-8c20-9bb6ef7fe4f9" returned: 0 in 0.710s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:22 devstack cinder-volume[83345]: DEBUG cinder.image.image_utils [None req-f90af487-abe5-422b-b1aa-e0fddb488184 tempest-SnapshotDependencyTests-797137213 None] Image conversion details: src /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-591f6681-dd5b-457f-8c20-9bb6ef7fe4f9, size 1024.00 MB, duration 2.55 sec, destination /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-5b0e240c-897c-43cb-8e50-7218c4554f06 {{(pid=83345) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 10 13:20:22 devstack cinder-volume[83345]: INFO cinder.image.image_utils [None req-f90af487-abe5-422b-b1aa-e0fddb488184 tempest-SnapshotDependencyTests-797137213 None] Converted 1024.00 MB image at 402.30 MB/s
Apr 10 13:20:22 devstack cinder-volume[83345]: WARNING cinder.volume.drivers.remotefs [None req-f90af487-abe5-422b-b1aa-e0fddb488184 tempest-SnapshotDependencyTests-797137213 None] /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-5b0e240c-897c-43cb-8e50-7218c4554f06 is being set with open permissions: ugo+rw
Apr 10 13:20:22 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-f90af487-abe5-422b-b1aa-e0fddb488184 tempest-SnapshotDependencyTests-797137213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-5b0e240c-897c-43cb-8e50-7218c4554f06 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:22 devstack sudo[91240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-5b0e240c-897c-43cb-8e50-7218c4554f06
Apr 10 13:20:22 devstack sudo[91240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:22 devstack sudo[91234]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:22 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-2f9594f3-b397-46b8-97d9-be5b4052e566 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-7919532b-9016-4e5a-b1fa-3d5c45a94cc7" returned: 0 in 0.459s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:22 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-2f9594f3-b397-46b8-97d9-be5b4052e566 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Lock "cinder-quobyte-7919532b-9016-4e5a-b1fa-3d5c45a94cc7" released by "delete_volume" :: held 1.073s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:20:22 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-2f9594f3-b397-46b8-97d9-be5b4052e566 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Created reservations ['67d38a49-8572-4f3d-81e8-47f15a62f9e3', '575581f7-1a87-42cd-94d8-b5c38228e416', '8ff4424f-91aa-4790-89b4-33eeac12e633', '6b122859-913f-4cd4-a68a-d49f44610632'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:20:22 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-2f9594f3-b397-46b8-97d9-be5b4052e566 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:20:22 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-2f9594f3-b397-46b8-97d9-be5b4052e566 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:20:22 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-2f9594f3-b397-46b8-97d9-be5b4052e566 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:20:22 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-2f9594f3-b397-46b8-97d9-be5b4052e566 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:20:22 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-2f9594f3-b397-46b8-97d9-be5b4052e566 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:20:22 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-2f9594f3-b397-46b8-97d9-be5b4052e566 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:22 devstack sudo[91242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:20:22 devstack sudo[91242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:22 devstack sudo[91240]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:22 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-f90af487-abe5-422b-b1aa-e0fddb488184 tempest-SnapshotDependencyTests-797137213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-5b0e240c-897c-43cb-8e50-7218c4554f06" returned: 0 in 0.422s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:22 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-f90af487-abe5-422b-b1aa-e0fddb488184 tempest-SnapshotDependencyTests-797137213 None] Lock "cinder-quobyte-5b0e240c-897c-43cb-8e50-7218c4554f06" released by "_copy_volume_from_snapshot" :: held 4.701s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:20:22 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-f90af487-abe5-422b-b1aa-e0fddb488184 tempest-SnapshotDependencyTests-797137213 None] Lock "cinder-quobyte-6922111d-0450-4d51-9371-e876e978d866-5b0e240c-897c-43cb-8e50-7218c4554f06" released by "_create_volume_from_snapshot" :: held 4.733s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:20:22 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-f90af487-abe5-422b-b1aa-e0fddb488184 tempest-SnapshotDependencyTests-797137213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.772s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:20:22 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-da110d11-3335-463b-8101-fd336a9350de tempest-VolumeDependencyTests-1052055728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.498s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:20:22 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-da110d11-3335-463b-8101-fd336a9350de tempest-VolumeDependencyTests-1052055728 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f252bf08b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:20:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-331300883',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5686dcff-f611-4b23-9d50-7f6a8d858c55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b860b753090645ad91f52b3e138634de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:20:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:20:15Z,use_quota=True,user_id='866c4ed007134f509b6d0152fa189d0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)}" {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 13:20:22 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-da110d11-3335-463b-8101-fd336a9350de tempest-VolumeDependencyTests-1052055728 None] Creating volume 5686dcff-f611-4b23-9d50-7f6a8d858c55 {{(pid=83345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 13:20:22 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-da110d11-3335-463b-8101-fd336a9350de tempest-VolumeDependencyTests-1052055728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:20:22 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-da110d11-3335-463b-8101-fd336a9350de tempest-VolumeDependencyTests-1052055728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:20:22 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-da110d11-3335-463b-8101-fd336a9350de tempest-VolumeDependencyTests-1052055728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:20:22 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-da110d11-3335-463b-8101-fd336a9350de tempest-VolumeDependencyTests-1052055728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:20:22 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-da110d11-3335-463b-8101-fd336a9350de tempest-VolumeDependencyTests-1052055728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:20:22 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-da110d11-3335-463b-8101-fd336a9350de tempest-VolumeDependencyTests-1052055728 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:20:22 devstack cinder-volume[83345]: INFO cinder.volume.drivers.remotefs [None req-da110d11-3335-463b-8101-fd336a9350de tempest-VolumeDependencyTests-1052055728 None] casted to osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331
Apr 10 13:20:22 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-da110d11-3335-463b-8101-fd336a9350de tempest-VolumeDependencyTests-1052055728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-5686dcff-f611-4b23-9d50-7f6a8d858c55 1073741824 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:22 devstack sudo[91245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-5686dcff-f611-4b23-9d50-7f6a8d858c55 1073741824
Apr 10 13:20:22 devstack sudo[91245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:22 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-f90af487-abe5-422b-b1aa-e0fddb488184 tempest-SnapshotDependencyTests-797137213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4977e749-6696-4e6d-92ee-3c8cc07632c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b0e240c-897c-43cb-8e50-7218c4554f06', 'volume_size': 1, 'snapshot_id': '6922111d-0450-4d51-9371-e876e978d866'}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:20:22 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-f90af487-abe5-422b-b1aa-e0fddb488184 tempest-SnapshotDependencyTests-797137213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4c11906-b966-4c22-a7c8-5e31b997bba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:20:22 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-f90af487-abe5-422b-b1aa-e0fddb488184 tempest-SnapshotDependencyTests-797137213 None] Volume volume-5b0e240c-897c-43cb-8e50-7218c4554f06 (5b0e240c-897c-43cb-8e50-7218c4554f06): created successfully
Apr 10 13:20:22 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-f90af487-abe5-422b-b1aa-e0fddb488184 tempest-SnapshotDependencyTests-797137213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4c11906-b966-4c22-a7c8-5e31b997bba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:20:22 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-f90af487-abe5-422b-b1aa-e0fddb488184 tempest-SnapshotDependencyTests-797137213 None] Flow 'volume_create_manager' (3bab4e84-3094-4614-bc17-1dec6693bf0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:20:22 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-f90af487-abe5-422b-b1aa-e0fddb488184 tempest-SnapshotDependencyTests-797137213 None] Created volume successfully.
Apr 10 13:20:22 devstack sudo[91242]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:22 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-2f9594f3-b397-46b8-97d9-be5b4052e566 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.432s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:22 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-2f9594f3-b397-46b8-97d9-be5b4052e566 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:20:22 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-2f9594f3-b397-46b8-97d9-be5b4052e566 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Deleted volume successfully.
Apr 10 13:20:22 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-2f9594f3-b397-46b8-97d9-be5b4052e566 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Lock "cinder-7919532b-9016-4e5a-b1fa-3d5c45a94cc7-delete_volume" released by "delete_volume" :: held 1.774s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:20:22 devstack sudo[91245]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:22 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-da110d11-3335-463b-8101-fd336a9350de tempest-VolumeDependencyTests-1052055728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-5686dcff-f611-4b23-9d50-7f6a8d858c55 1073741824" returned: 0 in 0.473s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:22 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-da110d11-3335-463b-8101-fd336a9350de tempest-VolumeDependencyTests-1052055728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-5686dcff-f611-4b23-9d50-7f6a8d858c55 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:22 devstack sudo[91252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-5686dcff-f611-4b23-9d50-7f6a8d858c55
Apr 10 13:20:22 devstack sudo[91252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:23 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-ec302edd-a778-4178-89cb-a31eac232440 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Acquiring lock "cinder-437e3fe8-b0d8-48f5-a19b-65adc8a52edb-delete_volume" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:20:23 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-ec302edd-a778-4178-89cb-a31eac232440 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Lock "cinder-437e3fe8-b0d8-48f5-a19b-65adc8a52edb-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:20:23 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-ec302edd-a778-4178-89cb-a31eac232440 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Acquiring lock "cinder-quobyte-437e3fe8-b0d8-48f5-a19b-65adc8a52edb" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:20:23 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-ec302edd-a778-4178-89cb-a31eac232440 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Lock "cinder-quobyte-437e3fe8-b0d8-48f5-a19b-65adc8a52edb" acquired by "delete_volume" :: waited 0.007s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:20:23 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1d30f0c-9e44-4592-bba6-63072130d55e]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:20:23 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ec302edd-a778-4178-89cb-a31eac232440 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-437e3fe8-b0d8-48f5-a19b-65adc8a52edb {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:23 devstack sudo[91254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-437e3fe8-b0d8-48f5-a19b-65adc8a52edb
Apr 10 13:20:23 devstack sudo[91254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:23 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-6bc66f2e-9cb6-4d48-b62b-b8a30d67c189 tempest-SnapshotDependencyTests-797137213 None] Acquiring lock "cinder-6922111d-0450-4d51-9371-e876e978d866-delete_snapshot" by "delete_snapshot" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:20:23 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-6bc66f2e-9cb6-4d48-b62b-b8a30d67c189 tempest-SnapshotDependencyTests-797137213 None] Lock "cinder-6922111d-0450-4d51-9371-e876e978d866-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:20:23 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-6bc66f2e-9cb6-4d48-b62b-b8a30d67c189 tempest-SnapshotDependencyTests-797137213 None] Acquiring lock "cinder-quobyte-591f6681-dd5b-457f-8c20-9bb6ef7fe4f9" by "delete_snapshot" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:20:23 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-6bc66f2e-9cb6-4d48-b62b-b8a30d67c189 tempest-SnapshotDependencyTests-797137213 None] Lock "cinder-quobyte-591f6681-dd5b-457f-8c20-9bb6ef7fe4f9" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:20:23 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-6bc66f2e-9cb6-4d48-b62b-b8a30d67c189 tempest-SnapshotDependencyTests-797137213 None] Acquiring lock "cinder-quobyte-6922111d-0450-4d51-9371-e876e978d866" by "_delete_snapshot" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:20:23 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-6bc66f2e-9cb6-4d48-b62b-b8a30d67c189 tempest-SnapshotDependencyTests-797137213 None] Lock "cinder-quobyte-6922111d-0450-4d51-9371-e876e978d866" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:20:23 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-6bc66f2e-9cb6-4d48-b62b-b8a30d67c189 tempest-SnapshotDependencyTests-797137213 None] Deleting offline snapshot 6922111d-0450-4d51-9371-e876e978d866 of volume 591f6681-dd5b-457f-8c20-9bb6ef7fe4f9 {{(pid=83345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 10 13:20:23 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-6bc66f2e-9cb6-4d48-b62b-b8a30d67c189 tempest-SnapshotDependencyTests-797137213 None] snapshot_file for this snap is: volume-591f6681-dd5b-457f-8c20-9bb6ef7fe4f9.6922111d-0450-4d51-9371-e876e978d866 {{(pid=83345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 10 13:20:23 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[8061bcd4-50d0-49a1-a712-a5d5fd5083a1]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:20:23 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-6bc66f2e-9cb6-4d48-b62b-b8a30d67c189 tempest-SnapshotDependencyTests-797137213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-591f6681-dd5b-457f-8c20-9bb6ef7fe4f9.6922111d-0450-4d51-9371-e876e978d866 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:23 devstack sudo[91256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-591f6681-dd5b-457f-8c20-9bb6ef7fe4f9.6922111d-0450-4d51-9371-e876e978d866
Apr 10 13:20:23 devstack sudo[91256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:23 devstack sudo[91252]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:23 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-da110d11-3335-463b-8101-fd336a9350de tempest-VolumeDependencyTests-1052055728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-5686dcff-f611-4b23-9d50-7f6a8d858c55" returned: 0 in 0.458s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:23 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-da110d11-3335-463b-8101-fd336a9350de tempest-VolumeDependencyTests-1052055728 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'} {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 13:20:23 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-da110d11-3335-463b-8101-fd336a9350de tempest-VolumeDependencyTests-1052055728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:20:23 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-56973308-d0a1-40b4-ac4e-806493d62d78 tempest-CinderUnicodeTest-30520849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.401s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:20:23 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-56973308-d0a1-40b4-ac4e-806493d62d78 tempest-CinderUnicodeTest-30520849 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f252bf08b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:20:22Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=300bc2c2-6522-4821-8413-42934dc1a554,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e79389e5bc54e33a53249eff3ff2be9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:20:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:20:22Z,use_quota=True,user_id='9f9e7e2ccefa4f8fabe7e3c5e3e91894',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)}" {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 13:20:23 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-56973308-d0a1-40b4-ac4e-806493d62d78 tempest-CinderUnicodeTest-30520849 None] Creating volume 300bc2c2-6522-4821-8413-42934dc1a554 {{(pid=83345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 13:20:23 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-56973308-d0a1-40b4-ac4e-806493d62d78 tempest-CinderUnicodeTest-30520849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:20:23 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-56973308-d0a1-40b4-ac4e-806493d62d78 tempest-CinderUnicodeTest-30520849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:20:23 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-56973308-d0a1-40b4-ac4e-806493d62d78 tempest-CinderUnicodeTest-30520849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:20:23 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-56973308-d0a1-40b4-ac4e-806493d62d78 tempest-CinderUnicodeTest-30520849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:20:23 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-56973308-d0a1-40b4-ac4e-806493d62d78 tempest-CinderUnicodeTest-30520849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:20:23 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-56973308-d0a1-40b4-ac4e-806493d62d78 tempest-CinderUnicodeTest-30520849 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:20:23 devstack cinder-volume[83345]: INFO cinder.volume.drivers.remotefs [None req-56973308-d0a1-40b4-ac4e-806493d62d78 tempest-CinderUnicodeTest-30520849 None] casted to osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331
Apr 10 13:20:23 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-56973308-d0a1-40b4-ac4e-806493d62d78 tempest-CinderUnicodeTest-30520849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-300bc2c2-6522-4821-8413-42934dc1a554 1073741824 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:23 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-da110d11-3335-463b-8101-fd336a9350de tempest-VolumeDependencyTests-1052055728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46d0be0b-1657-41b0-97ae-c2636b2a2006) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5686dcff-f611-4b23-9d50-7f6a8d858c55', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:20:23 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-da110d11-3335-463b-8101-fd336a9350de tempest-VolumeDependencyTests-1052055728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e7aea79-6041-4fd1-b8e1-f5880e795d57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:20:23 devstack sudo[91259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-300bc2c2-6522-4821-8413-42934dc1a554 1073741824
Apr 10 13:20:23 devstack sudo[91259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:23 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-da110d11-3335-463b-8101-fd336a9350de tempest-VolumeDependencyTests-1052055728 None] Volume volume-5686dcff-f611-4b23-9d50-7f6a8d858c55 (5686dcff-f611-4b23-9d50-7f6a8d858c55): created successfully
Apr 10 13:20:23 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-da110d11-3335-463b-8101-fd336a9350de tempest-VolumeDependencyTests-1052055728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e7aea79-6041-4fd1-b8e1-f5880e795d57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:20:23 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-da110d11-3335-463b-8101-fd336a9350de tempest-VolumeDependencyTests-1052055728 None] Flow 'volume_create_manager' (95033646-9052-488e-99a0-f6757b4bd2b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:20:23 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-da110d11-3335-463b-8101-fd336a9350de tempest-VolumeDependencyTests-1052055728 None] Created volume successfully.
Apr 10 13:20:23 devstack sudo[91254]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:23 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ec302edd-a778-4178-89cb-a31eac232440 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-437e3fe8-b0d8-48f5-a19b-65adc8a52edb" returned: 0 in 0.512s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:23 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ec302edd-a778-4178-89cb-a31eac232440 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-437e3fe8-b0d8-48f5-a19b-65adc8a52edb {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:23 devstack sudo[91264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-437e3fe8-b0d8-48f5-a19b-65adc8a52edb
Apr 10 13:20:23 devstack sudo[91264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:23 devstack sudo[91256]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:23 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-6bc66f2e-9cb6-4d48-b62b-b8a30d67c189 tempest-SnapshotDependencyTests-797137213 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-591f6681-dd5b-457f-8c20-9bb6ef7fe4f9.6922111d-0450-4d51-9371-e876e978d866" returned: 0 in 0.481s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:23 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-6bc66f2e-9cb6-4d48-b62b-b8a30d67c189 tempest-SnapshotDependencyTests-797137213 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-591f6681-dd5b-457f-8c20-9bb6ef7fe4f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 13:20:23 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[c56a1ae6-a686-435e-814c-bd90a727400a]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:20:23 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-6bc66f2e-9cb6-4d48-b62b-b8a30d67c189 tempest-SnapshotDependencyTests-797137213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-591f6681-dd5b-457f-8c20-9bb6ef7fe4f9 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:23 devstack sudo[91272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-591f6681-dd5b-457f-8c20-9bb6ef7fe4f9
Apr 10 13:20:23 devstack sudo[91272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:23 devstack sudo[91259]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:23 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-56973308-d0a1-40b4-ac4e-806493d62d78 tempest-CinderUnicodeTest-30520849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-300bc2c2-6522-4821-8413-42934dc1a554 1073741824" returned: 0 in 0.507s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:23 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-56973308-d0a1-40b4-ac4e-806493d62d78 tempest-CinderUnicodeTest-30520849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-300bc2c2-6522-4821-8413-42934dc1a554 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:23 devstack sudo[91274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-300bc2c2-6522-4821-8413-42934dc1a554
Apr 10 13:20:23 devstack sudo[91274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:24 devstack sudo[91264]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:24 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ec302edd-a778-4178-89cb-a31eac232440 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-437e3fe8-b0d8-48f5-a19b-65adc8a52edb" returned: 0 in 0.446s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:24 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-ec302edd-a778-4178-89cb-a31eac232440 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Lock "cinder-quobyte-437e3fe8-b0d8-48f5-a19b-65adc8a52edb" released by "delete_volume" :: held 0.991s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:20:24 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-ec302edd-a778-4178-89cb-a31eac232440 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Created reservations ['466e8e27-54b2-4019-a1fc-181f5781b49d', '5e49707f-1d92-4120-8b0c-91d6fc8f43b9', 'e873b675-7889-45cf-85ab-57933496c2e3', '4dcced61-c7b0-46ea-a17a-60f89f69bf51'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:20:24 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-ec302edd-a778-4178-89cb-a31eac232440 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:20:24 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-ec302edd-a778-4178-89cb-a31eac232440 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:20:24 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-ec302edd-a778-4178-89cb-a31eac232440 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:20:24 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-ec302edd-a778-4178-89cb-a31eac232440 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:20:24 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-ec302edd-a778-4178-89cb-a31eac232440 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:20:24 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ec302edd-a778-4178-89cb-a31eac232440 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:24 devstack sudo[91278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:20:24 devstack sudo[91278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:24 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-373f22d6-30f6-4282-ad37-f39cbf8e3a39 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Acquiring lock "cinder-e95469fe-2dca-407e-a3b3-edbdf5ac5dfb-delete_volume" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:20:24 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-373f22d6-30f6-4282-ad37-f39cbf8e3a39 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Lock "cinder-e95469fe-2dca-407e-a3b3-edbdf5ac5dfb-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:20:24 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-373f22d6-30f6-4282-ad37-f39cbf8e3a39 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Acquiring lock "cinder-quobyte-e95469fe-2dca-407e-a3b3-edbdf5ac5dfb" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:20:24 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-373f22d6-30f6-4282-ad37-f39cbf8e3a39 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Lock "cinder-quobyte-e95469fe-2dca-407e-a3b3-edbdf5ac5dfb" acquired by "delete_volume" :: waited 0.009s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:20:24 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f240212-7842-4e30-852c-116613e6ee75]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:20:24 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-373f22d6-30f6-4282-ad37-f39cbf8e3a39 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e95469fe-2dca-407e-a3b3-edbdf5ac5dfb {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:24 devstack sudo[91272]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:24 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-6bc66f2e-9cb6-4d48-b62b-b8a30d67c189 tempest-SnapshotDependencyTests-797137213 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-591f6681-dd5b-457f-8c20-9bb6ef7fe4f9" returned: 0 in 0.532s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:24 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-6bc66f2e-9cb6-4d48-b62b-b8a30d67c189 tempest-SnapshotDependencyTests-797137213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-591f6681-dd5b-457f-8c20-9bb6ef7fe4f9.6922111d-0450-4d51-9371-e876e978d866 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:24 devstack sudo[91283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-591f6681-dd5b-457f-8c20-9bb6ef7fe4f9.6922111d-0450-4d51-9371-e876e978d866
Apr 10 13:20:24 devstack sudo[91283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:24 devstack sudo[91282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e95469fe-2dca-407e-a3b3-edbdf5ac5dfb
Apr 10 13:20:24 devstack sudo[91282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:24 devstack sudo[91274]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:24 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-56973308-d0a1-40b4-ac4e-806493d62d78 tempest-CinderUnicodeTest-30520849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-300bc2c2-6522-4821-8413-42934dc1a554" returned: 0 in 0.515s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:24 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-56973308-d0a1-40b4-ac4e-806493d62d78 tempest-CinderUnicodeTest-30520849 None] <== create_volume: return (1049ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'} {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 13:20:24 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-56973308-d0a1-40b4-ac4e-806493d62d78 tempest-CinderUnicodeTest-30520849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.053s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:20:24 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-56973308-d0a1-40b4-ac4e-806493d62d78 tempest-CinderUnicodeTest-30520849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b009b5e-7485-4174-a3e2-90e6a0c34e31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-300bc2c2-6522-4821-8413-42934dc1a554', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:20:24 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-56973308-d0a1-40b4-ac4e-806493d62d78 tempest-CinderUnicodeTest-30520849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b86d7520-86ba-4106-8370-3d84fcd4fe7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:20:24 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-56973308-d0a1-40b4-ac4e-806493d62d78 tempest-CinderUnicodeTest-30520849 None] Volume volume-300bc2c2-6522-4821-8413-42934dc1a554 (300bc2c2-6522-4821-8413-42934dc1a554): created successfully
Apr 10 13:20:24 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-56973308-d0a1-40b4-ac4e-806493d62d78 tempest-CinderUnicodeTest-30520849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b86d7520-86ba-4106-8370-3d84fcd4fe7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:20:24 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-56973308-d0a1-40b4-ac4e-806493d62d78 tempest-CinderUnicodeTest-30520849 None] Flow 'volume_create_manager' (162b1ead-b0b8-4963-be98-77556dbe9cd7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:20:24 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-56973308-d0a1-40b4-ac4e-806493d62d78 tempest-CinderUnicodeTest-30520849 None] Created volume successfully.
Apr 10 13:20:24 devstack sudo[91278]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:24 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-ec302edd-a778-4178-89cb-a31eac232440 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.492s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:24 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-ec302edd-a778-4178-89cb-a31eac232440 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:20:24 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-ec302edd-a778-4178-89cb-a31eac232440 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Deleted volume successfully.
Apr 10 13:20:24 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-ec302edd-a778-4178-89cb-a31eac232440 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Lock "cinder-437e3fe8-b0d8-48f5-a19b-65adc8a52edb-delete_volume" released by "delete_volume" :: held 1.606s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:20:24 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-41050f16-cbe3-499d-9f82-5f2579f32463 tempest-VolumeDependencyTests-1052055728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:20:24 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-41050f16-cbe3-499d-9f82-5f2579f32463 tempest-VolumeDependencyTests-1052055728 None] Flow 'volume_create_manager' (10e363c4-00dd-4a06-97e9-4d39331b6729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:20:24 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-41050f16-cbe3-499d-9f82-5f2579f32463 tempest-VolumeDependencyTests-1052055728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d5f7411-8624-4912-be45-feede59c54c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:20:24 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-41050f16-cbe3-499d-9f82-5f2579f32463 tempest-VolumeDependencyTests-1052055728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d5f7411-8624-4912-be45-feede59c54c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:20:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-809896373',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69d6564b-70e8-4316-8e1e-b45ccd922f2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b860b753090645ad91f52b3e138634de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:20:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=5686dcff-f611-4b23-9d50-7f6a8d858c55,status='creating',terminated_at=None,updated_at=2026-04-10T11:20:25Z,use_quota=True,user_id='866c4ed007134f509b6d0152fa189d0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:20:24 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-41050f16-cbe3-499d-9f82-5f2579f32463 tempest-VolumeDependencyTests-1052055728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8351b709-e551-4579-8468-cd92e08365c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:20:24 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-41050f16-cbe3-499d-9f82-5f2579f32463 tempest-VolumeDependencyTests-1052055728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8351b709-e551-4579-8468-cd92e08365c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:20:24 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-41050f16-cbe3-499d-9f82-5f2579f32463 tempest-VolumeDependencyTests-1052055728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7e229d4-a664-4e90-bbe1-0992f6bb157e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:20:24 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-41050f16-cbe3-499d-9f82-5f2579f32463 tempest-VolumeDependencyTests-1052055728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7e229d4-a664-4e90-bbe1-0992f6bb157e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '69d6564b-70e8-4316-8e1e-b45ccd922f2c', 'volume_name': 'volume-69d6564b-70e8-4316-8e1e-b45ccd922f2c', 'volume_size': 1, 'source_volid': '5686dcff-f611-4b23-9d50-7f6a8d858c55', 'source_volstatus': 'available'}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:20:24 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-41050f16-cbe3-499d-9f82-5f2579f32463 tempest-VolumeDependencyTests-1052055728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cec7098b-d288-4904-b00d-f40a761804fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:20:24 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-41050f16-cbe3-499d-9f82-5f2579f32463 tempest-VolumeDependencyTests-1052055728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cec7098b-d288-4904-b00d-f40a761804fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:20:24 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-41050f16-cbe3-499d-9f82-5f2579f32463 tempest-VolumeDependencyTests-1052055728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a984f09b-d14f-4f50-b69c-2c2f31e0bf9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:20:24 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-41050f16-cbe3-499d-9f82-5f2579f32463 tempest-VolumeDependencyTests-1052055728 None] Volume 69d6564b-70e8-4316-8e1e-b45ccd922f2c: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-69d6564b-70e8-4316-8e1e-b45ccd922f2c', 'volume_size': 1, 'source_volid': '5686dcff-f611-4b23-9d50-7f6a8d858c55', 'source_volstatus': 'available'}
Apr 10 13:20:24 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-41050f16-cbe3-499d-9f82-5f2579f32463 tempest-VolumeDependencyTests-1052055728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:20:24 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-41050f16-cbe3-499d-9f82-5f2579f32463 tempest-VolumeDependencyTests-1052055728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:20:24 devstack cinder-volume[83345]: INFO cinder.volume.drivers.remotefs [None req-41050f16-cbe3-499d-9f82-5f2579f32463 tempest-VolumeDependencyTests-1052055728 None] Cloning volume 5686dcff-f611-4b23-9d50-7f6a8d858c55 to volume 69d6564b-70e8-4316-8e1e-b45ccd922f2c
Apr 10 13:20:24 devstack sudo[91282]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:24 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-373f22d6-30f6-4282-ad37-f39cbf8e3a39 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e95469fe-2dca-407e-a3b3-edbdf5ac5dfb" returned: 0 in 0.566s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:24 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-373f22d6-30f6-4282-ad37-f39cbf8e3a39 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e95469fe-2dca-407e-a3b3-edbdf5ac5dfb {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:24 devstack sudo[91283]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:24 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-6bc66f2e-9cb6-4d48-b62b-b8a30d67c189 tempest-SnapshotDependencyTests-797137213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-591f6681-dd5b-457f-8c20-9bb6ef7fe4f9.6922111d-0450-4d51-9371-e876e978d866" returned: 0 in 0.568s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:24 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-6bc66f2e-9cb6-4d48-b62b-b8a30d67c189 tempest-SnapshotDependencyTests-797137213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-591f6681-dd5b-457f-8c20-9bb6ef7fe4f9.6922111d-0450-4d51-9371-e876e978d866 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:24 devstack sudo[91294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e95469fe-2dca-407e-a3b3-edbdf5ac5dfb
Apr 10 13:20:24 devstack sudo[91294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:24 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-41050f16-cbe3-499d-9f82-5f2579f32463 tempest-VolumeDependencyTests-1052055728 None] Creating offline snapshot 0748ecab-8fe7-4793-b711-f195ddef9b43 of volume 5686dcff-f611-4b23-9d50-7f6a8d858c55 {{(pid=83345) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 10 13:20:24 devstack sudo[91296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-591f6681-dd5b-457f-8c20-9bb6ef7fe4f9.6922111d-0450-4d51-9371-e876e978d866
Apr 10 13:20:24 devstack sudo[91296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:24 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[a901a432-65ae-4510-a381-ac409196ae40]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:20:24 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-41050f16-cbe3-499d-9f82-5f2579f32463 tempest-VolumeDependencyTests-1052055728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-5686dcff-f611-4b23-9d50-7f6a8d858c55 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:24 devstack sudo[91298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-5686dcff-f611-4b23-9d50-7f6a8d858c55
Apr 10 13:20:24 devstack sudo[91298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:25 devstack sudo[91294]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:25 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-373f22d6-30f6-4282-ad37-f39cbf8e3a39 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-e95469fe-2dca-407e-a3b3-edbdf5ac5dfb" returned: 0 in 0.465s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:25 devstack sudo[91296]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:25 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-373f22d6-30f6-4282-ad37-f39cbf8e3a39 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Lock "cinder-quobyte-e95469fe-2dca-407e-a3b3-edbdf5ac5dfb" released by "delete_volume" :: held 1.067s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:20:25 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-6bc66f2e-9cb6-4d48-b62b-b8a30d67c189 tempest-SnapshotDependencyTests-797137213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-591f6681-dd5b-457f-8c20-9bb6ef7fe4f9.6922111d-0450-4d51-9371-e876e978d866" returned: 0 in 0.471s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:25 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-6bc66f2e-9cb6-4d48-b62b-b8a30d67c189 tempest-SnapshotDependencyTests-797137213 None] Lock "cinder-quobyte-6922111d-0450-4d51-9371-e876e978d866" released by "_delete_snapshot" :: held 2.128s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:20:25 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-6bc66f2e-9cb6-4d48-b62b-b8a30d67c189 tempest-SnapshotDependencyTests-797137213 None] Lock "cinder-quobyte-591f6681-dd5b-457f-8c20-9bb6ef7fe4f9" released by "delete_snapshot" :: held 2.149s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:20:25 devstack cinder-volume[83345]: DEBUG cinder.volume.flows.manager.create_volume [None req-18f42218-21db-4652-989b-e479fe410a4b tempest-CinderUnicodeTest-30520849 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 10 13:20:25 devstack sudo[91298]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:25 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-18f42218-21db-4652-989b-e479fe410a4b tempest-CinderUnicodeTest-30520849 None] Flow 'volume_create_manager' (9eebf481-64dc-4091-86e7-b750df0f5d0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:20:25 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-18f42218-21db-4652-989b-e479fe410a4b tempest-CinderUnicodeTest-30520849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cb7ab95-6a0e-4abd-87d2-361636310648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:20:25 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-373f22d6-30f6-4282-ad37-f39cbf8e3a39 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Created reservations ['e5d338ce-8bb1-4511-9991-1377a3657650', '29b63898-e3dd-4353-a1b3-6b3ca4533e4e', '9f8b10dc-0fb2-448f-864a-705bab60633d', '392e791a-52f1-47a6-a167-dc635bf3c235'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:20:25 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-41050f16-cbe3-499d-9f82-5f2579f32463 tempest-VolumeDependencyTests-1052055728 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-5686dcff-f611-4b23-9d50-7f6a8d858c55" returned: 0 in 0.579s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:25 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-41050f16-cbe3-499d-9f82-5f2579f32463 tempest-VolumeDependencyTests-1052055728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-5686dcff-f611-4b23-9d50-7f6a8d858c55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-5686dcff-f611-4b23-9d50-7f6a8d858c55.0748ecab-8fe7-4793-b711-f195ddef9b43 1G {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:25 devstack sudo[91305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-5686dcff-f611-4b23-9d50-7f6a8d858c55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-5686dcff-f611-4b23-9d50-7f6a8d858c55.0748ecab-8fe7-4793-b711-f195ddef9b43 1G
Apr 10 13:20:25 devstack sudo[91305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:25 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-18f42218-21db-4652-989b-e479fe410a4b tempest-CinderUnicodeTest-30520849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cb7ab95-6a0e-4abd-87d2-361636310648) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:20:25Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1674553528',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35423d3b-1715-4589-92fb-20af324218da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e79389e5bc54e33a53249eff3ff2be9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:20:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:20:25Z,use_quota=True,user_id='9f9e7e2ccefa4f8fabe7e3c5e3e91894',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:20:25 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-18f42218-21db-4652-989b-e479fe410a4b tempest-CinderUnicodeTest-30520849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9cad184-5f15-479c-b0e8-090fe6c49e6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:20:25 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-18f42218-21db-4652-989b-e479fe410a4b tempest-CinderUnicodeTest-30520849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9cad184-5f15-479c-b0e8-090fe6c49e6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:20:25 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-18f42218-21db-4652-989b-e479fe410a4b tempest-CinderUnicodeTest-30520849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4aab6f46-f97c-4f99-a691-750aa4855355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:20:25 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-18f42218-21db-4652-989b-e479fe410a4b tempest-CinderUnicodeTest-30520849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4aab6f46-f97c-4f99-a691-750aa4855355) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35423d3b-1715-4589-92fb-20af324218da', 'volume_name': 'volume-35423d3b-1715-4589-92fb-20af324218da', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:20:25 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-18f42218-21db-4652-989b-e479fe410a4b tempest-CinderUnicodeTest-30520849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f65edb22-e471-42b3-b95b-39806570339f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:20:25 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-18f42218-21db-4652-989b-e479fe410a4b tempest-CinderUnicodeTest-30520849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f65edb22-e471-42b3-b95b-39806570339f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:20:25 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-18f42218-21db-4652-989b-e479fe410a4b tempest-CinderUnicodeTest-30520849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75309748-eeaa-4e85-b4b6-dd0a8e2aa49c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:20:25 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-18f42218-21db-4652-989b-e479fe410a4b tempest-CinderUnicodeTest-30520849 None] Volume 35423d3b-1715-4589-92fb-20af324218da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35423d3b-1715-4589-92fb-20af324218da', 'volume_size': 1}
Apr 10 13:20:25 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-18f42218-21db-4652-989b-e479fe410a4b tempest-CinderUnicodeTest-30520849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:20:25 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-373f22d6-30f6-4282-ad37-f39cbf8e3a39 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:20:25 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-373f22d6-30f6-4282-ad37-f39cbf8e3a39 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:20:25 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-373f22d6-30f6-4282-ad37-f39cbf8e3a39 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:20:25 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-373f22d6-30f6-4282-ad37-f39cbf8e3a39 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:20:25 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-373f22d6-30f6-4282-ad37-f39cbf8e3a39 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:20:25 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-373f22d6-30f6-4282-ad37-f39cbf8e3a39 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:25 devstack sudo[91307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:20:25 devstack sudo[91307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:25 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-6bc66f2e-9cb6-4d48-b62b-b8a30d67c189 tempest-SnapshotDependencyTests-797137213 None] Created reservations ['848a924e-a513-4ce5-951d-e7cffbb63ec9', 'b7f74369-7f66-4f32-b8a2-d851b7ad9c11', 'd5154583-dfa3-4ee4-b773-dece60f9d4e0', '5546a8a0-ff45-47f9-8ba0-c70a87465d55'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:20:25 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-6bc66f2e-9cb6-4d48-b62b-b8a30d67c189 tempest-SnapshotDependencyTests-797137213 None] Delete snapshot completed successfully.
Apr 10 13:20:25 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-6bc66f2e-9cb6-4d48-b62b-b8a30d67c189 tempest-SnapshotDependencyTests-797137213 None] Lock "cinder-6922111d-0450-4d51-9371-e876e978d866-delete_snapshot" released by "delete_snapshot" :: held 2.393s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:20:25 devstack sudo[91305]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:25 devstack sudo[91307]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:25 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-41050f16-cbe3-499d-9f82-5f2579f32463 tempest-VolumeDependencyTests-1052055728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-5686dcff-f611-4b23-9d50-7f6a8d858c55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-5686dcff-f611-4b23-9d50-7f6a8d858c55.0748ecab-8fe7-4793-b711-f195ddef9b43 1G" returned: 0 in 0.510s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:25 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-41050f16-cbe3-499d-9f82-5f2579f32463 tempest-VolumeDependencyTests-1052055728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5686dcff-f611-4b23-9d50-7f6a8d858c55 -F qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-5686dcff-f611-4b23-9d50-7f6a8d858c55.0748ecab-8fe7-4793-b711-f195ddef9b43 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:26 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-373f22d6-30f6-4282-ad37-f39cbf8e3a39 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.439s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:26 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-373f22d6-30f6-4282-ad37-f39cbf8e3a39 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:20:26 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-373f22d6-30f6-4282-ad37-f39cbf8e3a39 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Deleted volume successfully.
Apr 10 13:20:26 devstack sudo[91313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5686dcff-f611-4b23-9d50-7f6a8d858c55 -F qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-5686dcff-f611-4b23-9d50-7f6a8d858c55.0748ecab-8fe7-4793-b711-f195ddef9b43
Apr 10 13:20:26 devstack sudo[91313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:26 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-373f22d6-30f6-4282-ad37-f39cbf8e3a39 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Lock "cinder-e95469fe-2dca-407e-a3b3-edbdf5ac5dfb-delete_volume" released by "delete_volume" :: held 1.794s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:20:26 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-a0a3ce24-db2b-4a7c-b943-3ad995daf6fc tempest-SnapshotDependencyTests-797137213 None] Acquiring lock "cinder-591f6681-dd5b-457f-8c20-9bb6ef7fe4f9-delete_volume" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:20:26 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-a0a3ce24-db2b-4a7c-b943-3ad995daf6fc tempest-SnapshotDependencyTests-797137213 None] Lock "cinder-591f6681-dd5b-457f-8c20-9bb6ef7fe4f9-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:20:26 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-a0a3ce24-db2b-4a7c-b943-3ad995daf6fc tempest-SnapshotDependencyTests-797137213 None] Acquiring lock "cinder-quobyte-591f6681-dd5b-457f-8c20-9bb6ef7fe4f9" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:20:26 devstack sudo[91313]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:26 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-41050f16-cbe3-499d-9f82-5f2579f32463 tempest-VolumeDependencyTests-1052055728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5686dcff-f611-4b23-9d50-7f6a8d858c55 -F qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-5686dcff-f611-4b23-9d50-7f6a8d858c55.0748ecab-8fe7-4793-b711-f195ddef9b43" returned: 0 in 0.443s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:26 devstack cinder-volume[83345]: WARNING cinder.volume.drivers.remotefs [None req-41050f16-cbe3-499d-9f82-5f2579f32463 tempest-VolumeDependencyTests-1052055728 None] /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-5686dcff-f611-4b23-9d50-7f6a8d858c55.0748ecab-8fe7-4793-b711-f195ddef9b43 is being set with open permissions: ugo+rw
Apr 10 13:20:26 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-41050f16-cbe3-499d-9f82-5f2579f32463 tempest-VolumeDependencyTests-1052055728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-5686dcff-f611-4b23-9d50-7f6a8d858c55.0748ecab-8fe7-4793-b711-f195ddef9b43 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:26 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-a0a3ce24-db2b-4a7c-b943-3ad995daf6fc tempest-SnapshotDependencyTests-797137213 None] Lock "cinder-quobyte-591f6681-dd5b-457f-8c20-9bb6ef7fe4f9" acquired by "delete_volume" :: waited 0.020s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:20:26 devstack sudo[91318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-5686dcff-f611-4b23-9d50-7f6a8d858c55.0748ecab-8fe7-4793-b711-f195ddef9b43
Apr 10 13:20:26 devstack sudo[91318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:26 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-62b264c6-09db-484a-8232-fdb8cda8f06e tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Acquiring lock "cinder-288a4151-f9a5-484b-8dc0-478dcc49e642-delete_volume" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:20:26 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cd63259-38dc-41a4-8f89-e508e34af2d3]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:20:26 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-a0a3ce24-db2b-4a7c-b943-3ad995daf6fc tempest-SnapshotDependencyTests-797137213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-591f6681-dd5b-457f-8c20-9bb6ef7fe4f9 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:26 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-62b264c6-09db-484a-8232-fdb8cda8f06e tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Lock "cinder-288a4151-f9a5-484b-8dc0-478dcc49e642-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:20:26 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-62b264c6-09db-484a-8232-fdb8cda8f06e tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Acquiring lock "cinder-quobyte-288a4151-f9a5-484b-8dc0-478dcc49e642" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:20:26 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-62b264c6-09db-484a-8232-fdb8cda8f06e tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Lock "cinder-quobyte-288a4151-f9a5-484b-8dc0-478dcc49e642" acquired by "delete_volume" :: waited 0.007s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:20:26 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[0505dcda-31ba-459e-a0e0-d4d895e808a1]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:20:26 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-62b264c6-09db-484a-8232-fdb8cda8f06e tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-288a4151-f9a5-484b-8dc0-478dcc49e642 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:26 devstack sudo[91320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-591f6681-dd5b-457f-8c20-9bb6ef7fe4f9
Apr 10 13:20:26 devstack sudo[91320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:26 devstack sudo[91321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-288a4151-f9a5-484b-8dc0-478dcc49e642
Apr 10 13:20:26 devstack sudo[91321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:26 devstack sudo[91318]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:26 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-41050f16-cbe3-499d-9f82-5f2579f32463 tempest-VolumeDependencyTests-1052055728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-5686dcff-f611-4b23-9d50-7f6a8d858c55.0748ecab-8fe7-4793-b711-f195ddef9b43" returned: 0 in 0.474s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:26 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-41050f16-cbe3-499d-9f82-5f2579f32463 tempest-VolumeDependencyTests-1052055728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-5686dcff-f611-4b23-9d50-7f6a8d858c55.info {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:26 devstack sudo[91328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-5686dcff-f611-4b23-9d50-7f6a8d858c55.info
Apr 10 13:20:26 devstack sudo[91328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:26 devstack sudo[91320]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:26 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-a0a3ce24-db2b-4a7c-b943-3ad995daf6fc tempest-SnapshotDependencyTests-797137213 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-591f6681-dd5b-457f-8c20-9bb6ef7fe4f9" returned: 0 in 0.505s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:26 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-a0a3ce24-db2b-4a7c-b943-3ad995daf6fc tempest-SnapshotDependencyTests-797137213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-591f6681-dd5b-457f-8c20-9bb6ef7fe4f9 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:27 devstack sudo[91333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-591f6681-dd5b-457f-8c20-9bb6ef7fe4f9
Apr 10 13:20:27 devstack sudo[91333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:27 devstack sudo[91321]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:27 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-62b264c6-09db-484a-8232-fdb8cda8f06e tempest-CreateVolumesFromSourceVolumeTest-218806783 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-288a4151-f9a5-484b-8dc0-478dcc49e642" returned: 0 in 0.479s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:27 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-62b264c6-09db-484a-8232-fdb8cda8f06e tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-288a4151-f9a5-484b-8dc0-478dcc49e642 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:27 devstack sudo[91335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-288a4151-f9a5-484b-8dc0-478dcc49e642
Apr 10 13:20:27 devstack sudo[91335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:27 devstack sudo[91328]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:27 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-41050f16-cbe3-499d-9f82-5f2579f32463 tempest-VolumeDependencyTests-1052055728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-5686dcff-f611-4b23-9d50-7f6a8d858c55.info" returned: 0 in 0.443s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:27 devstack cinder-volume[83345]: WARNING cinder.volume.drivers.remotefs [None req-41050f16-cbe3-499d-9f82-5f2579f32463 tempest-VolumeDependencyTests-1052055728 None] /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-5686dcff-f611-4b23-9d50-7f6a8d858c55.info is being set with open permissions: ugo+rw
Apr 10 13:20:27 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-41050f16-cbe3-499d-9f82-5f2579f32463 tempest-VolumeDependencyTests-1052055728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-5686dcff-f611-4b23-9d50-7f6a8d858c55.info {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:27 devstack sudo[91333]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:27 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-a0a3ce24-db2b-4a7c-b943-3ad995daf6fc tempest-SnapshotDependencyTests-797137213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-591f6681-dd5b-457f-8c20-9bb6ef7fe4f9" returned: 0 in 0.400s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:27 devstack sudo[91340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-5686dcff-f611-4b23-9d50-7f6a8d858c55.info
Apr 10 13:20:27 devstack sudo[91340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:27 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-a0a3ce24-db2b-4a7c-b943-3ad995daf6fc tempest-SnapshotDependencyTests-797137213 None] Lock "cinder-quobyte-591f6681-dd5b-457f-8c20-9bb6ef7fe4f9" released by "delete_volume" :: held 0.958s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:20:27 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-a0a3ce24-db2b-4a7c-b943-3ad995daf6fc tempest-SnapshotDependencyTests-797137213 None] Created reservations ['3f7f42fa-b2d4-40db-85e6-407932de4d69', '161a7b88-0020-4fb1-a2c0-d1fab80db24f', 'a848e74f-859f-4bb7-b2a2-306212a57eed', 'ed506390-8f0c-47d4-8307-6ce31c2d9e42'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:20:27 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-a0a3ce24-db2b-4a7c-b943-3ad995daf6fc tempest-SnapshotDependencyTests-797137213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:20:27 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-a0a3ce24-db2b-4a7c-b943-3ad995daf6fc tempest-SnapshotDependencyTests-797137213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:20:27 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-a0a3ce24-db2b-4a7c-b943-3ad995daf6fc tempest-SnapshotDependencyTests-797137213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:20:27 devstack sudo[91335]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:27 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-a0a3ce24-db2b-4a7c-b943-3ad995daf6fc tempest-SnapshotDependencyTests-797137213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:20:27 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-a0a3ce24-db2b-4a7c-b943-3ad995daf6fc tempest-SnapshotDependencyTests-797137213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:20:27 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-a0a3ce24-db2b-4a7c-b943-3ad995daf6fc tempest-SnapshotDependencyTests-797137213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:27 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-62b264c6-09db-484a-8232-fdb8cda8f06e tempest-CreateVolumesFromSourceVolumeTest-218806783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-288a4151-f9a5-484b-8dc0-478dcc49e642" returned: 0 in 0.446s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:27 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-62b264c6-09db-484a-8232-fdb8cda8f06e tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Lock "cinder-quobyte-288a4151-f9a5-484b-8dc0-478dcc49e642" released by "delete_volume" :: held 0.951s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:20:27 devstack sudo[91342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:20:27 devstack sudo[91342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:27 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-83a67c77-e530-4d97-8dd4-341b7f284b09 tempest-SnapshotDependencyTests-797137213 None] Acquiring lock "cinder-5b0e240c-897c-43cb-8e50-7218c4554f06-delete_volume" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:20:27 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-62b264c6-09db-484a-8232-fdb8cda8f06e tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Created reservations ['a8b17b2a-97ff-4dac-a516-5bb80af0789b', 'a9dfa0b7-8d9e-4b34-ad7d-631e4c328359', 'f04fa2e8-d2f0-4ba2-9268-cc0fe16fadd1', 'b63d1dc6-b30c-4ab5-a565-a535a819181f'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:20:27 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-83a67c77-e530-4d97-8dd4-341b7f284b09 tempest-SnapshotDependencyTests-797137213 None] Lock "cinder-5b0e240c-897c-43cb-8e50-7218c4554f06-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:20:27 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-83a67c77-e530-4d97-8dd4-341b7f284b09 tempest-SnapshotDependencyTests-797137213 None] Acquiring lock "cinder-quobyte-5b0e240c-897c-43cb-8e50-7218c4554f06" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:20:27 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-62b264c6-09db-484a-8232-fdb8cda8f06e tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:20:27 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-62b264c6-09db-484a-8232-fdb8cda8f06e tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:20:27 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-62b264c6-09db-484a-8232-fdb8cda8f06e tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:20:27 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-62b264c6-09db-484a-8232-fdb8cda8f06e tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:20:27 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-62b264c6-09db-484a-8232-fdb8cda8f06e tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:20:27 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-62b264c6-09db-484a-8232-fdb8cda8f06e tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:27 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-83a67c77-e530-4d97-8dd4-341b7f284b09 tempest-SnapshotDependencyTests-797137213 None] Lock "cinder-quobyte-5b0e240c-897c-43cb-8e50-7218c4554f06" acquired by "delete_volume" :: waited 0.023s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:20:27 devstack sudo[91344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:20:27 devstack sudo[91344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:27 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[be2dd6ea-c8fa-4fa0-b60c-11047b78cf4e]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:20:27 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-83a67c77-e530-4d97-8dd4-341b7f284b09 tempest-SnapshotDependencyTests-797137213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-5b0e240c-897c-43cb-8e50-7218c4554f06 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:27 devstack sudo[91346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-5b0e240c-897c-43cb-8e50-7218c4554f06
Apr 10 13:20:27 devstack sudo[91346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:27 devstack sudo[91340]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:27 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-41050f16-cbe3-499d-9f82-5f2579f32463 tempest-VolumeDependencyTests-1052055728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-5686dcff-f611-4b23-9d50-7f6a8d858c55.info" returned: 0 in 0.437s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:27 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-41050f16-cbe3-499d-9f82-5f2579f32463 tempest-VolumeDependencyTests-1052055728 None] Acquiring lock "cinder-quobyte-69d6564b-70e8-4316-8e1e-b45ccd922f2c" by "_copy_volume_from_snapshot" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:20:27 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-41050f16-cbe3-499d-9f82-5f2579f32463 tempest-VolumeDependencyTests-1052055728 None] Lock "cinder-quobyte-69d6564b-70e8-4316-8e1e-b45ccd922f2c" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:20:27 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-41050f16-cbe3-499d-9f82-5f2579f32463 tempest-VolumeDependencyTests-1052055728 None] snapshot: 0748ecab-8fe7-4793-b711-f195ddef9b43, volume: 69d6564b-70e8-4316-8e1e-b45ccd922f2c,  {{(pid=83345) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 10 13:20:27 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-41050f16-cbe3-499d-9f82-5f2579f32463 tempest-VolumeDependencyTests-1052055728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:20:27 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-41050f16-cbe3-499d-9f82-5f2579f32463 tempest-VolumeDependencyTests-1052055728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:20:27 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-41050f16-cbe3-499d-9f82-5f2579f32463 tempest-VolumeDependencyTests-1052055728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:20:27 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-41050f16-cbe3-499d-9f82-5f2579f32463 tempest-VolumeDependencyTests-1052055728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:20:27 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-41050f16-cbe3-499d-9f82-5f2579f32463 tempest-VolumeDependencyTests-1052055728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:20:27 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[70f9c7c8-36d8-4c82-b6b5-518b2715ed82]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:20:27 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-41050f16-cbe3-499d-9f82-5f2579f32463 tempest-VolumeDependencyTests-1052055728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-5686dcff-f611-4b23-9d50-7f6a8d858c55.0748ecab-8fe7-4793-b711-f195ddef9b43 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:27 devstack sudo[91349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-5686dcff-f611-4b23-9d50-7f6a8d858c55.0748ecab-8fe7-4793-b711-f195ddef9b43
Apr 10 13:20:27 devstack sudo[91349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:27 devstack sudo[91342]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:27 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-a0a3ce24-db2b-4a7c-b943-3ad995daf6fc tempest-SnapshotDependencyTests-797137213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.512s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:27 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-a0a3ce24-db2b-4a7c-b943-3ad995daf6fc tempest-SnapshotDependencyTests-797137213 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:20:27 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-a0a3ce24-db2b-4a7c-b943-3ad995daf6fc tempest-SnapshotDependencyTests-797137213 None] Deleted volume successfully.
Apr 10 13:20:28 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-a0a3ce24-db2b-4a7c-b943-3ad995daf6fc tempest-SnapshotDependencyTests-797137213 None] Lock "cinder-591f6681-dd5b-457f-8c20-9bb6ef7fe4f9-delete_volume" released by "delete_volume" :: held 1.610s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:20:28 devstack sudo[91344]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:28 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-62b264c6-09db-484a-8232-fdb8cda8f06e tempest-CreateVolumesFromSourceVolumeTest-218806783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.465s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:28 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-62b264c6-09db-484a-8232-fdb8cda8f06e tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:20:28 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-62b264c6-09db-484a-8232-fdb8cda8f06e tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Deleted volume successfully.
Apr 10 13:20:28 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-62b264c6-09db-484a-8232-fdb8cda8f06e tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Lock "cinder-288a4151-f9a5-484b-8dc0-478dcc49e642-delete_volume" released by "delete_volume" :: held 1.602s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:20:28 devstack sudo[91346]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:28 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-83a67c77-e530-4d97-8dd4-341b7f284b09 tempest-SnapshotDependencyTests-797137213 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-5b0e240c-897c-43cb-8e50-7218c4554f06" returned: 0 in 0.483s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:28 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-83a67c77-e530-4d97-8dd4-341b7f284b09 tempest-SnapshotDependencyTests-797137213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-5b0e240c-897c-43cb-8e50-7218c4554f06 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:28 devstack sudo[91356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-5b0e240c-897c-43cb-8e50-7218c4554f06
Apr 10 13:20:28 devstack sudo[91356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:28 devstack sudo[91349]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:28 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-41050f16-cbe3-499d-9f82-5f2579f32463 tempest-VolumeDependencyTests-1052055728 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-5686dcff-f611-4b23-9d50-7f6a8d858c55.0748ecab-8fe7-4793-b711-f195ddef9b43" returned: 0 in 0.519s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:28 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-41050f16-cbe3-499d-9f82-5f2579f32463 tempest-VolumeDependencyTests-1052055728 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5686dcff-f611-4b23-9d50-7f6a8d858c55(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 13:20:28 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-41050f16-cbe3-499d-9f82-5f2579f32463 tempest-VolumeDependencyTests-1052055728 None] will copy from snapshot at /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-5686dcff-f611-4b23-9d50-7f6a8d858c55 {{(pid=83345) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 10 13:20:28 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-41050f16-cbe3-499d-9f82-5f2579f32463 tempest-VolumeDependencyTests-1052055728 None] Creating direct copy from snapshot {{(pid=83345) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 10 13:20:28 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[53c65c1a-6b02-4a4b-9574-02bd29e364c8]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:20:28 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-41050f16-cbe3-499d-9f82-5f2579f32463 tempest-VolumeDependencyTests-1052055728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-5686dcff-f611-4b23-9d50-7f6a8d858c55 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:28 devstack sudo[91361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-5686dcff-f611-4b23-9d50-7f6a8d858c55
Apr 10 13:20:28 devstack sudo[91361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:28 devstack sudo[91356]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:28 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-83a67c77-e530-4d97-8dd4-341b7f284b09 tempest-SnapshotDependencyTests-797137213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-5b0e240c-897c-43cb-8e50-7218c4554f06" returned: 0 in 0.422s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:28 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-83a67c77-e530-4d97-8dd4-341b7f284b09 tempest-SnapshotDependencyTests-797137213 None] Lock "cinder-quobyte-5b0e240c-897c-43cb-8e50-7218c4554f06" released by "delete_volume" :: held 0.928s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:20:28 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-83a67c77-e530-4d97-8dd4-341b7f284b09 tempest-SnapshotDependencyTests-797137213 None] Created reservations ['b2b0e25c-cd52-4e89-a457-ff1ff5835b34', 'b204d2ce-5445-433f-a394-0764f9230198', 'fc26119b-4edc-491b-b6d1-b40b3aa3f6ef', '653bdb7e-961b-499a-8cee-3deac782cdd7'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:20:28 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-83a67c77-e530-4d97-8dd4-341b7f284b09 tempest-SnapshotDependencyTests-797137213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:20:28 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-83a67c77-e530-4d97-8dd4-341b7f284b09 tempest-SnapshotDependencyTests-797137213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:20:28 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-83a67c77-e530-4d97-8dd4-341b7f284b09 tempest-SnapshotDependencyTests-797137213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:20:28 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-83a67c77-e530-4d97-8dd4-341b7f284b09 tempest-SnapshotDependencyTests-797137213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:20:28 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-83a67c77-e530-4d97-8dd4-341b7f284b09 tempest-SnapshotDependencyTests-797137213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:20:28 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-83a67c77-e530-4d97-8dd4-341b7f284b09 tempest-SnapshotDependencyTests-797137213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:28 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-d6f68017-9260-4792-87b4-527c5ca20d79 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Acquiring lock "cinder-6ed9cc08-88fa-43c1-98dc-39e577c29bed-delete_volume" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:20:28 devstack sudo[91364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:20:28 devstack sudo[91364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:28 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-d6f68017-9260-4792-87b4-527c5ca20d79 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Lock "cinder-6ed9cc08-88fa-43c1-98dc-39e577c29bed-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:20:28 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-d6f68017-9260-4792-87b4-527c5ca20d79 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Acquiring lock "cinder-quobyte-6ed9cc08-88fa-43c1-98dc-39e577c29bed" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:20:28 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-d6f68017-9260-4792-87b4-527c5ca20d79 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Lock "cinder-quobyte-6ed9cc08-88fa-43c1-98dc-39e577c29bed" acquired by "delete_volume" :: waited 0.007s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:20:28 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fb56bb3-0a11-4670-99c0-6e89a1013ad8]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:20:28 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-d6f68017-9260-4792-87b4-527c5ca20d79 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-6ed9cc08-88fa-43c1-98dc-39e577c29bed {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:28 devstack sudo[91366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-6ed9cc08-88fa-43c1-98dc-39e577c29bed
Apr 10 13:20:28 devstack sudo[91366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:28 devstack sudo[91361]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:28 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-41050f16-cbe3-499d-9f82-5f2579f32463 tempest-VolumeDependencyTests-1052055728 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-5686dcff-f611-4b23-9d50-7f6a8d858c55" returned: 0 in 0.503s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:28 devstack cinder-volume[83345]: DEBUG cinder.utils [None req-41050f16-cbe3-499d-9f82-5f2579f32463 tempest-VolumeDependencyTests-1052055728 None] Path /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-69d6564b-70e8-4316-8e1e-b45ccd922f2c not found in is_blk_device check {{(pid=83345) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 10 13:20:28 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-41050f16-cbe3-499d-9f82-5f2579f32463 tempest-VolumeDependencyTests-1052055728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-5686dcff-f611-4b23-9d50-7f6a8d858c55 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-69d6564b-70e8-4316-8e1e-b45ccd922f2c {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:28 devstack sudo[91371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-5686dcff-f611-4b23-9d50-7f6a8d858c55 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-69d6564b-70e8-4316-8e1e-b45ccd922f2c
Apr 10 13:20:28 devstack sudo[91371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:29 devstack sudo[91364]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:29 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-83a67c77-e530-4d97-8dd4-341b7f284b09 tempest-SnapshotDependencyTests-797137213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.461s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:29 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-83a67c77-e530-4d97-8dd4-341b7f284b09 tempest-SnapshotDependencyTests-797137213 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:20:29 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-83a67c77-e530-4d97-8dd4-341b7f284b09 tempest-SnapshotDependencyTests-797137213 None] Deleted volume successfully.
Apr 10 13:20:29 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-83a67c77-e530-4d97-8dd4-341b7f284b09 tempest-SnapshotDependencyTests-797137213 None] Lock "cinder-5b0e240c-897c-43cb-8e50-7218c4554f06-delete_volume" released by "delete_volume" :: held 1.576s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:20:29 devstack sudo[91366]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:29 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-d6f68017-9260-4792-87b4-527c5ca20d79 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-6ed9cc08-88fa-43c1-98dc-39e577c29bed" returned: 0 in 0.504s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:29 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-d6f68017-9260-4792-87b4-527c5ca20d79 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-6ed9cc08-88fa-43c1-98dc-39e577c29bed {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:29 devstack sudo[91409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-6ed9cc08-88fa-43c1-98dc-39e577c29bed
Apr 10 13:20:29 devstack sudo[91409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:30 devstack sudo[91409]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:30 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-d6f68017-9260-4792-87b4-527c5ca20d79 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-6ed9cc08-88fa-43c1-98dc-39e577c29bed" returned: 0 in 1.052s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:30 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-d6f68017-9260-4792-87b4-527c5ca20d79 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Lock "cinder-quobyte-6ed9cc08-88fa-43c1-98dc-39e577c29bed" released by "delete_volume" :: held 1.580s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:20:30 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-d6f68017-9260-4792-87b4-527c5ca20d79 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Created reservations ['04b5ccfd-a0d2-4535-8a8c-5d026d101707', 'c3689361-c255-4f71-8ba5-e577e41a470d', '111b00ec-64d1-4d94-a846-0016e3a85add', '36b4ddf5-f111-4679-83ae-66f2288b2538'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:20:30 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-d6f68017-9260-4792-87b4-527c5ca20d79 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:20:30 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-d6f68017-9260-4792-87b4-527c5ca20d79 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:20:30 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-d6f68017-9260-4792-87b4-527c5ca20d79 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:20:30 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-d6f68017-9260-4792-87b4-527c5ca20d79 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:20:30 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-d6f68017-9260-4792-87b4-527c5ca20d79 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:20:30 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-d6f68017-9260-4792-87b4-527c5ca20d79 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:30 devstack sudo[91424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:20:30 devstack sudo[91424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:31 devstack sudo[91371]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:31 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-41050f16-cbe3-499d-9f82-5f2579f32463 tempest-VolumeDependencyTests-1052055728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-5686dcff-f611-4b23-9d50-7f6a8d858c55 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-69d6564b-70e8-4316-8e1e-b45ccd922f2c" returned: 0 in 2.151s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:31 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb99c215-e17f-4ce0-b7fd-160d76956fca]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:20:31 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-41050f16-cbe3-499d-9f82-5f2579f32463 tempest-VolumeDependencyTests-1052055728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-5686dcff-f611-4b23-9d50-7f6a8d858c55 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:31 devstack sudo[91426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-5686dcff-f611-4b23-9d50-7f6a8d858c55
Apr 10 13:20:31 devstack sudo[91426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:31 devstack sudo[91424]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:31 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-d6f68017-9260-4792-87b4-527c5ca20d79 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.878s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:31 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-d6f68017-9260-4792-87b4-527c5ca20d79 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:20:31 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-d6f68017-9260-4792-87b4-527c5ca20d79 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Deleted volume successfully.
Apr 10 13:20:31 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-d6f68017-9260-4792-87b4-527c5ca20d79 tempest-CreateVolumesFromSourceVolumeTest-218806783 None] Lock "cinder-6ed9cc08-88fa-43c1-98dc-39e577c29bed-delete_volume" released by "delete_volume" :: held 2.650s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:20:31 devstack sudo[91426]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:31 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-41050f16-cbe3-499d-9f82-5f2579f32463 tempest-VolumeDependencyTests-1052055728 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-5686dcff-f611-4b23-9d50-7f6a8d858c55" returned: 0 in 0.768s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:31 devstack cinder-volume[83345]: DEBUG cinder.image.image_utils [None req-41050f16-cbe3-499d-9f82-5f2579f32463 tempest-VolumeDependencyTests-1052055728 None] Image conversion details: src /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-5686dcff-f611-4b23-9d50-7f6a8d858c55, size 1024.00 MB, duration 2.15 sec, destination /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-69d6564b-70e8-4316-8e1e-b45ccd922f2c {{(pid=83345) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 10 13:20:31 devstack cinder-volume[83345]: INFO cinder.image.image_utils [None req-41050f16-cbe3-499d-9f82-5f2579f32463 tempest-VolumeDependencyTests-1052055728 None] Converted 1024.00 MB image at 475.77 MB/s
Apr 10 13:20:31 devstack cinder-volume[83345]: WARNING cinder.volume.drivers.remotefs [None req-41050f16-cbe3-499d-9f82-5f2579f32463 tempest-VolumeDependencyTests-1052055728 None] /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-69d6564b-70e8-4316-8e1e-b45ccd922f2c is being set with open permissions: ugo+rw
Apr 10 13:20:31 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-41050f16-cbe3-499d-9f82-5f2579f32463 tempest-VolumeDependencyTests-1052055728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-69d6564b-70e8-4316-8e1e-b45ccd922f2c {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:31 devstack sudo[91434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-69d6564b-70e8-4316-8e1e-b45ccd922f2c
Apr 10 13:20:31 devstack sudo[91434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:32 devstack sudo[91434]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:32 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-41050f16-cbe3-499d-9f82-5f2579f32463 tempest-VolumeDependencyTests-1052055728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-69d6564b-70e8-4316-8e1e-b45ccd922f2c" returned: 0 in 0.500s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:32 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-41050f16-cbe3-499d-9f82-5f2579f32463 tempest-VolumeDependencyTests-1052055728 None] Lock "cinder-quobyte-69d6564b-70e8-4316-8e1e-b45ccd922f2c" released by "_copy_volume_from_snapshot" :: held 4.495s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:20:32 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-41050f16-cbe3-499d-9f82-5f2579f32463 tempest-VolumeDependencyTests-1052055728 None] Acquiring lock "cinder-quobyte-0748ecab-8fe7-4793-b711-f195ddef9b43" by "_delete_snapshot" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:20:32 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-41050f16-cbe3-499d-9f82-5f2579f32463 tempest-VolumeDependencyTests-1052055728 None] Lock "cinder-quobyte-0748ecab-8fe7-4793-b711-f195ddef9b43" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:20:32 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-41050f16-cbe3-499d-9f82-5f2579f32463 tempest-VolumeDependencyTests-1052055728 None] Deleting offline snapshot 0748ecab-8fe7-4793-b711-f195ddef9b43 of volume 5686dcff-f611-4b23-9d50-7f6a8d858c55 {{(pid=83345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 10 13:20:32 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-41050f16-cbe3-499d-9f82-5f2579f32463 tempest-VolumeDependencyTests-1052055728 None] snapshot_file for this snap is: volume-5686dcff-f611-4b23-9d50-7f6a8d858c55.0748ecab-8fe7-4793-b711-f195ddef9b43 {{(pid=83345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 10 13:20:32 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[42aba55f-9841-4e09-88ab-b517fa5d798b]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:20:32 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-41050f16-cbe3-499d-9f82-5f2579f32463 tempest-VolumeDependencyTests-1052055728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-5686dcff-f611-4b23-9d50-7f6a8d858c55.0748ecab-8fe7-4793-b711-f195ddef9b43 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:32 devstack sudo[91437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-5686dcff-f611-4b23-9d50-7f6a8d858c55.0748ecab-8fe7-4793-b711-f195ddef9b43
Apr 10 13:20:32 devstack sudo[91437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:32 devstack sudo[91437]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:32 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-41050f16-cbe3-499d-9f82-5f2579f32463 tempest-VolumeDependencyTests-1052055728 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-5686dcff-f611-4b23-9d50-7f6a8d858c55.0748ecab-8fe7-4793-b711-f195ddef9b43" returned: 0 in 0.535s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:32 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-41050f16-cbe3-499d-9f82-5f2579f32463 tempest-VolumeDependencyTests-1052055728 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5686dcff-f611-4b23-9d50-7f6a8d858c55(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 13:20:32 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ef5022e-ebdb-4a14-a2f2-02afce7c2684]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:20:32 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-41050f16-cbe3-499d-9f82-5f2579f32463 tempest-VolumeDependencyTests-1052055728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-5686dcff-f611-4b23-9d50-7f6a8d858c55 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:32 devstack sudo[91442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-5686dcff-f611-4b23-9d50-7f6a8d858c55
Apr 10 13:20:32 devstack sudo[91442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:33 devstack sudo[91442]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:33 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-41050f16-cbe3-499d-9f82-5f2579f32463 tempest-VolumeDependencyTests-1052055728 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-5686dcff-f611-4b23-9d50-7f6a8d858c55" returned: 0 in 0.497s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:33 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-41050f16-cbe3-499d-9f82-5f2579f32463 tempest-VolumeDependencyTests-1052055728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-5686dcff-f611-4b23-9d50-7f6a8d858c55.0748ecab-8fe7-4793-b711-f195ddef9b43 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:33 devstack sudo[91448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-5686dcff-f611-4b23-9d50-7f6a8d858c55.0748ecab-8fe7-4793-b711-f195ddef9b43
Apr 10 13:20:33 devstack sudo[91448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:33 devstack sudo[91448]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:33 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-41050f16-cbe3-499d-9f82-5f2579f32463 tempest-VolumeDependencyTests-1052055728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-5686dcff-f611-4b23-9d50-7f6a8d858c55.0748ecab-8fe7-4793-b711-f195ddef9b43" returned: 0 in 0.492s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:33 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-41050f16-cbe3-499d-9f82-5f2579f32463 tempest-VolumeDependencyTests-1052055728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-5686dcff-f611-4b23-9d50-7f6a8d858c55.0748ecab-8fe7-4793-b711-f195ddef9b43 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:33 devstack sudo[91453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-5686dcff-f611-4b23-9d50-7f6a8d858c55.0748ecab-8fe7-4793-b711-f195ddef9b43
Apr 10 13:20:33 devstack sudo[91453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:34 devstack sudo[91453]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:34 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-41050f16-cbe3-499d-9f82-5f2579f32463 tempest-VolumeDependencyTests-1052055728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-5686dcff-f611-4b23-9d50-7f6a8d858c55.0748ecab-8fe7-4793-b711-f195ddef9b43" returned: 0 in 0.439s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:34 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-41050f16-cbe3-499d-9f82-5f2579f32463 tempest-VolumeDependencyTests-1052055728 None] Lock "cinder-quobyte-0748ecab-8fe7-4793-b711-f195ddef9b43" released by "_delete_snapshot" :: held 2.017s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:20:34 devstack cinder-volume[83345]: DEBUG dbcounter [-] [83345] Writing DB stats cinder:DELETE=30,cinder:UPDATE=275,cinder:SELECT=205,cinder:INSERT=64 {{(pid=83345) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 10 13:20:34 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-41050f16-cbe3-499d-9f82-5f2579f32463 tempest-VolumeDependencyTests-1052055728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.554s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:20:34 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-18f42218-21db-4652-989b-e479fe410a4b tempest-CinderUnicodeTest-30520849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.844s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:20:34 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-18f42218-21db-4652-989b-e479fe410a4b tempest-CinderUnicodeTest-30520849 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f252bf08b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-10T11:20:25Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1674553528',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35423d3b-1715-4589-92fb-20af324218da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e79389e5bc54e33a53249eff3ff2be9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:20:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:20:25Z,use_quota=True,user_id='9f9e7e2ccefa4f8fabe7e3c5e3e91894',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7),volume_type_id=949be8a1-e7d9-49cd-bbcf-1d063fcb5ef7)}" {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 10 13:20:34 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-18f42218-21db-4652-989b-e479fe410a4b tempest-CinderUnicodeTest-30520849 None] Creating volume 35423d3b-1715-4589-92fb-20af324218da {{(pid=83345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 10 13:20:34 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-18f42218-21db-4652-989b-e479fe410a4b tempest-CinderUnicodeTest-30520849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:20:34 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-18f42218-21db-4652-989b-e479fe410a4b tempest-CinderUnicodeTest-30520849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:20:34 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-18f42218-21db-4652-989b-e479fe410a4b tempest-CinderUnicodeTest-30520849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:20:34 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-18f42218-21db-4652-989b-e479fe410a4b tempest-CinderUnicodeTest-30520849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:20:34 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-18f42218-21db-4652-989b-e479fe410a4b tempest-CinderUnicodeTest-30520849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:20:34 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-18f42218-21db-4652-989b-e479fe410a4b tempest-CinderUnicodeTest-30520849 None] Selected osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331 as target Quobyte volume. {{(pid=83345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 10 13:20:34 devstack cinder-volume[83345]: INFO cinder.volume.drivers.remotefs [None req-18f42218-21db-4652-989b-e479fe410a4b tempest-CinderUnicodeTest-30520849 None] casted to osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331
Apr 10 13:20:34 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-18f42218-21db-4652-989b-e479fe410a4b tempest-CinderUnicodeTest-30520849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-35423d3b-1715-4589-92fb-20af324218da 1073741824 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:34 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-41050f16-cbe3-499d-9f82-5f2579f32463 tempest-VolumeDependencyTests-1052055728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a984f09b-d14f-4f50-b69c-2c2f31e0bf9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69d6564b-70e8-4316-8e1e-b45ccd922f2c', 'volume_size': 1, 'source_volid': '5686dcff-f611-4b23-9d50-7f6a8d858c55', 'source_volstatus': 'available'}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:20:34 devstack sudo[91457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-35423d3b-1715-4589-92fb-20af324218da 1073741824
Apr 10 13:20:34 devstack sudo[91457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:34 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-41050f16-cbe3-499d-9f82-5f2579f32463 tempest-VolumeDependencyTests-1052055728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7eccef42-34da-48a7-8c7e-3e0765da03c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:20:34 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-41050f16-cbe3-499d-9f82-5f2579f32463 tempest-VolumeDependencyTests-1052055728 None] Volume volume-69d6564b-70e8-4316-8e1e-b45ccd922f2c (69d6564b-70e8-4316-8e1e-b45ccd922f2c): created successfully
Apr 10 13:20:34 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-41050f16-cbe3-499d-9f82-5f2579f32463 tempest-VolumeDependencyTests-1052055728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7eccef42-34da-48a7-8c7e-3e0765da03c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:20:34 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-41050f16-cbe3-499d-9f82-5f2579f32463 tempest-VolumeDependencyTests-1052055728 None] Flow 'volume_create_manager' (10e363c4-00dd-4a06-97e9-4d39331b6729) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:20:34 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-41050f16-cbe3-499d-9f82-5f2579f32463 tempest-VolumeDependencyTests-1052055728 None] Created volume successfully.
Apr 10 13:20:34 devstack sudo[91457]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:34 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-18f42218-21db-4652-989b-e479fe410a4b tempest-CinderUnicodeTest-30520849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-35423d3b-1715-4589-92fb-20af324218da 1073741824" returned: 0 in 0.577s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:35 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-18f42218-21db-4652-989b-e479fe410a4b tempest-CinderUnicodeTest-30520849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-35423d3b-1715-4589-92fb-20af324218da {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:35 devstack sudo[91462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-35423d3b-1715-4589-92fb-20af324218da
Apr 10 13:20:35 devstack sudo[91462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:35 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-1d30363c-962e-4ed1-a960-4c64c8c6ab76 tempest-VolumeDependencyTests-1052055728 None] Acquiring lock "cinder-5686dcff-f611-4b23-9d50-7f6a8d858c55-delete_volume" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:20:35 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-1d30363c-962e-4ed1-a960-4c64c8c6ab76 tempest-VolumeDependencyTests-1052055728 None] Lock "cinder-5686dcff-f611-4b23-9d50-7f6a8d858c55-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:20:35 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-1d30363c-962e-4ed1-a960-4c64c8c6ab76 tempest-VolumeDependencyTests-1052055728 None] Acquiring lock "cinder-quobyte-5686dcff-f611-4b23-9d50-7f6a8d858c55" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:20:35 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-1d30363c-962e-4ed1-a960-4c64c8c6ab76 tempest-VolumeDependencyTests-1052055728 None] Lock "cinder-quobyte-5686dcff-f611-4b23-9d50-7f6a8d858c55" acquired by "delete_volume" :: waited 0.012s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:20:35 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5f1c3c8-be04-4607-acb8-9c742e460dca]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:20:35 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-1d30363c-962e-4ed1-a960-4c64c8c6ab76 tempest-VolumeDependencyTests-1052055728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-5686dcff-f611-4b23-9d50-7f6a8d858c55 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:35 devstack sudo[91462]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:35 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-18f42218-21db-4652-989b-e479fe410a4b tempest-CinderUnicodeTest-30520849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-35423d3b-1715-4589-92fb-20af324218da" returned: 0 in 0.529s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:35 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-18f42218-21db-4652-989b-e479fe410a4b tempest-CinderUnicodeTest-30520849 None] <== create_volume: return (1139ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'} {{(pid=83345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 10 13:20:35 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-18f42218-21db-4652-989b-e479fe410a4b tempest-CinderUnicodeTest-30520849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.144s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:20:35 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-18f42218-21db-4652-989b-e479fe410a4b tempest-CinderUnicodeTest-30520849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75309748-eeaa-4e85-b4b6-dd0a8e2aa49c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35423d3b-1715-4589-92fb-20af324218da', 'volume_size': 1}' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:20:35 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-18f42218-21db-4652-989b-e479fe410a4b tempest-CinderUnicodeTest-30520849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e34396e-e5b6-4e1f-9817-ff97be606c14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 10 13:20:35 devstack cinder-volume[83345]: INFO cinder.volume.flows.manager.create_volume [None req-18f42218-21db-4652-989b-e479fe410a4b tempest-CinderUnicodeTest-30520849 None] Volume volume-35423d3b-1715-4589-92fb-20af324218da (35423d3b-1715-4589-92fb-20af324218da): created successfully
Apr 10 13:20:35 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-18f42218-21db-4652-989b-e479fe410a4b tempest-CinderUnicodeTest-30520849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e34396e-e5b6-4e1f-9817-ff97be606c14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83345) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 10 13:20:35 devstack cinder-volume[83345]: DEBUG cinder.volume.manager [None req-18f42218-21db-4652-989b-e479fe410a4b tempest-CinderUnicodeTest-30520849 None] Flow 'volume_create_manager' (9eebf481-64dc-4091-86e7-b750df0f5d0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83345) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 10 13:20:35 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-18f42218-21db-4652-989b-e479fe410a4b tempest-CinderUnicodeTest-30520849 None] Created volume successfully.
Apr 10 13:20:35 devstack sudo[91465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-5686dcff-f611-4b23-9d50-7f6a8d858c55
Apr 10 13:20:35 devstack sudo[91465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:36 devstack sudo[91465]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:36 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-1d30363c-962e-4ed1-a960-4c64c8c6ab76 tempest-VolumeDependencyTests-1052055728 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-5686dcff-f611-4b23-9d50-7f6a8d858c55" returned: 0 in 0.601s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:36 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-1d30363c-962e-4ed1-a960-4c64c8c6ab76 tempest-VolumeDependencyTests-1052055728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-5686dcff-f611-4b23-9d50-7f6a8d858c55 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:36 devstack sudo[91471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-5686dcff-f611-4b23-9d50-7f6a8d858c55
Apr 10 13:20:36 devstack sudo[91471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:36 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-6f5f50df-7343-435f-a86c-64bc68d7f23e tempest-CinderUnicodeTest-30520849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:20:36 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-6f5f50df-7343-435f-a86c-64bc68d7f23e tempest-CinderUnicodeTest-30520849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:20:36 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-6f5f50df-7343-435f-a86c-64bc68d7f23e tempest-CinderUnicodeTest-30520849 None] Creating offline snapshot b1a2cc0b-79b3-40d7-84e0-66b0e12f9b7c of volume 35423d3b-1715-4589-92fb-20af324218da {{(pid=83345) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 10 13:20:36 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[013b813d-f0dc-45f6-8224-8811ac8d5bf2]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:20:36 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-6f5f50df-7343-435f-a86c-64bc68d7f23e tempest-CinderUnicodeTest-30520849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-35423d3b-1715-4589-92fb-20af324218da {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:36 devstack sudo[91473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-35423d3b-1715-4589-92fb-20af324218da
Apr 10 13:20:36 devstack sudo[91473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:36 devstack sudo[91471]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:36 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-1d30363c-962e-4ed1-a960-4c64c8c6ab76 tempest-VolumeDependencyTests-1052055728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-5686dcff-f611-4b23-9d50-7f6a8d858c55" returned: 0 in 0.527s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:36 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-1d30363c-962e-4ed1-a960-4c64c8c6ab76 tempest-VolumeDependencyTests-1052055728 None] Lock "cinder-quobyte-5686dcff-f611-4b23-9d50-7f6a8d858c55" released by "delete_volume" :: held 1.170s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:20:36 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-1d30363c-962e-4ed1-a960-4c64c8c6ab76 tempest-VolumeDependencyTests-1052055728 None] Created reservations ['d544ff40-6a11-4e4f-8037-8794605d42c1', '73ee39c2-59d1-4753-86d3-0284e1b476b6', '2ff415a9-d954-4d36-85eb-b0813eaad194', 'bb71f7dd-da1f-4008-a95e-a0a193e31ba6'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:20:36 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-1d30363c-962e-4ed1-a960-4c64c8c6ab76 tempest-VolumeDependencyTests-1052055728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:20:36 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-1d30363c-962e-4ed1-a960-4c64c8c6ab76 tempest-VolumeDependencyTests-1052055728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:20:36 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-1d30363c-962e-4ed1-a960-4c64c8c6ab76 tempest-VolumeDependencyTests-1052055728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:20:36 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-1d30363c-962e-4ed1-a960-4c64c8c6ab76 tempest-VolumeDependencyTests-1052055728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:20:36 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-1d30363c-962e-4ed1-a960-4c64c8c6ab76 tempest-VolumeDependencyTests-1052055728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:20:36 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-1d30363c-962e-4ed1-a960-4c64c8c6ab76 tempest-VolumeDependencyTests-1052055728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:36 devstack sudo[91476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:20:36 devstack sudo[91476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:36 devstack sudo[91473]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:36 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-6f5f50df-7343-435f-a86c-64bc68d7f23e tempest-CinderUnicodeTest-30520849 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-35423d3b-1715-4589-92fb-20af324218da" returned: 0 in 0.575s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:36 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-6f5f50df-7343-435f-a86c-64bc68d7f23e tempest-CinderUnicodeTest-30520849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-35423d3b-1715-4589-92fb-20af324218da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-35423d3b-1715-4589-92fb-20af324218da.b1a2cc0b-79b3-40d7-84e0-66b0e12f9b7c 1G {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:36 devstack sudo[91481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-35423d3b-1715-4589-92fb-20af324218da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-35423d3b-1715-4589-92fb-20af324218da.b1a2cc0b-79b3-40d7-84e0-66b0e12f9b7c 1G
Apr 10 13:20:36 devstack sudo[91481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:37 devstack sudo[91476]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:37 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-1d30363c-962e-4ed1-a960-4c64c8c6ab76 tempest-VolumeDependencyTests-1052055728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.448s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:37 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-1d30363c-962e-4ed1-a960-4c64c8c6ab76 tempest-VolumeDependencyTests-1052055728 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:20:37 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-1d30363c-962e-4ed1-a960-4c64c8c6ab76 tempest-VolumeDependencyTests-1052055728 None] Deleted volume successfully.
Apr 10 13:20:37 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-1d30363c-962e-4ed1-a960-4c64c8c6ab76 tempest-VolumeDependencyTests-1052055728 None] Lock "cinder-5686dcff-f611-4b23-9d50-7f6a8d858c55-delete_volume" released by "delete_volume" :: held 1.754s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:20:37 devstack sudo[91481]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:37 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-6f5f50df-7343-435f-a86c-64bc68d7f23e tempest-CinderUnicodeTest-30520849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-35423d3b-1715-4589-92fb-20af324218da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-35423d3b-1715-4589-92fb-20af324218da.b1a2cc0b-79b3-40d7-84e0-66b0e12f9b7c 1G" returned: 0 in 0.466s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:37 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-6f5f50df-7343-435f-a86c-64bc68d7f23e tempest-CinderUnicodeTest-30520849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35423d3b-1715-4589-92fb-20af324218da -F qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-35423d3b-1715-4589-92fb-20af324218da.b1a2cc0b-79b3-40d7-84e0-66b0e12f9b7c {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:37 devstack sudo[91487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35423d3b-1715-4589-92fb-20af324218da -F qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-35423d3b-1715-4589-92fb-20af324218da.b1a2cc0b-79b3-40d7-84e0-66b0e12f9b7c
Apr 10 13:20:37 devstack sudo[91487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:37 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-716c8ccd-a16f-4fe2-897b-e6e5fae1f5c6 tempest-VolumeDependencyTests-1052055728 None] Acquiring lock "cinder-69d6564b-70e8-4316-8e1e-b45ccd922f2c-delete_volume" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:20:37 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-716c8ccd-a16f-4fe2-897b-e6e5fae1f5c6 tempest-VolumeDependencyTests-1052055728 None] Lock "cinder-69d6564b-70e8-4316-8e1e-b45ccd922f2c-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:20:37 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-716c8ccd-a16f-4fe2-897b-e6e5fae1f5c6 tempest-VolumeDependencyTests-1052055728 None] Acquiring lock "cinder-quobyte-69d6564b-70e8-4316-8e1e-b45ccd922f2c" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:20:37 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-716c8ccd-a16f-4fe2-897b-e6e5fae1f5c6 tempest-VolumeDependencyTests-1052055728 None] Lock "cinder-quobyte-69d6564b-70e8-4316-8e1e-b45ccd922f2c" acquired by "delete_volume" :: waited 0.009s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:20:37 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[23a5dd1b-41a1-4638-8708-ca4318714e63]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:20:37 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-716c8ccd-a16f-4fe2-897b-e6e5fae1f5c6 tempest-VolumeDependencyTests-1052055728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-69d6564b-70e8-4316-8e1e-b45ccd922f2c {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:37 devstack sudo[91489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-69d6564b-70e8-4316-8e1e-b45ccd922f2c
Apr 10 13:20:37 devstack sudo[91489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:37 devstack sudo[91487]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:37 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-6f5f50df-7343-435f-a86c-64bc68d7f23e tempest-CinderUnicodeTest-30520849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35423d3b-1715-4589-92fb-20af324218da -F qcow2 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-35423d3b-1715-4589-92fb-20af324218da.b1a2cc0b-79b3-40d7-84e0-66b0e12f9b7c" returned: 0 in 0.434s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:37 devstack cinder-volume[83345]: WARNING cinder.volume.drivers.remotefs [None req-6f5f50df-7343-435f-a86c-64bc68d7f23e tempest-CinderUnicodeTest-30520849 None] /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-35423d3b-1715-4589-92fb-20af324218da.b1a2cc0b-79b3-40d7-84e0-66b0e12f9b7c is being set with open permissions: ugo+rw
Apr 10 13:20:37 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-6f5f50df-7343-435f-a86c-64bc68d7f23e tempest-CinderUnicodeTest-30520849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-35423d3b-1715-4589-92fb-20af324218da.b1a2cc0b-79b3-40d7-84e0-66b0e12f9b7c {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:37 devstack sudo[91494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-35423d3b-1715-4589-92fb-20af324218da.b1a2cc0b-79b3-40d7-84e0-66b0e12f9b7c
Apr 10 13:20:37 devstack sudo[91494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:38 devstack sudo[91489]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:38 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-716c8ccd-a16f-4fe2-897b-e6e5fae1f5c6 tempest-VolumeDependencyTests-1052055728 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-69d6564b-70e8-4316-8e1e-b45ccd922f2c" returned: 0 in 0.459s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:38 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-716c8ccd-a16f-4fe2-897b-e6e5fae1f5c6 tempest-VolumeDependencyTests-1052055728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-69d6564b-70e8-4316-8e1e-b45ccd922f2c {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:38 devstack sudo[91500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-69d6564b-70e8-4316-8e1e-b45ccd922f2c
Apr 10 13:20:38 devstack sudo[91500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:38 devstack sudo[91494]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:38 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-6f5f50df-7343-435f-a86c-64bc68d7f23e tempest-CinderUnicodeTest-30520849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-35423d3b-1715-4589-92fb-20af324218da.b1a2cc0b-79b3-40d7-84e0-66b0e12f9b7c" returned: 0 in 0.419s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:38 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-6f5f50df-7343-435f-a86c-64bc68d7f23e tempest-CinderUnicodeTest-30520849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-35423d3b-1715-4589-92fb-20af324218da.info {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:38 devstack sudo[91502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-35423d3b-1715-4589-92fb-20af324218da.info
Apr 10 13:20:38 devstack sudo[91502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:38 devstack sudo[91500]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:38 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-716c8ccd-a16f-4fe2-897b-e6e5fae1f5c6 tempest-VolumeDependencyTests-1052055728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-69d6564b-70e8-4316-8e1e-b45ccd922f2c" returned: 0 in 0.397s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:38 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-716c8ccd-a16f-4fe2-897b-e6e5fae1f5c6 tempest-VolumeDependencyTests-1052055728 None] Lock "cinder-quobyte-69d6564b-70e8-4316-8e1e-b45ccd922f2c" released by "delete_volume" :: held 0.879s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:20:38 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-716c8ccd-a16f-4fe2-897b-e6e5fae1f5c6 tempest-VolumeDependencyTests-1052055728 None] Created reservations ['30ec6a10-103d-401b-a1c8-76f0e69c93ab', 'd278ad9f-82ca-4df4-92a7-422af31361c3', '1256064d-6d89-4049-a449-7e714fd41685', '52ed4ff2-1ae0-411e-a698-0bd8eae1a380'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:20:38 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-716c8ccd-a16f-4fe2-897b-e6e5fae1f5c6 tempest-VolumeDependencyTests-1052055728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:20:38 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-716c8ccd-a16f-4fe2-897b-e6e5fae1f5c6 tempest-VolumeDependencyTests-1052055728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:20:38 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-716c8ccd-a16f-4fe2-897b-e6e5fae1f5c6 tempest-VolumeDependencyTests-1052055728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:20:38 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-716c8ccd-a16f-4fe2-897b-e6e5fae1f5c6 tempest-VolumeDependencyTests-1052055728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:20:38 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-716c8ccd-a16f-4fe2-897b-e6e5fae1f5c6 tempest-VolumeDependencyTests-1052055728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:20:38 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-716c8ccd-a16f-4fe2-897b-e6e5fae1f5c6 tempest-VolumeDependencyTests-1052055728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:38 devstack sudo[91502]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:38 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-6f5f50df-7343-435f-a86c-64bc68d7f23e tempest-CinderUnicodeTest-30520849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-35423d3b-1715-4589-92fb-20af324218da.info" returned: 0 in 0.401s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:38 devstack cinder-volume[83345]: WARNING cinder.volume.drivers.remotefs [None req-6f5f50df-7343-435f-a86c-64bc68d7f23e tempest-CinderUnicodeTest-30520849 None] /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-35423d3b-1715-4589-92fb-20af324218da.info is being set with open permissions: ugo+rw
Apr 10 13:20:38 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-6f5f50df-7343-435f-a86c-64bc68d7f23e tempest-CinderUnicodeTest-30520849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-35423d3b-1715-4589-92fb-20af324218da.info {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:38 devstack sudo[91506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:20:38 devstack sudo[91506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:38 devstack sudo[91508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-35423d3b-1715-4589-92fb-20af324218da.info
Apr 10 13:20:38 devstack sudo[91508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:38 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-5d02594a-337c-45db-99fc-1fbae4df5691 tempest-VolumeDependencyTests-1052055728 None] Acquiring lock "cinder-9c018ce6-b114-4814-98e4-4a13612f79b8-delete_volume" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:20:38 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-5d02594a-337c-45db-99fc-1fbae4df5691 tempest-VolumeDependencyTests-1052055728 None] Lock "cinder-9c018ce6-b114-4814-98e4-4a13612f79b8-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:20:38 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-5d02594a-337c-45db-99fc-1fbae4df5691 tempest-VolumeDependencyTests-1052055728 None] Acquiring lock "cinder-quobyte-9c018ce6-b114-4814-98e4-4a13612f79b8" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:20:38 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-5d02594a-337c-45db-99fc-1fbae4df5691 tempest-VolumeDependencyTests-1052055728 None] Lock "cinder-quobyte-9c018ce6-b114-4814-98e4-4a13612f79b8" acquired by "delete_volume" :: waited 0.007s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:20:38 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[99414ed6-20ed-4e01-98c3-10cde18835de]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:20:38 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-5d02594a-337c-45db-99fc-1fbae4df5691 tempest-VolumeDependencyTests-1052055728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-9c018ce6-b114-4814-98e4-4a13612f79b8 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:38 devstack sudo[91510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-9c018ce6-b114-4814-98e4-4a13612f79b8
Apr 10 13:20:38 devstack sudo[91510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:39 devstack sudo[91508]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:39 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-6f5f50df-7343-435f-a86c-64bc68d7f23e tempest-CinderUnicodeTest-30520849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-35423d3b-1715-4589-92fb-20af324218da.info" returned: 0 in 0.409s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:39 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-6f5f50df-7343-435f-a86c-64bc68d7f23e tempest-CinderUnicodeTest-30520849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.764s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:20:39 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-6f5f50df-7343-435f-a86c-64bc68d7f23e tempest-CinderUnicodeTest-30520849 None] Create snapshot completed successfully
Apr 10 13:20:39 devstack sudo[91506]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:39 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-716c8ccd-a16f-4fe2-897b-e6e5fae1f5c6 tempest-VolumeDependencyTests-1052055728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.471s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:39 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-716c8ccd-a16f-4fe2-897b-e6e5fae1f5c6 tempest-VolumeDependencyTests-1052055728 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:20:39 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-716c8ccd-a16f-4fe2-897b-e6e5fae1f5c6 tempest-VolumeDependencyTests-1052055728 None] Deleted volume successfully.
Apr 10 13:20:39 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-716c8ccd-a16f-4fe2-897b-e6e5fae1f5c6 tempest-VolumeDependencyTests-1052055728 None] Lock "cinder-69d6564b-70e8-4316-8e1e-b45ccd922f2c-delete_volume" released by "delete_volume" :: held 1.472s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:20:39 devstack sudo[91510]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:39 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-5d02594a-337c-45db-99fc-1fbae4df5691 tempest-VolumeDependencyTests-1052055728 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-9c018ce6-b114-4814-98e4-4a13612f79b8" returned: 0 in 0.480s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:39 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-5d02594a-337c-45db-99fc-1fbae4df5691 tempest-VolumeDependencyTests-1052055728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-9c018ce6-b114-4814-98e4-4a13612f79b8 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:39 devstack sudo[91517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-9c018ce6-b114-4814-98e4-4a13612f79b8
Apr 10 13:20:39 devstack sudo[91517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:39 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-470fe9c6-13ee-457d-9143-92c64d09e688 tempest-CinderUnicodeTest-30520849 None] Acquiring lock "cinder-b1a2cc0b-79b3-40d7-84e0-66b0e12f9b7c-delete_snapshot" by "delete_snapshot" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:20:39 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-470fe9c6-13ee-457d-9143-92c64d09e688 tempest-CinderUnicodeTest-30520849 None] Lock "cinder-b1a2cc0b-79b3-40d7-84e0-66b0e12f9b7c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:20:39 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-470fe9c6-13ee-457d-9143-92c64d09e688 tempest-CinderUnicodeTest-30520849 None] Acquiring lock "cinder-quobyte-35423d3b-1715-4589-92fb-20af324218da" by "delete_snapshot" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:20:39 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-470fe9c6-13ee-457d-9143-92c64d09e688 tempest-CinderUnicodeTest-30520849 None] Lock "cinder-quobyte-35423d3b-1715-4589-92fb-20af324218da" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:20:39 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-470fe9c6-13ee-457d-9143-92c64d09e688 tempest-CinderUnicodeTest-30520849 None] Acquiring lock "cinder-quobyte-b1a2cc0b-79b3-40d7-84e0-66b0e12f9b7c" by "_delete_snapshot" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:20:39 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-470fe9c6-13ee-457d-9143-92c64d09e688 tempest-CinderUnicodeTest-30520849 None] Lock "cinder-quobyte-b1a2cc0b-79b3-40d7-84e0-66b0e12f9b7c" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:20:39 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-470fe9c6-13ee-457d-9143-92c64d09e688 tempest-CinderUnicodeTest-30520849 None] Deleting offline snapshot b1a2cc0b-79b3-40d7-84e0-66b0e12f9b7c of volume 35423d3b-1715-4589-92fb-20af324218da {{(pid=83345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 10 13:20:39 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-470fe9c6-13ee-457d-9143-92c64d09e688 tempest-CinderUnicodeTest-30520849 None] snapshot_file for this snap is: volume-35423d3b-1715-4589-92fb-20af324218da.b1a2cc0b-79b3-40d7-84e0-66b0e12f9b7c {{(pid=83345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 10 13:20:39 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[f84753cf-cf1a-4e62-8738-fdb2e19f2a48]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:20:39 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-470fe9c6-13ee-457d-9143-92c64d09e688 tempest-CinderUnicodeTest-30520849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-35423d3b-1715-4589-92fb-20af324218da.b1a2cc0b-79b3-40d7-84e0-66b0e12f9b7c {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:39 devstack sudo[91519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-35423d3b-1715-4589-92fb-20af324218da.b1a2cc0b-79b3-40d7-84e0-66b0e12f9b7c
Apr 10 13:20:39 devstack sudo[91519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:39 devstack sudo[91517]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:39 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-5d02594a-337c-45db-99fc-1fbae4df5691 tempest-VolumeDependencyTests-1052055728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-9c018ce6-b114-4814-98e4-4a13612f79b8" returned: 0 in 0.406s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:39 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-5d02594a-337c-45db-99fc-1fbae4df5691 tempest-VolumeDependencyTests-1052055728 None] Lock "cinder-quobyte-9c018ce6-b114-4814-98e4-4a13612f79b8" released by "delete_volume" :: held 0.911s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:20:39 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-5d02594a-337c-45db-99fc-1fbae4df5691 tempest-VolumeDependencyTests-1052055728 None] Created reservations ['d7da652c-6a1a-4759-a0b9-e31a9b324e18', '2f516628-6e24-483b-b555-bc90cfc74647', '9324d31c-068e-4357-8647-59956a538262', '8ae1bd5f-d338-48d7-aa03-9e9f51f96b49'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:20:39 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-5d02594a-337c-45db-99fc-1fbae4df5691 tempest-VolumeDependencyTests-1052055728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:20:39 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-5d02594a-337c-45db-99fc-1fbae4df5691 tempest-VolumeDependencyTests-1052055728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:20:39 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-5d02594a-337c-45db-99fc-1fbae4df5691 tempest-VolumeDependencyTests-1052055728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:20:39 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-5d02594a-337c-45db-99fc-1fbae4df5691 tempest-VolumeDependencyTests-1052055728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:20:39 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-5d02594a-337c-45db-99fc-1fbae4df5691 tempest-VolumeDependencyTests-1052055728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:20:39 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-5d02594a-337c-45db-99fc-1fbae4df5691 tempest-VolumeDependencyTests-1052055728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:39 devstack sudo[91522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:20:39 devstack sudo[91522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:40 devstack sudo[91519]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:40 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-470fe9c6-13ee-457d-9143-92c64d09e688 tempest-CinderUnicodeTest-30520849 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-35423d3b-1715-4589-92fb-20af324218da.b1a2cc0b-79b3-40d7-84e0-66b0e12f9b7c" returned: 0 in 0.553s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:40 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.remotefs [None req-470fe9c6-13ee-457d-9143-92c64d09e688 tempest-CinderUnicodeTest-30520849 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35423d3b-1715-4589-92fb-20af324218da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 10 13:20:40 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[094ff11f-6d64-4127-ba48-10c8f3a28b34]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:20:40 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-470fe9c6-13ee-457d-9143-92c64d09e688 tempest-CinderUnicodeTest-30520849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-35423d3b-1715-4589-92fb-20af324218da {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:40 devstack sudo[91527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-35423d3b-1715-4589-92fb-20af324218da
Apr 10 13:20:40 devstack sudo[91527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:40 devstack sudo[91522]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:40 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-5d02594a-337c-45db-99fc-1fbae4df5691 tempest-VolumeDependencyTests-1052055728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.463s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:40 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-5d02594a-337c-45db-99fc-1fbae4df5691 tempest-VolumeDependencyTests-1052055728 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:20:40 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-5d02594a-337c-45db-99fc-1fbae4df5691 tempest-VolumeDependencyTests-1052055728 None] Deleted volume successfully.
Apr 10 13:20:40 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-5d02594a-337c-45db-99fc-1fbae4df5691 tempest-VolumeDependencyTests-1052055728 None] Lock "cinder-9c018ce6-b114-4814-98e4-4a13612f79b8-delete_volume" released by "delete_volume" :: held 1.498s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:20:40 devstack sudo[91527]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:40 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-470fe9c6-13ee-457d-9143-92c64d09e688 tempest-CinderUnicodeTest-30520849 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-35423d3b-1715-4589-92fb-20af324218da" returned: 0 in 0.563s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:40 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-470fe9c6-13ee-457d-9143-92c64d09e688 tempest-CinderUnicodeTest-30520849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-35423d3b-1715-4589-92fb-20af324218da.b1a2cc0b-79b3-40d7-84e0-66b0e12f9b7c {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:40 devstack sudo[91533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-35423d3b-1715-4589-92fb-20af324218da.b1a2cc0b-79b3-40d7-84e0-66b0e12f9b7c
Apr 10 13:20:40 devstack sudo[91533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:41 devstack sudo[91533]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:41 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-470fe9c6-13ee-457d-9143-92c64d09e688 tempest-CinderUnicodeTest-30520849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-35423d3b-1715-4589-92fb-20af324218da.b1a2cc0b-79b3-40d7-84e0-66b0e12f9b7c" returned: 0 in 0.493s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:41 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-470fe9c6-13ee-457d-9143-92c64d09e688 tempest-CinderUnicodeTest-30520849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-35423d3b-1715-4589-92fb-20af324218da.b1a2cc0b-79b3-40d7-84e0-66b0e12f9b7c {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:41 devstack sudo[91538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-35423d3b-1715-4589-92fb-20af324218da.b1a2cc0b-79b3-40d7-84e0-66b0e12f9b7c
Apr 10 13:20:41 devstack sudo[91538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:41 devstack sudo[91538]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:41 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-470fe9c6-13ee-457d-9143-92c64d09e688 tempest-CinderUnicodeTest-30520849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-35423d3b-1715-4589-92fb-20af324218da.b1a2cc0b-79b3-40d7-84e0-66b0e12f9b7c" returned: 0 in 0.392s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:41 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-470fe9c6-13ee-457d-9143-92c64d09e688 tempest-CinderUnicodeTest-30520849 None] Lock "cinder-quobyte-b1a2cc0b-79b3-40d7-84e0-66b0e12f9b7c" released by "_delete_snapshot" :: held 2.063s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:20:41 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-470fe9c6-13ee-457d-9143-92c64d09e688 tempest-CinderUnicodeTest-30520849 None] Lock "cinder-quobyte-35423d3b-1715-4589-92fb-20af324218da" released by "delete_snapshot" :: held 2.078s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:20:41 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-470fe9c6-13ee-457d-9143-92c64d09e688 tempest-CinderUnicodeTest-30520849 None] Created reservations ['81049438-dabd-4166-867a-b1fdbb0d3204', '10840c5a-136e-48de-943b-dfb0447f646a', 'ae5cce43-f52f-467e-bbd8-f0461473e434', '94da3a28-c964-47cf-9a7c-dc21a3fb2231'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:20:41 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-470fe9c6-13ee-457d-9143-92c64d09e688 tempest-CinderUnicodeTest-30520849 None] Delete snapshot completed successfully.
Apr 10 13:20:41 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-470fe9c6-13ee-457d-9143-92c64d09e688 tempest-CinderUnicodeTest-30520849 None] Lock "cinder-b1a2cc0b-79b3-40d7-84e0-66b0e12f9b7c-delete_snapshot" released by "delete_snapshot" :: held 2.157s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:20:42 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-2568419b-024f-472b-9869-93943c02c931 tempest-CinderUnicodeTest-30520849 None] Acquiring lock "cinder-35423d3b-1715-4589-92fb-20af324218da-delete_volume" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:20:42 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-2568419b-024f-472b-9869-93943c02c931 tempest-CinderUnicodeTest-30520849 None] Lock "cinder-35423d3b-1715-4589-92fb-20af324218da-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:20:42 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-2568419b-024f-472b-9869-93943c02c931 tempest-CinderUnicodeTest-30520849 None] Acquiring lock "cinder-quobyte-35423d3b-1715-4589-92fb-20af324218da" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:20:42 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-2568419b-024f-472b-9869-93943c02c931 tempest-CinderUnicodeTest-30520849 None] Lock "cinder-quobyte-35423d3b-1715-4589-92fb-20af324218da" acquired by "delete_volume" :: waited 0.008s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:20:42 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[57e969a3-5690-4dd2-a339-c563b2976c40]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:20:42 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-2568419b-024f-472b-9869-93943c02c931 tempest-CinderUnicodeTest-30520849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-35423d3b-1715-4589-92fb-20af324218da {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:42 devstack sudo[91542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-35423d3b-1715-4589-92fb-20af324218da
Apr 10 13:20:42 devstack sudo[91542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:43 devstack sudo[91542]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:43 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-2568419b-024f-472b-9869-93943c02c931 tempest-CinderUnicodeTest-30520849 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-35423d3b-1715-4589-92fb-20af324218da" returned: 0 in 0.478s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:43 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-2568419b-024f-472b-9869-93943c02c931 tempest-CinderUnicodeTest-30520849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-35423d3b-1715-4589-92fb-20af324218da {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:43 devstack sudo[91547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-35423d3b-1715-4589-92fb-20af324218da
Apr 10 13:20:43 devstack sudo[91547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:43 devstack sudo[91547]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:43 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-2568419b-024f-472b-9869-93943c02c931 tempest-CinderUnicodeTest-30520849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-35423d3b-1715-4589-92fb-20af324218da" returned: 0 in 0.393s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:43 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-2568419b-024f-472b-9869-93943c02c931 tempest-CinderUnicodeTest-30520849 None] Lock "cinder-quobyte-35423d3b-1715-4589-92fb-20af324218da" released by "delete_volume" :: held 0.907s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:20:43 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-2568419b-024f-472b-9869-93943c02c931 tempest-CinderUnicodeTest-30520849 None] Created reservations ['fc15e0e1-1a17-4ba4-b092-f941dc59b13f', 'ab812367-7953-402c-8ce6-06fd15f94295', '96913ae2-d7db-4939-a263-cd2cb4566ed5', '7aed62c7-ba34-4538-acfb-d7124a3b4090'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:20:43 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-2568419b-024f-472b-9869-93943c02c931 tempest-CinderUnicodeTest-30520849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:20:43 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-2568419b-024f-472b-9869-93943c02c931 tempest-CinderUnicodeTest-30520849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:20:43 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-2568419b-024f-472b-9869-93943c02c931 tempest-CinderUnicodeTest-30520849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:20:43 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-2568419b-024f-472b-9869-93943c02c931 tempest-CinderUnicodeTest-30520849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:20:43 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-2568419b-024f-472b-9869-93943c02c931 tempest-CinderUnicodeTest-30520849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:20:43 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-2568419b-024f-472b-9869-93943c02c931 tempest-CinderUnicodeTest-30520849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:43 devstack sudo[91550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:20:43 devstack sudo[91550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:43 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-43efea93-c93f-4340-b3f2-685bfab2d0b5 tempest-CinderUnicodeTest-30520849 None] Acquiring lock "cinder-300bc2c2-6522-4821-8413-42934dc1a554-delete_volume" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:20:43 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-43efea93-c93f-4340-b3f2-685bfab2d0b5 tempest-CinderUnicodeTest-30520849 None] Lock "cinder-300bc2c2-6522-4821-8413-42934dc1a554-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:20:43 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-43efea93-c93f-4340-b3f2-685bfab2d0b5 tempest-CinderUnicodeTest-30520849 None] Acquiring lock "cinder-quobyte-300bc2c2-6522-4821-8413-42934dc1a554" by "delete_volume" {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 10 13:20:43 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-43efea93-c93f-4340-b3f2-685bfab2d0b5 tempest-CinderUnicodeTest-30520849 None] Lock "cinder-quobyte-300bc2c2-6522-4821-8413-42934dc1a554" acquired by "delete_volume" :: waited 0.018s {{(pid=83345) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 10 13:20:43 devstack cinder-volume[83345]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b4e8248-cb64-45bf-bfec-932915bfeaed]: (4, 'qcow2') {{(pid=84247) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 10 13:20:43 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-43efea93-c93f-4340-b3f2-685bfab2d0b5 tempest-CinderUnicodeTest-30520849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-300bc2c2-6522-4821-8413-42934dc1a554 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:43 devstack sudo[91552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-300bc2c2-6522-4821-8413-42934dc1a554
Apr 10 13:20:43 devstack sudo[91552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:44 devstack sudo[91550]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:44 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-2568419b-024f-472b-9869-93943c02c931 tempest-CinderUnicodeTest-30520849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.432s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:44 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-2568419b-024f-472b-9869-93943c02c931 tempest-CinderUnicodeTest-30520849 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:20:44 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-2568419b-024f-472b-9869-93943c02c931 tempest-CinderUnicodeTest-30520849 None] Deleted volume successfully.
Apr 10 13:20:44 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-2568419b-024f-472b-9869-93943c02c931 tempest-CinderUnicodeTest-30520849 None] Lock "cinder-35423d3b-1715-4589-92fb-20af324218da-delete_volume" released by "delete_volume" :: held 1.469s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:20:44 devstack sudo[91552]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:44 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-43efea93-c93f-4340-b3f2-685bfab2d0b5 tempest-CinderUnicodeTest-30520849 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-300bc2c2-6522-4821-8413-42934dc1a554" returned: 0 in 0.493s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:44 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-43efea93-c93f-4340-b3f2-685bfab2d0b5 tempest-CinderUnicodeTest-30520849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-300bc2c2-6522-4821-8413-42934dc1a554 {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:44 devstack sudo[91558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-300bc2c2-6522-4821-8413-42934dc1a554
Apr 10 13:20:44 devstack sudo[91558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:44 devstack sudo[91558]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:44 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-43efea93-c93f-4340-b3f2-685bfab2d0b5 tempest-CinderUnicodeTest-30520849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b/volume-300bc2c2-6522-4821-8413-42934dc1a554" returned: 0 in 0.410s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:44 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-43efea93-c93f-4340-b3f2-685bfab2d0b5 tempest-CinderUnicodeTest-30520849 None] Lock "cinder-quobyte-300bc2c2-6522-4821-8413-42934dc1a554" released by "delete_volume" :: held 0.926s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:20:44 devstack cinder-volume[83345]: DEBUG cinder.quota [None req-43efea93-c93f-4340-b3f2-685bfab2d0b5 tempest-CinderUnicodeTest-30520849 None] Created reservations ['6945a59a-6128-4550-8730-b91bdd09af73', 'da38f773-d148-4671-8ab8-390aa46c94cd', '46d229ce-9ec6-474b-ad86-44ad0183501d', '44d64add-df4b-441c-be12-99fb6690e879'] {{(pid=83345) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 10 13:20:44 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-43efea93-c93f-4340-b3f2-685bfab2d0b5 tempest-CinderUnicodeTest-30520849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:20:44 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-43efea93-c93f-4340-b3f2-685bfab2d0b5 tempest-CinderUnicodeTest-30520849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:20:44 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-43efea93-c93f-4340-b3f2-685bfab2d0b5 tempest-CinderUnicodeTest-30520849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:20:44 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-43efea93-c93f-4340-b3f2-685bfab2d0b5 tempest-CinderUnicodeTest-30520849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:20:44 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-43efea93-c93f-4340-b3f2-685bfab2d0b5 tempest-CinderUnicodeTest-30520849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:20:44 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-43efea93-c93f-4340-b3f2-685bfab2d0b5 tempest-CinderUnicodeTest-30520849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:44 devstack sudo[91561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:20:44 devstack sudo[91561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:45 devstack sudo[91561]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:45 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-43efea93-c93f-4340-b3f2-685bfab2d0b5 tempest-CinderUnicodeTest-30520849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.460s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:45 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-43efea93-c93f-4340-b3f2-685bfab2d0b5 tempest-CinderUnicodeTest-30520849 None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:20:45 devstack cinder-volume[83345]: INFO cinder.volume.manager [None req-43efea93-c93f-4340-b3f2-685bfab2d0b5 tempest-CinderUnicodeTest-30520849 None] Deleted volume successfully.
Apr 10 13:20:45 devstack cinder-volume[83345]: DEBUG cinder.coordination [None req-43efea93-c93f-4340-b3f2-685bfab2d0b5 tempest-CinderUnicodeTest-30520849 None] Lock "cinder-300bc2c2-6522-4821-8413-42934dc1a554-delete_volume" released by "delete_volume" :: held 1.524s {{(pid=83345) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 10 13:20:53 devstack cinder-volume[83345]: DEBUG oslo_service.periodic_task [None req-c3f44832-ad7f-424b-a850-32c7352a19c5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83345) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 10 13:20:53 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-c3f44832-ad7f-424b-a850-32c7352a19c5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 10 13:20:53 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-c3f44832-ad7f-424b-a850-32c7352a19c5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 10 13:20:53 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-c3f44832-ad7f-424b-a850-32c7352a19c5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331': None} {{(pid=83345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 10 13:20:53 devstack cinder-volume[83345]: DEBUG cinder.volume.drivers.quobyte [None req-c3f44832-ad7f-424b-a850-32c7352a19c5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-450c9fba-d3c6-4e0a-9875-297368d5b331'] {{(pid=83345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 10 13:20:53 devstack cinder-volume[83345]: DEBUG oslo_concurrency.lockutils [None req-c3f44832-ad7f-424b-a850-32c7352a19c5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83345) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 10 13:20:53 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-c3f44832-ad7f-424b-a850-32c7352a19c5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 10 13:20:53 devstack sudo[91780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b
Apr 10 13:20:53 devstack sudo[91780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 10 13:20:53 devstack sudo[91780]: pam_unix(sudo:session): session closed for user root
Apr 10 13:20:53 devstack cinder-volume[83345]: DEBUG oslo_concurrency.processutils [None req-c3f44832-ad7f-424b-a850-32c7352a19c5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/640f6afd5f8f98165dd1a9222e64c65b" returned: 0 in 0.395s {{(pid=83345) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 10 13:20:53 devstack cinder-volume[83345]: DEBUG cinder.manager [None req-c3f44832-ad7f-424b-a850-32c7352a19c5 None None] Notifying Schedulers of capabilities ... {{(pid=83345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 10 13:20:54 devstack cinder-volume[83345]: DEBUG dbcounter [-] [83345] Writing DB stats cinder:SELECT=160,cinder:INSERT=61,cinder:UPDATE=220,cinder:DELETE=15 {{(pid=83345) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 10 13:20:55 devstack cinder-volume[83345]: DEBUG dbcounter [-] [83345] Writing DB stats cinder:UPDATE=61,cinder:INSERT=12,cinder:DELETE=6,cinder:SELECT=33 {{(pid=83345) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}